00010000:00080000:2.2F:1788563883.505554:0:0:0:(ldlm_lib.c:3056:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00010000:00080000:3.2F:1788564018.505546:0:0:0:(ldlm_lib.c:3056:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00010000:00010000:2.0:1788572074.191456:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc3aa lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191462:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc3aa lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191466:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.191469:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc3aa lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191473:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc3aa lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191505:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a1fbf4200) 00010000:00010000:2.0:1788572074.191508:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.191511:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc3aa lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191517:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc3aa lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191527:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc3b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x202e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191533:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc3b1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x202e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191538:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc3b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x202e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191543:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.191546:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc3b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x202e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191555:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc3b1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x202e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191563:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x202e:0x0].0x0 (ffff8e5a318f4f00) 00010000:00010000:2.0:1788572074.191565:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.191568:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc3b1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x202e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191573:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc3b1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x202e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191586:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc3b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191592:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc3b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191597:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc3b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191601:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.191604:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc3b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191609:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc3b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191615:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x39:0x0].0x0 (ffff8e5a318f4a00) 00010000:00010000:2.0:1788572074.191617:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.191620:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc3b8 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191629:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc3b8 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191642:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bc40c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191648:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bc40c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191654:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bc40c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191659:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.191661:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bc40c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191668:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bc40c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191677:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a1fbf4200) 00010000:00010000:2.0:1788572074.191679:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.191681:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bc40c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.191686:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bc40c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.206790:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569429376 00000100:00100000:2.0:1788572074.206799:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569429376 00000100:00100000:2.0:1788572074.206852:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 759 00000100:00100000:2.0:1788572074.206862:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:156893:x1875444569429376:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:2.0:1788572074.206892:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572074.206912:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc491 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bafa0 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.206976:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.206990:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207002:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207016:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207023:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207029:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207097:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc4a6 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207104:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc4a6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207110:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc4a6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572074.207212:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x202f:0x0]: returning size 4096 00000004:00200000:2.0:1788572074.207218:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1788572074.207242:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc4a6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207253:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207259:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207265:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207271:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.207275:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207283:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207295:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572074.207298:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.207303:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207309:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc498 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207324:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207333:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207338:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207342:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.207345:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207351:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207357:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a16272300) 00010000:00010000:2.0:1788572074.207360:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.207363:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207368:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc49f lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207400:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc491 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafa0 expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207414:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc4a6 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafa0 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.207420:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x202f:0x0].0x0 (ffff8e5a16272200) 00010000:00010000:2.0:1788572074.207422:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572074.207425:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0c00, rc 0) 00000100:00100000:2.0:1788572074.207514:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+10:156893:x1875444569429376:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 651us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.207521:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 759 00000100:00100000:2.0:1788572074.220133:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584150912 00000100:00100000:2.0:1788572074.220148:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584150912 00000100:00100000:2.0:1788572074.220213:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572074.220226:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:188107:x1875444584150912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.220431:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:188107:x1875444584150912:12345-0@lo:1000:osp_up1-0.0 Request processed in 207us (11664us total) trans 21474837309 rc 0/0 00000100:00100000:2.0:1788572074.220440:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572074.222962:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584151168 00000100:00100000:2.0:1788572074.222971:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584151168 00000100:00100000:2.0:1788572074.223026:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572074.223036:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904154050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:188107:x1875444584151168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.223375:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904154050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:188107:x1875444584151168:12345-0@lo:1000:osp_up1-0.0 Request processed in 339us (448us total) trans 21474837310 rc 0/0 00000100:00100000:2.0:1788572074.223382:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572074.229557:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584151936 00000100:00100000:2.0:1788572074.229566:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584151936 00000100:00100000:2.0:1788572074.229619:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572074.229628:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:188107:x1875444584151936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.229781:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:188107:x1875444584151936:12345-0@lo:1000:osp_up1-0.0 Request processed in 153us (270us total) trans 21474837313 rc 0/0 00000100:00100000:2.0:1788572074.229788:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572074.230016:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584152192 00000100:00100000:2.0:1788572074.230021:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584152192 00000100:00100000:2.0:1788572074.230048:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788572074.230053:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:188107:x1875444584152192:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.230130:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+20:188107:x1875444584152192:12345-0@lo:1000:osp_up1-0.0 Request processed in 68us (147us total) trans 21474837314 rc 0/0 00000100:00100000:2.0:1788572074.230137:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788572074.230382:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584152448 00000100:00100000:2.0:1788572074.230387:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584152448 00000100:00100000:2.0:1788572074.230447:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788572074.230454:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+20:188107:x1875444584152448:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.230547:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+21:188107:x1875444584152448:12345-0@lo:1000:osp_up1-0.0 Request processed in 92us (282us total) trans 21474837315 rc 0/0 00000100:00100000:2.0:1788572074.230554:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788572074.258883:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584153344 00000100:00100000:2.0:1788572074.258898:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584153344 00000100:00100000:2.0:1788572074.259168:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569430144 00000100:00100000:2.0:1788572074.259173:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569430144 00010000:00010000:2.0:1788572074.259204:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bc4c2 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafae expref: 7 pid: 188049 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.259285:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12852 00000100:00100000:2.0:1788572074.259297:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2397:x1875444569430144:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572074.259313:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572074.259320:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bc4c2 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafae expref: 7 pid: 188049 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.259340:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bc4c2 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafae expref: 7 pid: 188049 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.259372:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bc4c2 lrc: 0/0,0 mode: --/PR res: [0x240002728:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafae expref: 7 pid: 188049 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.259405:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3a:0x0].0x0 (ffff8e5a318f4000) 00010000:00010000:2.0:1788572074.259415:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bc4ec lrc: 2/0,0 mode: --/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc4e5 expref: 23 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.259435:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bc4ec lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bc4e5 expref: 23 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.259446:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bc4ec lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bc4e5 expref: 23 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.260288:0:8447:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bc4ec lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc4e5 expref: 23 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.260307:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8447:1875444584153472:0@lo:105: 00000100:00100000:2.0:1788572074.260355:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.260407:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.260428:0:13337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584153472 00000100:00100000:2.0:1788572074.260433:0:13337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584153472 00000100:00100000:2.0:1788572074.260466:0:13337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5364 00000100:00100000:2.0:1788572074.260676:0:13337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8447:x1875444584153472:12345-0@lo:105: 00010000:00010000:2.0:1788572074.260689:0:13337:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.260704:0:13337:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.260711:0:13337:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.260719:0:13337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.260726:0:13337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.260734:0:13337:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.260754:0:13337:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a00031000) 00000100:00100000:2.0:1788572074.260791:0:13337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8447:x1875444584153472:12345-0@lo:105: Request processed in 317us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.260797:0:13337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5364 00000100:00100000:2.0:1788572074.260829:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8447:1875444584153472:0@lo:105: 00010000:00010000:2.0:1788572074.260842:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572074.260882:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569430144:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1586us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.260889:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12852 00010000:00010000:2.0:1788572074.268739:0:188050:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.268761:0:188050:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.269469:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584153856:0@lo:403:mdt00_002.0 00000100:00100000:2.0:1788572074.271043:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.271057:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.271690:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27421f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584154880:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.271702:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 845 rpc_version 845 00000020:00100000:2.0:1788572074.271716:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.271722:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd1f80 x1875444584155136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.271736:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584155136:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.271767:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.271779:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.280231:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584155136 00000100:00100000:2.0:1788572074.280244:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584155136 00000100:00100000:2.0:1788572074.280928:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584155136:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.280943:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 846 rpc_version 846 00000020:00100000:2.0:1788572074.280967:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.280975:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd3b80 x1875444584155392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.280997:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584155392:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.281034:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.281063:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.282369:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584155392:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.282439:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 847 rpc_version 847 00000020:00100000:2.0:1788572074.282460:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.282468:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd2a00 x1875444584155648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.283458:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584155648 00000100:00100000:2.0:1788572074.283464:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584155648 00000100:00100000:2.0:1788572074.283594:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788572074.283603:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+32:188107:x1875444584155648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.283732:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:188107:x1875444584155648:12345-0@lo:1000:osp_up1-0.0 Request processed in 130us (505us total) trans 21474837325 rc 0/0 00000100:00100000:2.0:1788572074.283739:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788572074.285567:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584155648:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572074.285590:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 848 rpc_version 848 00000020:00100000:0.0:1788572074.285619:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572074.285626:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27420000 x1875444584155904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572074.285649:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584155904:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.285706:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.285744:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.286346:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584155904 00000100:00100000:2.0:1788572074.286354:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584155904 00000100:00100000:2.0:1788572074.286418:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788572074.286429:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:188107:x1875444584155904:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.286650:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+34:188107:x1875444584155904:12345-0@lo:1000:osp_up1-0.0 Request processed in 222us (943us total) trans 21474837326 rc 0/0 00000100:00100000:2.0:1788572074.286660:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788572074.287265:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584155904:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572074.287281:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 849 rpc_version 849 00000020:00100000:0.0:1788572074.287305:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572074.287312:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27422680 x1875444584156160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572074.287335:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27422680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584156160:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.287377:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.287397:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.287657:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:188050:x1875444584153856:12345-0@lo:403:mdt00_002.0 Request processed in 16452us (16612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572074.287666:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788572074.287689:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584156160 00000100:00100000:0.0:1788572074.287695:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584156160 00000100:00100000:0.0:1788572074.287720:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788572074.287727:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:188107:x1875444584156160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.287849:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+34:188107:x1875444584156160:12345-0@lo:1000:osp_up1-0.0 Request processed in 121us (471us total) trans 21474837327 rc 0/0 00000100:00100000:0.0:1788572074.287857:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788572074.287906:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27422680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584156160:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572074.287915:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 850 rpc_version 850 00000020:00100000:0.0:1788572074.287928:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572074.287934:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27422300 x1875444584156416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572074.289994:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584156416:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.290056:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.290095:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.293662:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584156416 00000100:00100000:2.0:1788572074.293677:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584156416 00000100:00100000:2.0:1788572074.293735:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788572074.293746:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+34:188107:x1875444584156416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.293958:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+35:188107:x1875444584156416:12345-0@lo:1000:osp_up1-0.0 Request processed in 214us (3900us total) trans 21474837328 rc 0/0 00000100:00100000:2.0:1788572074.293966:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572074.294173:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584156416:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572074.294192:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 851 rpc_version 851 00000020:00100000:0.0:1788572074.294217:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572074.294224:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462df80 x1875444584156672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572074.294245:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584156672:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.294287:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.294354:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.314249:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584156672:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572074.314267:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 852 rpc_version 852 00000020:00100000:0.0:1788572074.314290:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572074.314298:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462ca80 x1875444584156928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572074.314323:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584156928:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.314364:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.314397:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.314424:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584156928 00000100:00100000:0.0:1788572074.314431:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584156928 00000100:00100000:0.0:1788572074.314459:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572074.314465:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+36:188107:x1875444584156928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.314569:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+37:188107:x1875444584156928:12345-0@lo:1000:osp_up1-0.0 Request processed in 103us (204us total) trans 21474837330 rc 0/0 00000100:00100000:0.0:1788572074.314576:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572074.314606:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584156928:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572074.314613:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 853 rpc_version 853 00000020:00100000:0.0:1788572074.314625:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572074.314630:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462d180 x1875444584157184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572074.314643:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584157184:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.314672:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.314684:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.329064:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788572074.329082:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+52:188107:x1875444584161024:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.329299:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+53:188107:x1875444584161024:12345-0@lo:1000:osp_up1-0.0 Request processed in 223us (5233us total) trans 21474837346 rc 0/0 00000100:00100000:0.0:1788572074.329308:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788572074.344609:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584162048:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.344625:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 873 rpc_version 873 00000020:00100000:2.0:1788572074.344651:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.344658:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd3800 x1875444584162304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.344680:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584162304:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.344724:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.344752:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.345887:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584162304 00000100:00100000:0.0:1788572074.345907:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584162304 00000100:00100000:0.0:1788572074.345959:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788572074.345968:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+57:188107:x1875444584162304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.346161:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+58:188107:x1875444584162304:12345-0@lo:1000:osp_up1-0.0 Request processed in 194us (1436us total) trans 21474837351 rc 0/0 00000100:00100000:0.0:1788572074.346168:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788572074.346279:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584162304:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.346296:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 874 rpc_version 874 00000020:00100000:2.0:1788572074.346319:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.346326:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd2d80 x1875444584162560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.346346:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584162560:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.346401:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.346434:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.346523:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584162560 00000100:00100000:0.0:1788572074.346528:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584162560 00000100:00100000:0.0:1788572074.346549:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788572074.346556:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+58:188107:x1875444584162560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.346650:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+59:188107:x1875444584162560:12345-0@lo:1000:osp_up1-0.0 Request processed in 93us (248us total) trans 21474837352 rc 0/0 00000100:00100000:0.0:1788572074.346658:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788572074.346691:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584162560:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.346699:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 875 rpc_version 875 00000020:00100000:2.0:1788572074.346712:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.346718:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd1c00 x1875444584162816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.346731:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584162816:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.346767:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.346790:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.347554:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584162816:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.347565:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 876 rpc_version 876 00000020:00100000:2.0:1788572074.347580:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.347585:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590c440e00 x1875444584163072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.347600:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c440e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584163072:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.347627:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.347653:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.347888:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584163072 00000100:00100000:0.0:1788572074.347959:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584163072 00000100:00100000:0.0:1788572074.347992:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788572074.348000:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+60:188107:x1875444584163072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.348339:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+61:188107:x1875444584163072:12345-0@lo:1000:osp_up1-0.0 Request processed in 340us (711us total) trans 21474837354 rc 0/0 00000100:00100000:0.0:1788572074.348347:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788572074.348808:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c440e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584163072:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.348819:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 877 rpc_version 877 00000020:00100000:2.0:1788572074.348836:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.348842:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590c441500 x1875444584163328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.348858:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c441500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584163328:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.348894:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.348916:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.350091:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584163328 00000100:00100000:2.0:1788572074.350100:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584163328 00000100:00100000:2.0:1788572074.350161:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788572074.350171:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+61:188107:x1875444584163328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.350348:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+62:188107:x1875444584163328:12345-0@lo:1000:osp_up1-0.0 Request processed in 178us (1453us total) trans 21474837355 rc 0/0 00000100:00100000:2.0:1788572074.350355:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788572074.350402:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c441500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584163328:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.350411:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 878 rpc_version 878 00000020:00100000:2.0:1788572074.350426:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.350433:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590c443480 x1875444584163584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.350449:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c443480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584163584:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.350527:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.350554:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.350704:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584163584 00000100:00100000:2.0:1788572074.350708:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584163584 00000100:00100000:2.0:1788572074.350728:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788572074.350733:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+62:188107:x1875444584163584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.350819:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:188107:x1875444584163584:12345-0@lo:1000:osp_up1-0.0 Request processed in 85us (291us total) trans 21474837356 rc 0/0 00000100:00100000:2.0:1788572074.350825:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788572074.350975:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c443480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584163584:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572074.350984:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 879 rpc_version 879 00000020:00100000:0.0:1788572074.350998:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572074.351004:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462e680 x1875444584163840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572074.351017:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584163840:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.351056:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.351087:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.351619:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584163840 00000100:00100000:2.0:1788572074.351627:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584163840 00000100:00100000:2.0:1788572074.351662:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788572074.351671:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904156850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+63:188107:x1875444584163840:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.351784:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904156850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+64:188107:x1875444584163840:12345-0@lo:1000:osp_up1-0.0 Request processed in 114us (727us total) trans 21474837357 rc 0/0 00000100:00100000:2.0:1788572074.351791:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788572074.352126:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584163840:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572074.352137:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 880 rpc_version 880 00000020:00100000:0.0:1788572074.352153:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572074.352158:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462dc00 x1875444584164096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572074.352176:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584164096:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.352209:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.352235:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.352515:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584164096:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.352525:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 881 rpc_version 881 00000020:00100000:2.0:1788572074.352538:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.352544:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31c81180 x1875444584164352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.352561:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c81180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584164352:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.352589:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.352610:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.352711:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584164352 00000100:00100000:0.0:1788572074.352716:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584164352 00000100:00100000:0.0:1788572074.352748:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788572074.352755:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+65:188107:x1875444584164352:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.352849:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+66:188107:x1875444584164352:12345-0@lo:1000:osp_up1-0.0 Request processed in 95us (259us total) trans 21474837359 rc 0/0 00000100:00100000:0.0:1788572074.352855:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788572074.353176:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c81180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584164352:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572074.353185:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 882 rpc_version 882 00000020:00100000:2.0:1788572074.353198:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572074.353203:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31c82680 x1875444584164608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572074.353217:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584164608:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.353250:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.353286:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.353371:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584164608 00000100:00100000:0.0:1788572074.353376:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584164608 00000100:00100000:0.0:1788572074.353414:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788572074.353422:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+66:188107:x1875444584164608:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.353533:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+67:188107:x1875444584164608:12345-0@lo:1000:osp_up1-0.0 Request processed in 111us (282us total) trans 21474837360 rc 0/0 00000100:00100000:0.0:1788572074.353540:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788572074.355031:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584164864 00000100:00100000:2.0:1788572074.355038:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584164864 00000100:00100000:2.0:1788572074.355084:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788572074.355093:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+67:188107:x1875444584164864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.355225:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+68:188107:x1875444584164864:12345-0@lo:1000:osp_up1-0.0 Request processed in 132us (633us total) trans 21474837361 rc 0/0 00000100:00100000:2.0:1788572074.355234:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788572074.357797:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584165120 00000100:00100000:2.0:1788572074.357809:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584165120 00000100:00100000:2.0:1788572074.357861:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788572074.357871:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+68:188107:x1875444584165120:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.358806:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+69:188107:x1875444584165120:12345-0@lo:1000:osp_up1-0.0 Request processed in 921us (2535us total) trans 21474837362 rc 0/0 00000100:00100000:2.0:1788572074.358816:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788572074.369437:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584165248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572074.369527:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572074.370197:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572074.370393:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584165248:0@lo:13:osp-pre-1-0.0 00000004:00200000:2.0:1788572074.371185:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x202f:0x0]: returning size 4096 00000100:00100000:0.0:1788572074.371270:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572074.371286:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584165376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572074.371333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.371372:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584165504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572074.371403:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572074.372308:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bc4de lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372319:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bc4de lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372328:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bc4de lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372335:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.372340:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bc4de lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372348:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bc4de lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372363:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3a:0x0].0x0 (ffff8e5a318f4e00) 00010000:00010000:0.0:1788572074.372367:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572074.372372:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bc4de lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372379:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bc4de lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372402:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372411:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372419:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00031000/0x265cfe11109bc4e5 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc4ec expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372436:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572074.372445:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3a:0x0] 00010000:00010000:0.0:1788572074.372452:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bc4d7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372460:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bc4d7 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372466:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bc4d7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372472:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.372475:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bc4d7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372504:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bc4d7 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372513:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x202f:0x0].0x0 (ffff8e5a36aabb00) 00010000:00010000:0.0:1788572074.372516:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572074.372520:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bc4d7 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372526:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bc4d7 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x202f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372548:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bc4c9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372555:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bc4c9 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372562:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bc4c9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372567:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.372571:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bc4c9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372578:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bc4c9 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372587:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572074.372590:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572074.372593:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bc4c9 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372599:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bc4c9 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572074.372613:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000002dfc80 reply state 00000000c0cde193 transno 330712481904 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bc4d0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372626:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bc4d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.372634:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572074.372636:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572074.372639:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572074.372715:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:156893:x1875444569429888:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 132915us (133029us total) trans 330712481904 rc 0/0 00000100:00100000:0.0:1788572074.372724:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 762 00000100:00100000:2.0:1788572074.373067:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584165504 00000100:00100000:2.0:1788572074.373076:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584165504 00000100:00100000:2.0:1788572074.373129:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788572074.373141:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584165504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572074.373175:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444978688 avail 1298739200 00000100:00100000:2.0:1788572074.373232:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584165504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.373245:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788572074.373512:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584165632 00000100:00100000:2.0:1788572074.373516:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584165632 00000100:00100000:2.0:1788572074.373549:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4620 00000100:00100000:2.0:1788572074.373556:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+69:3641:x1875444584165632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572074.373566:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572074.373585:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bc4ec lrc: 0/0,0 mode: --/EX res: [0x240002728:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bc4e5 expref: 69 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.373601:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3a:0x0].0x0 (ffff8e5a318f4000) 00010000:00010000:2.0:1788572074.373608:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572074.373638:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+68:3641:x1875444584165632:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.373647:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4620 00000100:00100000:0.0:1788572074.396999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572074.415080:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569430528 00000100:00100000:0.0:1788572074.415091:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569430528 00000100:00100000:0.0:1788572074.415152:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 765 00000100:00100000:0.0:1788572074.415162:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:156898:x1875444569430528:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572074.415181:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572074.415199:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc51d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bafc3 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.415259:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc524 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.415274:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc524 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.415285:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc524 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572074.415327:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:0.0:1788572074.415330:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572074.415348:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc524 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.415371:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc51d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafc3 expref: 13 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.415386:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc524 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafc3 expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.415395:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572074.415399:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572074.415402:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2200, rc 0) 00000100:00100000:0.0:1788572074.415464:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:156898:x1875444569430528:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 304us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572074.415472:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 765 00000100:00100000:0.0:1788572074.445005:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569430784 00000100:00100000:0.0:1788572074.445021:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569430784 00000100:00100000:0.0:1788572074.445092:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 766 00000100:00100000:0.0:1788572074.445102:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:156898:x1875444569430784:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:0.0:1788572074.445181:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572074.445211:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc524 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafc3 expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.445229:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572074.445235:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572074.445295:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.445309:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.445320:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.445331:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.445339:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.445349:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572074.447273:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].431, 2152 off647496 00000040:00080000:0.0:1788572074.447361:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].463, 2352 off748240 00000004:00080000:0.0:1788572074.447372:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e59061c7780 with version 885 00000100:00100000:2.0:1788572074.452761:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584166016 00000100:00100000:2.0:1788572074.452771:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584166016 00000100:00100000:2.0:1788572074.452837:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788572074.452846:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+69:188048:x1875444584166016:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572074.452865:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572074.453076:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bc54e lrc: 2/0,0 mode: --/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bc547 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.453107:0:188053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bc54e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bc547 expref: 70 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.453132:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bc54e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc547 expref: 70 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.453142:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3b:0x0].0x0 (ffff8e5a16272300) 00010000:00010000:2.0:1788572074.453145:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.453148:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1200, rc 0) 00000100:00100000:2.0:1788572074.453211:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+70:188048:x1875444584166016:12345-0@lo:101:mdt00_000.0 Request processed in 366us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.453217:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788572074.453607:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584166016:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788572074.453627:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01670e00/0x265cfe11109bc547 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc54e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453637:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01670e00/0x265cfe11109bc547 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc54e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572074.453660:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc26e1dc reply state 0000000078a084a8 transno 330712481905 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bc540 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453672:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bc540 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453679:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3b:0x0].0x0 (ffff8e5a36aab600) 00010000:00010000:0.0:1788572074.453682:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572074.453685:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572074.453690:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01670e00/0x265cfe11109bc547 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc54e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453698:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01670e00/0x265cfe11109bc547 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc54e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572074.453715:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3b:0x0] 00000004:00010000:0.0:1788572074.453722:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc26e1dc reply state 0000000078a084a8 transno 330712481905 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bc539 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453730:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bc539 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453736:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2030:0x0].0x0 (ffff8e5a36aaba00) 00010000:00010000:0.0:1788572074.453738:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572074.453740:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1788572074.453745:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2030:0x0]: returning size 4096 00010000:00010000:0.0:1788572074.453756:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453763:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453769:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453775:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.453779:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453787:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453798:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572074.453801:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572074.453805:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453812:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc52b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572074.453835:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc26e1dc reply state 0000000078a084a8 transno 330712481905 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453845:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.453851:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572074.453854:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572074.453856:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1788572074.453934:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:156898:x1875444569430784:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 8832us (13611us total) trans 330712481905 rc 0/0 00000100:00100000:0.0:1788572074.453942:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 766 00000100:00100000:2.0:1788572074.486144:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572074.486224:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569430912 00000100:00100000:0.0:1788572074.486234:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569430912 00000100:00100000:0.0:1788572074.486290:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 767 00000100:00100000:0.0:1788572074.486306:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:156900:x1875444569430912:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572074.486329:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572074.486350:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc555 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bafca expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486405:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486418:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486434:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486444:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486451:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486457:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486571:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc56a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486578:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc56a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486584:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc56a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572074.486659:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2030:0x0]: returning size 4096 00000004:00200000:0.0:1788572074.486663:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1788572074.486695:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc56a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486707:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486714:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486732:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486738:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.486742:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486750:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486762:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572074.486765:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572074.486770:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486777:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc55c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486790:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486796:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486801:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486806:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.486808:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486818:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486824:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572074.486827:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572074.486830:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486835:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc563 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486861:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc555 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafca expref: 15 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486875:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc56a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafca expref: 14 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.486881:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2030:0x0].0x0 (ffff8e5a36aaba00) 00010000:00010000:0.0:1788572074.486883:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572074.486886:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2400, rc 0) 00000100:00100000:0.0:1788572074.486941:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:156900:x1875444569430912:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 642us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572074.486948:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 767 00000100:00100000:0.0:1788572074.500311:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569431168 00000100:00100000:0.0:1788572074.500321:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569431168 00000100:00100000:0.0:1788572074.500376:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 769 00000100:00100000:0.0:1788572074.500387:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:156900:x1875444569431168:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572074.500408:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572074.500427:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc57f lrc: 2/0,0 mode: --/CR res: [0x240002728:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bafd8 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.500541:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.500557:0:188833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bc54e lrc: 2/0,0 mode: PW/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc547 expref: 69 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.500567:0:188833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 4/1,0 mode: --/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.500602:0:188833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bc54e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bc547 expref: 69 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.500618:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188833:1875444584166144:0@lo:104: 00000100:00100000:0.0:1788572074.500667:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.500704:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0459a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.502140:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188833:1875444584166144:0@lo:104: 00010000:00010000:0.0:1788572074.502161:0:188833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.504247:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bc54e lrc: 0/0,0 mode: --/PW res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bc547 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.504267:0:152004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3b:0x0].0x0 (ffff8e5a16272300) 00010000:00010000:2.0:1788572074.504272:0:152004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.504282:0:152004:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.504289:0:152004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.504438:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572074.504549:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584166272:12345-0@lo:103:ldlm_bl.0 Request processed in 3383us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.504559:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12853 00010000:00010000:0.0:1788572074.509772:0:188833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.509784:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572074.509851:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002728:0x3b:0x0]: returning size 4096 00000004:00200000:0.0:1788572074.509858:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1788572074.509922:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc57f lrc: 0/0,0 mode: --/CR res: [0x240002728:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd8 expref: 8 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.509943:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd8 expref: 7 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.509953:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3b:0x0].0x0 (ffff8e5a16272300) 00010000:00010000:0.0:1788572074.509956:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788572074.509959:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2c00, rc 0) 00000100:00100000:0.0:1788572074.510028:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:156900:x1875444569431168:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 9642us (9823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572074.510037:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 769 00000100:00100000:2.0:1788572074.519660:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572074.525132:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:188050:1875444584166400:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572074.525167:0:188050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.526565:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572074.526613:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569431552 00000100:00100000:0.0:1788572074.526620:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569431552 00010000:00010000:0.0:1788572074.526660:0:43930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bc578 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd1 expref: 15 pid: 188050 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.526696:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12854 00000100:00100000:0.0:1788572074.526705:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+15:2398:x1875444569431552:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572074.526720:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572074.526726:0:43930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bc578 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd1 expref: 15 pid: 188050 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.526739:0:43930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bc578 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd1 expref: 15 pid: 188050 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.526766:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bc578 lrc: 0/0,0 mode: --/PR res: [0x200025d90:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd1 expref: 15 pid: 188050 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.539787:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3b:0x0].0x0 (ffff8e5a36aab600) 00010000:00010000:0.0:1788572074.539802:0:43930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.539815:0:43930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.539823:0:43930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 4/0,1 mode: EX/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.539869:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572074.539952:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:2398:x1875444569431552:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 13243us (13389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572074.539962:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12854 00000100:00100000:0.0:1788572074.540643:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584166528 00000100:00100000:0.0:1788572074.540650:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584166528 00000100:00100000:0.0:1788572074.540698:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788572074.540708:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:188050:x1875444584166528:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788572074.540725:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572074.540742:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc5b0 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bc5a9 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.540765:0:189111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd8 expref: 6 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.540780:0:189111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc5b0 lrc: 4/0,0 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bc5a9 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.540805:0:189111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd8 expref: 6 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.540819:0:189111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd8 expref: 6 pid: 188833 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.540830:0:189111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:189111:1875444584166656:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572074.540880:0:189111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0459a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.545770:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572074.546067:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569431680 00000100:00100000:2.0:1788572074.546075:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569431680 00010000:00010000:2.0:1788572074.546119:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd8 expref: 7 pid: 188833 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.546157:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12855 00000100:00100000:2.0:1788572074.546167:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2399:x1875444569431680:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572074.546180:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572074.546187:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd8 expref: 7 pid: 188833 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.546199:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd8 expref: 7 pid: 188833 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.546221:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc586 lrc: 0/0,0 mode: --/PR res: [0x240002728:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafd8 expref: 7 pid: 188833 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.546236:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3b:0x0].0x0 (ffff8e5a16272300) 00010000:00010000:2.0:1788572074.546240:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc5b0 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc5a9 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.546250:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc5b0 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bc5a9 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.546271:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc5b0 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bc5a9 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.546303:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc5b0 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc5a9 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.546316:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6502:1875444584166784:0@lo:105: 00000100:00100000:0.0:1788572074.546357:0:188050:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837363 gen 2 00000004:00080000:0.0:1788572074.546363:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837301 committed transno 21474837363 00000020:00080000:0.0:1788572074.546369:0:188050:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5905129480 refcount 2 committed 0 result 0 batchid 326417522171 00000020:00080000:0.0:1788572074.546373:0:188050:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5906764e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5a10db2a80 00000020:00080000:0.0:1788572074.546376:0:188050:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240002728:0x1:0x0].460 00000020:00080000:0.0:1788572074.546378:0:188050:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5906764300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e59045ba400 00000020:00080000:0.0:1788572074.546381:0:188050:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200025d90:0x1:0x0].428 00000004:00080000:0.0:1788572074.546402:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837302 committed transno 21474837363 00000020:00080000:0.0:1788572074.546405:0:188050:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5a0133af00 refcount 2 committed 0 result 0 batchid 326417522172 00000020:00080000:0.0:1788572074.546407:0:188050:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a1fbb2500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5a0133aa80 00000020:00080000:0.0:1788572074.546410:0:188050:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240002728:0x1:0x0].461 00000020:00080000:0.0:1788572074.546412:0:188050:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a1fbb2900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5905bf8e00 00000020:00080000:0.0:1788572074.546415:0:188050:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200025d90:0x1:0x0].429 00000004:00080000:0.0:1788572074.546426:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837303 committed transno 21474837363 00000004:00080000:0.0:1788572074.546434:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837304 committed transno 21474837363 00000004:00080000:0.0:1788572074.546443:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837305 committed transno 21474837363 00000004:00080000:0.0:1788572074.546452:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837306 committed transno 21474837363 00000004:00080000:0.0:1788572074.546460:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837307 committed transno 21474837363 00000004:00080000:0.0:1788572074.546473:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837308 committed transno 21474837363 00000004:00080000:0.0:1788572074.546505:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837309 committed transno 21474837363 00000004:00080000:0.0:1788572074.546514:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837310 committed transno 21474837363 00000004:00080000:0.0:1788572074.546521:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837311 committed transno 21474837363 00000004:00080000:0.0:1788572074.546529:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837312 committed transno 21474837363 00000004:00080000:0.0:1788572074.546536:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837313 committed transno 21474837363 00000004:00080000:0.0:1788572074.546542:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837314 committed transno 21474837363 00000004:00080000:0.0:1788572074.546549:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837315 committed transno 21474837363 00000004:00080000:0.0:1788572074.546556:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837316 committed transno 21474837363 00000004:00080000:0.0:1788572074.546562:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837317 committed transno 21474837363 00000004:00080000:0.0:1788572074.546570:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837318 committed transno 21474837363 00000004:00080000:0.0:1788572074.546583:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837319 committed transno 21474837363 00000004:00080000:0.0:1788572074.546590:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837320 committed transno 21474837363 00000004:00080000:0.0:1788572074.546597:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837321 committed transno 21474837363 00000004:00080000:0.0:1788572074.546609:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837322 committed transno 21474837363 00000004:00080000:0.0:1788572074.546628:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837323 committed transno 21474837363 00000004:00080000:0.0:1788572074.546636:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837324 committed transno 21474837363 00000004:00080000:0.0:1788572074.546641:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837325 committed transno 21474837363 00000004:00080000:0.0:1788572074.546650:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837326 committed transno 21474837363 00000004:00080000:0.0:1788572074.546661:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837327 committed transno 21474837363 00000004:00080000:0.0:1788572074.546667:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837328 committed transno 21474837363 00000004:00080000:0.0:1788572074.546679:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837329 committed transno 21474837363 00000004:00080000:0.0:1788572074.546687:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837330 committed transno 21474837363 00000004:00080000:0.0:1788572074.546706:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837331 committed transno 21474837363 00000004:00080000:0.0:1788572074.546717:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837332 committed transno 21474837363 00000004:00080000:0.0:1788572074.546724:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837333 committed transno 21474837363 00000004:00080000:0.0:1788572074.546733:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837334 committed transno 21474837363 00000004:00080000:0.0:1788572074.546741:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837335 committed transno 21474837363 00000004:00080000:0.0:1788572074.546748:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837336 committed transno 21474837363 00000004:00080000:0.0:1788572074.546755:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837337 committed transno 21474837363 00000004:00080000:0.0:1788572074.546765:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837338 committed transno 21474837363 00000004:00080000:0.0:1788572074.546774:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837339 committed transno 21474837363 00000004:00080000:0.0:1788572074.546781:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837340 committed transno 21474837363 00000004:00080000:0.0:1788572074.546792:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837341 committed transno 21474837363 00000004:00080000:0.0:1788572074.546807:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837342 committed transno 21474837363 00000004:00080000:0.0:1788572074.546814:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837343 committed transno 21474837363 00000004:00080000:0.0:1788572074.546823:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837344 committed transno 21474837363 00000004:00080000:0.0:1788572074.546829:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837345 committed transno 21474837363 00000004:00080000:0.0:1788572074.546836:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837346 committed transno 21474837363 00000004:00080000:0.0:1788572074.546844:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837347 committed transno 21474837363 00000004:00080000:0.0:1788572074.546854:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837348 committed transno 21474837363 00000004:00080000:0.0:1788572074.546861:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837349 committed transno 21474837363 00000004:00080000:0.0:1788572074.546869:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837350 committed transno 21474837363 00000004:00080000:0.0:1788572074.546879:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837351 committed transno 21474837363 00000004:00080000:0.0:1788572074.546889:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837352 committed transno 21474837363 00000004:00080000:0.0:1788572074.546898:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837353 committed transno 21474837363 00000004:00080000:0.0:1788572074.546907:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837354 committed transno 21474837363 00000004:00080000:0.0:1788572074.546917:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837355 committed transno 21474837363 00000004:00080000:0.0:1788572074.546932:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837356 committed transno 21474837363 00000004:00080000:0.0:1788572074.546942:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837357 committed transno 21474837363 00000100:00100000:2.0:1788572074.547044:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.547078:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.547097:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584166784 00000100:00100000:2.0:1788572074.547102:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584166784 00000100:00100000:2.0:1788572074.547145:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5366 00000100:00100000:2.0:1788572074.547153:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6502:x1875444584166784:12345-0@lo:105: 00010000:00010000:2.0:1788572074.547165:0:6501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.547175:0:6501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.547183:0:6501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.547191:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.547198:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.547207:0:6501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.547222:0:6501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a01671000) 00000100:00100000:2.0:1788572074.547255:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6502:x1875444584166784:12345-0@lo:105: Request processed in 102us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.547261:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5366 00000100:00100000:2.0:1788572074.547294:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6502:1875444584166784:0@lo:105: 00010000:00010000:2.0:1788572074.549155:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572074.549232:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569431680:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3061us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.549242:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12855 00000004:00080000:0.0:1788572074.549548:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837358 committed transno 21474837363 00000004:00080000:0.0:1788572074.549557:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837359 committed transno 21474837363 00000004:00080000:0.0:1788572074.549565:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837360 committed transno 21474837363 00000004:00080000:0.0:1788572074.549575:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837361 committed transno 21474837363 00000004:00080000:0.0:1788572074.549588:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837362 committed transno 21474837363 00000004:00080000:0.0:1788572074.549603:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837363 committed transno 21474837363 00000100:00100000:0.0:1788572074.549635:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584166528:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788572074.549660:0:188050:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.550378:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584166912:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1788572074.550444:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.550498:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0459a3c0 going to sleep for 11 seconds 00000020:00080000:0.0:1788572074.550517:0:188127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 326417522172 committed batchid 326417522120 00000020:00080000:0.0:1788572074.550562:0:188127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522120 00000100:00100000:2.0:1788572074.550653:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584166912 00000100:00100000:2.0:1788572074.550661:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584166912 00000100:00100000:2.0:1788572074.550723:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788572074.550733:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188050:x1875444584166912:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1788572074.552443:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188050:x1875444584166912:12345-0@lo:403:mdt00_002.0 Request processed in 1704us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.552456:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788572074.552960:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584166912:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1788572074.556371:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].432, 656 off648152 00000040:00080000:0.0:1788572074.557263:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].464, 736 off748976 00000004:00080000:0.0:1788572074.557272:0:188050:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a0459a3c0 with version 886 00000100:00100000:0.0:1788572074.558296:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584167168 00000100:00100000:0.0:1788572074.558306:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584167168 00000100:00100000:0.0:1788572074.558368:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788572074.558377:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584167168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.558647:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584167168:12345-0@lo:1000:osp_up1-0.0 Request processed in 270us (1061us total) trans 21474837364 rc 0/0 00000100:00100000:0.0:1788572074.558655:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000004:00200000:0.0:1788572074.558863:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2030:0x0]: returning size 4096 00010000:00010000:0.0:1788572074.558887:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.558899:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.558908:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.558914:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.558919:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.558928:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.558943:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3b:0x0].0x0 (ffff8e5a36aab600) 00010000:00010000:0.0:1788572074.558946:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572074.558951:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.558957:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc5a2 lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.558972:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.558981:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.558988:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559015:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572074.559024:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3b:0x0] 00010000:00010000:0.0:1788572074.559033:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc59b lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559040:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc59b lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559046:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc59b lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559051:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.559054:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc59b lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559061:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc59b lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559069:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2030:0x0].0x0 (ffff8e5a36aaba00) 00010000:00010000:0.0:1788572074.559072:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572074.559075:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc59b lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559081:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc59b lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559096:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc58d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559102:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc58d lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559117:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc58d lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559126:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.559129:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc58d lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559134:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc58d lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559142:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572074.559144:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572074.559147:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc58d lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559153:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc58d lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572074.559163:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002219a08b reply state 0000000017aa36dc transno 330712481906 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bc594 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559175:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bc594 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.559182:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572074.559184:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572074.559187:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572074.559258:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+15:156900:x1875444569431424:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 39409us (39606us total) trans 330712481906 rc 0/0 00000100:00100000:0.0:1788572074.559265:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 770 00010000:00010000:2.0:1788572074.559324:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572074.559331:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.559339:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671000 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572074.559344:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572074.559353:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.559382:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.559389:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572074.559418:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 1/0,0 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.559425:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01671000/0x265cfe11109bc5a9 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bc5b0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.559442:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572074.559444:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572074.559445:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572074.559453:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572074.559465:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584167296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572074.559526:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.559558:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584167296 00000100:00100000:2.0:1788572074.559562:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584167296 00000100:00100000:2.0:1788572074.559594:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4621 00000100:00100000:2.0:1788572074.559601:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3644:x1875444584167296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572074.559612:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572074.559627:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc5b0 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bc5a9 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.559646:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3b:0x0].0x0 (ffff8e5a16272300) 00010000:00010000:2.0:1788572074.559654:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572074.559693:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1875444584167296:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.559700:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4621 00000100:00100000:2.0:1788572074.559726:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584167296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572074.592446:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569432064 00000100:00100000:0.0:1788572074.592462:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569432064 00000100:00100000:0.0:1788572074.592659:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 773 00000100:00100000:0.0:1788572074.592670:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+15:156906:x1875444569432064:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572074.592692:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572074.592714:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bc5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bafed expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.592782:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc5e8 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.592797:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc5e8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.592809:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc5e8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572074.592860:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:0.0:1788572074.592864:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572074.592885:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc5e8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.592909:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bc5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafed expref: 17 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.592926:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc5e8 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafed expref: 16 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.592935:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572074.592938:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572074.592942:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3200, rc 0) 00000100:00100000:0.0:1788572074.593038:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+16:156906:x1875444569432064:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 370us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572074.593045:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 773 00000100:00100000:2.0:1788572074.613776:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569432320 00000100:00100000:2.0:1788572074.613786:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569432320 00000100:00100000:2.0:1788572074.613854:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 774 00000100:00100000:2.0:1788572074.613866:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+16:156906:x1875444569432320:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1788572074.613930:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572074.613959:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc5e8 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bafed expref: 16 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.613978:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572074.613985:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572074.614049:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc5ef lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.614064:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc5ef lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.614075:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc5ef lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.614086:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.614099:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.614117:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572074.614980:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].433, 2152 off650304 00000040:00080000:2.0:1788572074.615055:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].465, 2352 off751328 00000004:00080000:2.0:1788572074.615062:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a3fb4af00 with version 887 00000004:00080000:0.0:1788572074.615569:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 887 rpc_version 887 00000020:00100000:0.0:1788572074.615608:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572074.615619:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5905a9ce00 x1875444584167552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572074.615645:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584167552:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.615711:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.615752:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.616551:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584167552:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.616942:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584167680 00000100:00100000:2.0:1788572074.616948:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584167680 00000100:00100000:2.0:1788572074.616984:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788572074.616992:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:188048:x1875444584167680:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572074.617005:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572074.617022:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc612 lrc: 2/0,0 mode: --/PW res: [0x240002728:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bc60b expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.617040:0:188053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc612 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bc60b expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.617051:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc612 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc60b expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.617060:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3c:0x0].0x0 (ffff8e5a16272300) 00010000:00010000:2.0:1788572074.617063:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.617066:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1e00, rc 0) 00000100:00100000:2.0:1788572074.617119:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:188048:x1875444584167680:12345-0@lo:101:mdt00_000.0 Request processed in 128us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.617128:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788572074.698903:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584167936 00000100:00100000:2.0:1788572074.698919:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584167936 00010000:00010000:2.0:1788572074.698962:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc612 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x265cfe11109bc60b expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.699012:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12856 00000100:00100000:2.0:1788572074.699022:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3643:x1875444584167936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572074.699036:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1788572074.705277:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837365 is committed 00010000:00010000:0.0:1788572074.705407:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc612 lrc: 0/0,0 mode: --/PW res: [0x240002728:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bc60b expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.705428:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3c:0x0].0x0 (ffff8e5a16272300) 00010000:00010000:0.0:1788572074.705435:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60de00/0x265cfe11109bc64a lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.705446:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60de00/0x265cfe11109bc64a lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.705454:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60de00/0x265cfe11109bc64a lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.705521:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572074.705612:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584167936:12345-0@lo:103:ldlm_bl.0 Request processed in 6590us (8975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572074.705622:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12856 00000100:00100000:2.0:1788572074.706141:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584167936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572074.727882:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572074.745988:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572074.746083:0:188053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:188053:1875444584168320:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572074.746131:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bc674 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc66d expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.746144:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3c:0x0].0x0 (ffff8e5a16272300) 00010000:00010000:2.0:1788572074.746148:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572074.746152:0:188053:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bc674 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc66d expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.746163:0:188053:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bc674 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc66d expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.746172:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd2c00, rc 0) 00000100:00100000:2.0:1788572074.746234:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188050:x1875444584168192:12345-0@lo:101:mdt00_002.0 Request processed in 6945us (7028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.746246:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788572074.747240:0:188050:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837365 gen 2 00000004:00080000:0.0:1788572074.747247:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837364 committed transno 21474837365 00000004:00080000:0.0:1788572074.747267:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837365 committed transno 21474837365 00000100:00100000:0.0:1788572074.747284:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584168192:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788572074.747300:0:188050:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01670400/0x265cfe11109bc66d lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc674 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.751378:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584168576:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1788572074.751508:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.751552:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.760677:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584168576:0@lo:403:mdt00_002.0 00000040:00080000:2.0:1788572074.761822:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].434, 656 off650960 00000040:00080000:2.0:1788572074.762012:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].466, 736 off752064 00000004:00080000:2.0:1788572074.762019:0:188050:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a3fb4a780 with version 888 00000100:00100000:2.0:1788572074.763837:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584168832 00000100:00100000:2.0:1788572074.763845:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584168832 00000100:00100000:2.0:1788572074.763902:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788572074.763912:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584168832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572074.764191:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584168832:12345-0@lo:1000:osp_up1-0.0 Request processed in 280us (746us total) trans 21474837366 rc 0/0 00000100:00100000:2.0:1788572074.764199:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000004:00200000:2.0:1788572074.764919:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2031:0x0]: returning size 4096 00010000:00010000:2.0:1788572074.764946:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bc666 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.764957:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bc666 lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.764965:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bc666 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.764971:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.764976:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bc666 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.764985:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bc666 lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765006:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3c:0x0].0x0 (ffff8e5a16354200) 00010000:00010000:2.0:1788572074.765009:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572074.765015:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bc666 lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765021:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bc666 lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765035:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01670400/0x265cfe11109bc66d lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc674 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765043:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01670400/0x265cfe11109bc66d lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc674 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765050:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a01670400/0x265cfe11109bc66d lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc674 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765077:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788572074.765087:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3c:0x0] 00010000:00010000:2.0:1788572074.765095:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bc65f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765110:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bc65f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765116:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bc65f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765121:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.765124:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bc65f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765131:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bc65f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765139:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2031:0x0].0x0 (ffff8e5a16354800) 00010000:00010000:2.0:1788572074.765141:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572074.765144:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bc65f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765150:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bc65f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765165:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc651 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765172:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc651 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765178:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc651 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765183:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.765186:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc651 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765193:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc651 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765200:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572074.765203:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.765206:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc651 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765217:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bc651 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572074.765227:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000938b8bba reply state 00000000a4a3144e transno 330712481908 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bc658 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765242:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bc658 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.765249:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572074.765252:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572074.765255:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572074.765350:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+19:156909:x1875444569432960:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 37297us (37472us total) trans 330712481908 rc 0/0 00000100:00100000:2.0:1788572074.765359:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 778 00000100:00100000:2.0:1788572074.818400:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572074.827834:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569433856 00000100:00100000:0.0:1788572074.827844:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569433856 00000100:00100000:0.0:1788572074.827903:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 782 00000100:00100000:0.0:1788572074.827912:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+20:156919:x1875444569433856:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:0.0:1788572074.827967:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572074.827992:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bc6ac lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb017 expref: 20 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.828012:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572074.828017:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572074.828076:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.828091:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.828111:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.828124:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.828132:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.828138:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572074.828875:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].435, 2152 off653112 00000040:00080000:0.0:1788572074.828946:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].468, 2352 off756016 00000004:00080000:0.0:1788572074.828952:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a1fdbc540 with version 889 00000100:00100000:0.0:1788572074.831549:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584169216 00000100:00100000:0.0:1788572074.831564:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584169216 00000100:00100000:0.0:1788572074.831699:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788572074.831710:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584169216:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.832401:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584169216:12345-0@lo:1000:osp_up1-0.0 Request processed in 692us (3165us total) trans 21474837367 rc 0/0 00000100:00100000:0.0:1788572074.832411:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:0.0:1788572074.834856:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.834875:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.834887:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.834905:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 3/0,1 mode: --/PW res: [0x200025d90:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.834913:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.834918:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.834954:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3800/0x265cfe11109bc6cf lrc: 3/0,1 mode: --/PW res: [0x240002728:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.834961:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3800/0x265cfe11109bc6cf lrc: 3/0,1 mode: --/PW res: [0x240002728:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.834971:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3800/0x265cfe11109bc6cf lrc: 3/0,1 mode: --/PW res: [0x240002728:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.834996:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584169344:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788572074.835071:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.835123:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572074.835539:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584169344:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572074.835560:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3800/0x265cfe11109bc6cf lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc6d6 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835571:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3800/0x265cfe11109bc6cf lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc6d6 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572074.835604:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca0e1b87 reply state 000000007207bc93 transno 330712481909 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835617:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835628:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3d:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:2.0:1788572074.835630:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572074.835632:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572074.835637:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3800/0x265cfe11109bc6cf lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc6d6 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835645:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3800/0x265cfe11109bc6cf lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc6d6 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572074.835655:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3d:0x0] 00000004:00010000:2.0:1788572074.835662:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca0e1b87 reply state 000000007207bc93 transno 330712481909 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835669:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835675:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2032:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:2.0:1788572074.835677:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572074.835679:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1788572074.835683:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2032:0x0]: returning size 4096 00010000:00010000:2.0:1788572074.835692:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835698:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835705:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835711:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572074.835716:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835723:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835733:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572074.835736:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572074.835739:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835746:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bc6b3 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572074.835761:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca0e1b87 reply state 000000007207bc93 transno 330712481909 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835769:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.835774:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572074.835776:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572074.835778:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1788572074.835870:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+21:156919:x1875444569433856:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 7956us (8115us total) trans 330712481909 rc 0/0 00000100:00100000:2.0:1788572074.835878:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 782 00000100:00100000:0.0:1788572074.876137:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569434240 00000100:00100000:0.0:1788572074.876148:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569434240 00000100:00100000:0.0:1788572074.876216:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 785 00000100:00100000:0.0:1788572074.876227:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:156928:x1875444569434240:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572074.876248:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572074.876269:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2800/0x265cfe11109bc707 lrc: 2/0,0 mode: --/CR res: [0x240002728:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb02c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.876331:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3400/0x265cfe11109bc70e lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.876364:0:188833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bc6d6 lrc: 2/0,0 mode: PW/PW res: [0x240002728:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc6cf expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.876374:0:188833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3400/0x265cfe11109bc70e lrc: 4/1,0 mode: --/PR res: [0x240002728:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.876409:0:188833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bc6d6 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bc6cf expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.876425:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188833:1875444584169472:0@lo:104: 00000100:00100000:0.0:1788572074.876474:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.876563:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.877091:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590b638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584169600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572074.877136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.878056:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188833:1875444584169472:0@lo:104: 00010000:00010000:2.0:1788572074.878075:0:188833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3400/0x265cfe11109bc70e lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572074.892336:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837367 is committed 00010000:00010000:2.0:1788572074.892733:0:188833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3400/0x265cfe11109bc70e lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.892741:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3400/0x265cfe11109bc70e lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572074.892803:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002728:0x3d:0x0]: returning size 4096 00000004:00200000:2.0:1788572074.892808:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788572074.892857:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2800/0x265cfe11109bc707 lrc: 0/0,0 mode: --/CR res: [0x240002728:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb02c expref: 8 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.892874:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3400/0x265cfe11109bc70e lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb02c expref: 7 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.892882:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3d:0x0].0x0 (ffff8e5a16354e00) 00010000:00010000:2.0:1788572074.892885:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572074.892887:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3400, rc 0) 00000100:00100000:2.0:1788572074.892944:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:156928:x1875444569434240:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 16718us (17148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572074.892950:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 785 00000100:00100000:0.0:1788572074.892983:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584169600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572074.896134:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569434496 00000100:00100000:2.0:1788572074.896147:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569434496 00000100:00100000:2.0:1788572074.896216:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 786 00000100:00100000:2.0:1788572074.896228:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+23:156928:x1875444569434496:12345-192.168.202.57@tcp:36:rmdir.0 00010000:00010000:2.0:1788572074.896286:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572074.896318:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bc6f2 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb01e expref: 23 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896341:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2032:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:2.0:1788572074.896346:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572074.896370:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896386:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896396:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896408:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896416:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896422:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896530:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896538:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896546:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896563:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896573:0:188050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bc700 lrc: 2/0,0 mode: PR/PR res: [0x200025d90:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb025 expref: 22 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896596:0:188050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 4/0,1 mode: --/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896632:0:188050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bc700 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb025 expref: 22 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.896647:0:188050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bc700 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb025 expref: 22 pid: 188050 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.896662:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:188050:1875444584169728:192.168.202.57@tcp:104: 00000100:00100000:2.0:1788572074.896986:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0b5ac0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788572074.907268:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bc700 lrc: 0/0,0 mode: --/PR res: [0x200025d90:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb025 expref: 22 pid: 188050 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.907286:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:188050:1875444584169728:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572074.907310:0:188050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.907321:0:188050:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.907327:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.907380:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.907392:0:188050:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.907403:0:188050:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572074.907425:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584169856:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1788572074.907514:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572074.907543:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0b5ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.928162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572074.928195:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569434752 00000100:00100000:0.0:1788572074.928204:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569434752 00010000:00010000:0.0:1788572074.928244:0:43930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3400/0x265cfe11109bc70e lrc: 5/0,0 mode: PR/PR res: [0x240002728:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb02c expref: 7 pid: 188833 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.928281:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12861 00000100:00100000:0.0:1788572074.928290:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2397:x1875444569434752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572074.928305:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572074.928312:0:43930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3400/0x265cfe11109bc70e lrc: 5/0,0 mode: PR/PR res: [0x240002728:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb02c expref: 7 pid: 188833 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928332:0:43930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3400/0x265cfe11109bc70e lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb02c expref: 7 pid: 188833 timeout: 8927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928369:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3d:0x0].0x0 (ffff8e5a16354e00) 00010000:00010000:0.0:1788572074.928377:0:43930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc738 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bc731 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928390:0:43930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc738 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109bc731 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928401:0:43930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc738 lrc: 4/0,0 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109bc731 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928440:0:43930:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc738 lrc: 4/0,0 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc731 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572074.928454:0:43930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:43930:1875444584170112:0@lo:105: 00000100:00100000:0.0:1788572074.928526:0:43930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572074.928561:0:43930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572074.928581:0:13337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584170112 00000100:00100000:0.0:1788572074.928585:0:13337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584170112 00000100:00100000:0.0:1788572074.928612:0:13337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5370 00000100:00100000:0.0:1788572074.928619:0:13337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:43930:x1875444584170112:12345-0@lo:105: 00010000:00010000:0.0:1788572074.928631:0:13337:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928647:0:13337:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928656:0:13337:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928664:0:13337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928671:0:13337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928679:0:13337:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.928691:0:13337:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5905fe1c00) 00000100:00100000:0.0:1788572074.928737:0:13337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:43930:x1875444584170112:12345-0@lo:105: Request processed in 118us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572074.928744:0:13337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5370 00000100:00100000:0.0:1788572074.928784:0:43930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:43930:1875444584170112:0@lo:105: 00010000:00010000:0.0:1788572074.928797:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572074.928832:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2397:x1875444569434752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 543us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572074.928840:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12861 00000100:00100000:0.0:1788572074.937369:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584170240:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1788572074.938814:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].436, 656 off653768 00000040:00080000:0.0:1788572074.938995:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].469, 736 off756752 00000004:00080000:0.0:1788572074.939001:0:188050:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a1fdbcf00 with version 890 00000100:00100000:0.0:1788572074.939455:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584170496 00000100:00100000:0.0:1788572074.939464:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584170496 00000100:00100000:0.0:1788572074.939554:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788572074.939563:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584170496:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572074.939908:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584170496:12345-0@lo:1000:osp_up1-0.0 Request processed in 345us (604us total) trans 21474837368 rc 0/0 00000100:00100000:0.0:1788572074.939916:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788572074.940156:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b638a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584170496:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1788572074.940444:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2032:0x0]: returning size 4096 00010000:00010000:0.0:1788572074.940468:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940589:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940599:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940606:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.940611:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940619:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940636:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3d:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:0.0:1788572074.940640:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572074.940645:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940776:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc72a lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940793:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940802:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940810:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940873:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572074.940882:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3d:0x0] 00010000:00010000:0.0:1788572074.940890:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940896:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940903:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940908:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.940912:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940918:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940932:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2032:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:0.0:1788572074.940935:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572074.940938:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940944:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc723 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940957:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940963:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940969:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940974:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572074.940977:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940983:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.940990:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572074.940992:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572074.940996:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.941002:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bc715 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572074.941016:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000061cfa65 reply state 0000000012b27b26 transno 330712481910 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.941028:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572074.941036:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572074.941039:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572074.941041:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572074.941122:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+23:156928:x1875444569434496:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 44895us (45278us total) trans 330712481910 rc 0/0 00000100:00100000:0.0:1788572074.941130:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 786 00010000:00010000:2.0:1788572074.944815:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572074.944829:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572074.944842:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1c00 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572074.944850:0:10396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572074.944860:0:10396:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1c00/0x265cfe11109bc731 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bc738 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.020036:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569434880 00000100:00100000:0.0:1788572075.020047:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569434880 00000100:00100000:0.0:1788572075.020131:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 787 00000100:00100000:0.0:1788572075.020142:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+23:156934:x1875444569434880:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572075.020169:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.020197:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc73f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb033 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020260:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020276:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020290:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020304:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020311:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020317:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020376:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020384:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020391:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020396:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.020401:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020408:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020419:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.020422:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.020427:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020432:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc746 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020447:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020452:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020458:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020463:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.020466:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020471:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020516:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.020519:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.020523:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020529:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc74d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020557:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc73f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb033 expref: 24 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020567:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.020570:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.020574:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc73f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb033 expref: 24 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.020583:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3400, rc 0) 00000100:00100000:0.0:1788572075.020643:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+23:156934:x1875444569434880:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 502us (1004us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572075.020662:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 787 00000100:00100000:0.0:1788572075.037816:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.044131:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.044258:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569435136 00000100:00100000:2.0:1788572075.044269:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569435136 00000100:00100000:2.0:1788572075.044336:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 789 00000100:00100000:2.0:1788572075.044348:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+23:156934:x1875444569435136:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572075.044370:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.044391:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb041 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.044461:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bc770 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.044514:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bc770 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.044528:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bc770 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572075.044586:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:2.0:1788572075.044589:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572075.044612:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bc770 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.044638:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb041 expref: 25 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.044808:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bc770 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb041 expref: 24 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.044818:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.044821:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572075.044825:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0000, rc 0) 00000100:00100000:2.0:1788572075.044927:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+24:156934:x1875444569435136:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 581us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.044935:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 789 00000100:00100000:0.0:1788572075.050534:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569435392 00000100:00100000:0.0:1788572075.050545:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569435392 00000100:00100000:0.0:1788572075.050612:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 790 00000100:00100000:0.0:1788572075.050624:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+24:156934:x1875444569435392:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:0.0:1788572075.050694:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572075.050724:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bc770 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb041 expref: 24 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.050744:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.050750:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572075.050810:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.050824:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.050835:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.050846:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.050855:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.050861:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572075.051848:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].438, 2152 off657512 00000040:00080000:0.0:1788572075.051935:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].470, 2352 off759104 00000004:00080000:0.0:1788572075.051943:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a1fdbccc0 with version 891 00000004:00080000:2.0:1788572075.052029:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 891 rpc_version 891 00000020:00100000:2.0:1788572075.052067:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572075.052077:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36eaad80 x1875444584170880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572075.052111:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584170880:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.052175:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.052199:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0b5aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.053067:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584170880:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.053568:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584171008 00000100:00100000:2.0:1788572075.053573:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584171008 00000100:00100000:2.0:1788572075.053601:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788572075.053608:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:188048:x1875444584171008:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572075.053620:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.053636:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc79a lrc: 2/0,0 mode: --/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bc793 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053655:0:189111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc79a lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bc793 expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053669:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc79a lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc793 expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053677:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3e:0x0].0x0 (ffff8e5a16272100) 00010000:00010000:2.0:1788572075.053680:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572075.053683:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0e00, rc 0) 00000100:00100000:2.0:1788572075.053716:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:188048:x1875444584171008:12345-0@lo:101:mdt00_000.0 Request processed in 107us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.053722:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788572075.053750:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b639500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584171008:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572075.053763:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053773:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.053794:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000955f8929 reply state 0000000076d28fe0 transno 330712481911 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bc78c lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053804:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bc78c lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053810:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3e:0x0].0x0 (ffff8e5a318f4500) 00010000:00010000:2.0:1788572075.053813:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.053815:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572075.053821:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053829:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572075.053838:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3e:0x0] 00000004:00010000:2.0:1788572075.053844:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000955f8929 reply state 0000000076d28fe0 transno 330712481911 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc785 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053852:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc785 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053858:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2033:0x0].0x0 (ffff8e5a318f4100) 00010000:00010000:2.0:1788572075.053860:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.053863:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1788572075.053867:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2033:0x0]: returning size 4096 00010000:00010000:2.0:1788572075.053874:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053881:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053888:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053894:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572075.053899:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053906:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053917:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.053920:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572075.053924:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053931:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bc777 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.053944:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000955f8929 reply state 0000000076d28fe0 transno 330712481911 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053952:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.053957:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572075.053960:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.053962:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1788572075.054033:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+25:156934:x1875444569435392:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 3410us (3628us total) trans 330712481911 rc 0/0 00000100:00100000:2.0:1788572075.054040:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 790 00000100:00100000:0.0:1788572075.072881:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.077848:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.077985:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569435648 00000100:00100000:2.0:1788572075.077995:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569435648 00000100:00100000:2.0:1788572075.078066:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 792 00000100:00100000:2.0:1788572075.078077:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+26:156938:x1875444569435648:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:2.0:1788572075.078106:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.078128:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc7bd lrc: 2/0,0 mode: --/CR res: [0x200025d90:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb04f expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.078187:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 3/1,0 mode: --/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.078202:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.078215:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572075.078267:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200025d90:0x3e:0x0]: returning size 4096 00000004:00200000:2.0:1788572075.078272:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788572075.078306:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc7bd lrc: 0/0,0 mode: --/CR res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb04f expref: 28 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.078326:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb04f expref: 27 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.078342:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3e:0x0].0x0 (ffff8e5a318f4500) 00010000:00010000:2.0:1788572075.078345:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572075.078348:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1200, rc 0) 00000100:00100000:2.0:1788572075.078409:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+27:156938:x1875444569435648:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 334us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.078416:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 792 00000100:00100000:0.0:1788572075.080411:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569435776 00000100:00100000:0.0:1788572075.080419:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569435776 00000100:00100000:0.0:1788572075.080518:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 793 00000100:00100000:0.0:1788572075.080528:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:156938:x1875444569435776:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572075.080546:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.080565:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2000/0x265cfe11109bc7cb lrc: 2/0,0 mode: --/CR res: [0x240002728:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb056 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.080618:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.080631:0:188049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc79a lrc: 2/0,0 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc793 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.080641:0:188049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 4/1,0 mode: --/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.080799:0:188049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc79a lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bc793 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.080816:0:188049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:188049:1875444584171136:0@lo:104: 00000100:00100000:0.0:1788572075.080864:0:188049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.080910:0:188049:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0ef22600 going to sleep for 11 seconds 00010000:00010000:2.0:1788572075.081185:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572075.081193:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.081200:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60cc00 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572075.081206:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.081216:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.081246:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 2/0,0 mode: --/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.081254:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572075.081274:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 1/0,0 mode: --/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.081282:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bc793 lrc: 0/0,0 mode: --/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bc79a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.081308:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572075.081310:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572075.081312:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572075.081319:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572075.081330:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584171264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572075.081361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.081392:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584171264 00000100:00100000:2.0:1788572075.081396:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584171264 00010000:00010000:2.0:1788572075.081414:0:152004:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc79a lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x265cfe11109bc793 expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.081434:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12862 00000100:00100000:2.0:1788572075.081440:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3643:x1875444584171264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572075.081449:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788572075.082160:0:188049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:188049:1875444584171136:0@lo:104: 00010000:00010000:0.0:1788572075.082187:0:188049:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.088706:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc79a lrc: 0/0,0 mode: --/PW res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bc793 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.088726:0:152004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3e:0x0].0x0 (ffff8e5a16272100) 00010000:00010000:2.0:1788572075.088732:0:152004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.088743:0:152004:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.088751:0:152004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.088774:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572075.088862:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584171264:12345-0@lo:103:ldlm_bl.0 Request processed in 7421us (7498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.088872:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12862 00010000:00010000:0.0:1788572075.089099:0:188049:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.089110:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572075.089164:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002728:0x3e:0x0]: returning size 4096 00000004:00200000:0.0:1788572075.089169:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1788572075.089214:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2000/0x265cfe11109bc7cb lrc: 0/0,0 mode: --/CR res: [0x240002728:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb056 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.089232:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb056 expref: 7 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.089240:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3e:0x0].0x0 (ffff8e5a16272100) 00010000:00010000:0.0:1788572075.089243:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788572075.089246:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3200, rc 0) 00000100:00100000:0.0:1788572075.089303:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:156938:x1875444569435776:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 8777us (8990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.089311:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 793 00000100:00100000:0.0:1788572075.096356:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.096431:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569436032 00000100:00100000:2.0:1788572075.096441:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569436032 00000100:00100000:2.0:1788572075.096535:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 794 00000100:00100000:2.0:1788572075.096547:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+27:156938:x1875444569436032:12345-192.168.202.57@tcp:36:rmdir.0 00010000:00010000:2.0:1788572075.096612:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572075.096640:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bc7b6 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb048 expref: 27 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096673:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2033:0x0].0x0 (ffff8e5a318f4100) 00010000:00010000:2.0:1788572075.096678:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572075.096701:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096716:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096726:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096737:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096746:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096765:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096853:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096862:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096869:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096887:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096897:0:188048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 2/0,0 mode: PR/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb04f expref: 26 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096906:0:188048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 4/0,1 mode: --/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096938:0:188048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb04f expref: 26 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.096952:0:188048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb04f expref: 26 pid: 188048 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.096965:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188048:1875444584171392:192.168.202.57@tcp:104: 00000100:00100000:2.0:1788572075.097053:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.105023:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.105244:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569436160 00000100:00100000:0.0:1788572075.105251:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569436160 00010000:00010000:0.0:1788572075.105287:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb04f expref: 27 pid: 188048 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.105332:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12863 00000100:00100000:0.0:1788572075.105341:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+27:2400:x1875444569436160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572075.105358:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572075.105364:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb04f expref: 27 pid: 188048 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.105377:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb04f expref: 27 pid: 188048 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.105399:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc7c4 lrc: 0/0,0 mode: --/PR res: [0x200025d90:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb04f expref: 27 pid: 188048 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.105416:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3e:0x0].0x0 (ffff8e5a318f4500) 00010000:00010000:0.0:1788572075.105421:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.105431:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.105438:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 4/0,1 mode: EX/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.105470:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572075.105552:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+26:2400:x1875444569436160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 211us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.105559:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12863 00000100:00100000:2.0:1788572075.105948:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584171520 00000100:00100000:2.0:1788572075.105955:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584171520 00000100:00100000:2.0:1788572075.105990:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788572075.105998:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41334050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:188048:x1875444584171520:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572075.106012:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.106028:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc7fc lrc: 2/0,0 mode: --/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bc7f5 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.106049:0:189111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb056 expref: 6 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.106058:0:189111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc7fc lrc: 4/0,0 mode: --/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bc7f5 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.106079:0:189111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb056 expref: 6 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.106109:0:189111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc7d2 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb056 expref: 6 pid: 188049 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.106121:0:189111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:189111:1875444584171648:192.168.202.57@tcp:104: 00000100:00100000:2.0:1788572075.106160:0:189111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.108682:0:189111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:189111:1875444584171648:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572075.108718:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc7fc lrc: 3/0,0 mode: --/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc7f5 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.108732:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3e:0x0].0x0 (ffff8e5a16272100) 00010000:00010000:2.0:1788572075.108735:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572075.108741:0:189111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc7fc lrc: 3/0,0 mode: --/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc7f5 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.108762:0:189111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc7fc lrc: 3/0,0 mode: --/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc7f5 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.108770:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0e00, rc 0) 00000100:00100000:2.0:1788572075.108829:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41334050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188048:x1875444584171520:12345-0@lo:101:mdt00_000.0 Request processed in 2831us (3021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.108838:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788572075.111191:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.113871:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584171776 00000100:00100000:0.0:1788572075.113876:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584171776 00000100:00100000:0.0:1788572075.113914:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5372 00000100:00100000:0.0:1788572075.113921:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6504:x1875444584171776:12345-0@lo:105: 00010000:00010000:0.0:1788572075.113934:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.113944:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.113953:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.113960:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.113967:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.113975:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.113995:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e590a60de00) 00000100:00100000:0.0:1788572075.114036:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6504:x1875444584171776:12345-0@lo:105: Request processed in 115us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.114047:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5372 00010000:00010000:2.0:1788572075.114334:0:188048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.114345:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.115130:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584171904:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1788572075.115192:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.115227:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572075.126880:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188048:x1875444584171904:12345-0@lo:403:mdt00_000.0 Request processed in 11321us (11678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.126898:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788572075.127022:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584171904:0@lo:403:mdt00_000.0 00000040:00080000:2.0:1788572075.129823:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].439, 656 off658168 00000040:00080000:2.0:1788572075.130018:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].471, 736 off759840 00000004:00080000:2.0:1788572075.130025:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a3fb4a780 with version 892 00000020:00100000:2.0:1788572075.136586:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572075.136604:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36eab100 x1875444584172160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572075.136628:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584172160:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.137375:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.137812:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.144824:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788572075.144841:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584172160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.145170:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584172160:12345-0@lo:1000:osp_up1-0.0 Request processed in 333us (7797us total) trans 21474837370 rc 0/0 00000100:00100000:2.0:1788572075.145179:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000004:00200000:0.0:1788572075.145762:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2033:0x0]: returning size 4096 00010000:00010000:0.0:1788572075.145790:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145800:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145808:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145814:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.145818:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145826:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145843:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3e:0x0].0x0 (ffff8e5a318f4500) 00010000:00010000:0.0:1788572075.145846:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572075.145851:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145858:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc7ee lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145874:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145888:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145895:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60de00/0x265cfe11109bc7f5 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc7fc expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145925:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572075.145934:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3e:0x0] 00010000:00010000:0.0:1788572075.145941:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145947:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145954:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145959:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.145963:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145969:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145978:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2033:0x0].0x0 (ffff8e5a318f4100) 00010000:00010000:0.0:1788572075.145981:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572075.145984:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.145990:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc7e7 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.146005:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.146011:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.146016:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.146021:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.146023:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.146029:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.146036:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.146037:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.146040:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.146045:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bc7d9 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572075.146055:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d13f03c1 reply state 000000002266a858 transno 330712481912 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.146067:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.146075:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.146078:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572075.146081:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572075.146162:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+27:156938:x1875444569436032:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 49615us (49815us total) trans 330712481912 rc 0/0 00000100:00100000:0.0:1788572075.146170:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 794 00000100:00100000:0.0:1788572075.149550:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584172288 00000100:00100000:0.0:1788572075.149560:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584172288 00000100:00100000:0.0:1788572075.149619:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4624 00000100:00100000:0.0:1788572075.149629:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3642:x1875444584172288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572075.149653:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572075.149673:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc7fc lrc: 0/0,0 mode: --/EX res: [0x240002728:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bc7f5 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.149693:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3e:0x0].0x0 (ffff8e5a16272100) 00010000:00010000:0.0:1788572075.149705:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572075.149762:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1875444584172288:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.149769:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4624 00000100:00100000:0.0:1788572075.149812:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584172288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572075.171720:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.177092:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.180929:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.181031:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569436672 00000100:00100000:0.0:1788572075.181042:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569436672 00000100:00100000:0.0:1788572075.181113:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 797 00000100:00100000:0.0:1788572075.181123:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+27:156943:x1875444569436672:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572075.181143:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.181164:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc82d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb06b expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.181235:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc834 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.181249:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc834 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.181260:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc834 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572075.181317:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:0.0:1788572075.181321:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572075.181344:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc834 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.181369:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc82d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb06b expref: 29 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.181388:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc834 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb06b expref: 28 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.181397:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.181400:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572075.181404:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2200, rc 0) 00000100:00100000:0.0:1788572075.181513:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+28:156943:x1875444569436672:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 356us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.181521:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 797 00000100:00100000:2.0:1788572075.188429:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.188570:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569436928 00000100:00100000:0.0:1788572075.188580:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569436928 00000100:00100000:0.0:1788572075.188650:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 798 00000100:00100000:0.0:1788572075.188661:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+28:156943:x1875444569436928:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:0.0:1788572075.188725:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572075.188753:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc834 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb06b expref: 28 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.188772:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.188778:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572075.188840:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.188855:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.188865:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.188875:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.188883:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.188890:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572075.195594:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].440, 2152 off660320 00000040:00080000:0.0:1788572075.195683:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].472, 2352 off762192 00000004:00080000:0.0:1788572075.195689:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a0ef22600 with version 893 00000100:00100000:0.0:1788572075.198070:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584172544 00000100:00100000:0.0:1788572075.198079:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584172544 00000100:00100000:0.0:1788572075.198985:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788572075.198998:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584172544:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572075.199645:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584172544:12345-0@lo:1000:osp_up1-0.0 Request processed in 649us (1911us total) trans 21474837371 rc 0/0 00000100:00100000:0.0:1788572075.199654:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00010000:2.0:1788572075.201181:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.201200:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.201214:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.201234:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 3/0,1 mode: --/PW res: [0x200025d90:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.201240:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.201246:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.201278:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 3/0,1 mode: --/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.201289:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 3/0,1 mode: --/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.201299:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 3/0,1 mode: --/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.201319:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584172672:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1788572075.201370:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.203072:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0b5ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.203888:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584172672:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572075.203905:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.203921:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.203948:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000254bbc33 reply state 0000000063deab99 transno 330712481913 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.203960:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.203966:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3f:0x0].0x0 (ffff8e5a16272f00) 00010000:00010000:2.0:1788572075.203969:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.203971:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572075.203977:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.203985:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572075.203998:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3f:0x0] 00000004:00010000:2.0:1788572075.204005:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000254bbc33 reply state 0000000063deab99 transno 330712481913 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204014:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204020:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2034:0x0].0x0 (ffff8e5a16272c00) 00010000:00010000:2.0:1788572075.204022:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.204024:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1788572075.204028:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2034:0x0]: returning size 4096 00010000:00010000:2.0:1788572075.204037:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204043:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204049:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204055:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572075.204059:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204066:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204076:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.204079:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572075.204092:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204099:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc83b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.204114:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000254bbc33 reply state 0000000063deab99 transno 330712481913 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204123:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.204129:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572075.204131:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.204133:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1788572075.204230:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+29:156943:x1875444569436928:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 15569us (15811us total) trans 330712481913 rc 0/0 00000100:00100000:2.0:1788572075.204238:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 798 00000100:00100000:0.0:1788572075.225786:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569437056 00000100:00100000:0.0:1788572075.225796:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569437056 00000100:00100000:0.0:1788572075.225886:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 799 00000100:00100000:0.0:1788572075.225894:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+29:156945:x1875444569437056:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572075.225914:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.225937:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc865 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb072 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226002:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226018:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226030:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226042:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226050:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226056:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226179:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bc87a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226188:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bc87a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226195:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bc87a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572075.226290:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2034:0x0]: returning size 4096 00000004:00200000:0.0:1788572075.226295:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1788572075.226312:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bc87a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226321:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226326:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226331:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226334:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.226337:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226342:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226350:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.226353:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.226356:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226360:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc86c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226371:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226374:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226378:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226381:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.226383:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226386:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226389:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.226391:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.226392:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226395:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc873 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226414:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc865 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb072 expref: 31 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226424:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bc87a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb072 expref: 30 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.226429:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2034:0x0].0x0 (ffff8e5a16272c00) 00010000:00010000:0.0:1788572075.226431:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572075.226432:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2000, rc 0) 00000100:00100000:0.0:1788572075.226535:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+30:156945:x1875444569437056:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 641us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.226542:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 799 00000100:00100000:2.0:1788572075.237375:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 800 00000100:00100000:2.0:1788572075.237392:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+30:156945:x1875444569437184:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:2.0:1788572075.237416:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.237439:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc881 lrc: 2/0,0 mode: --/CR res: [0x200025d90:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb079 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.237561:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc888 lrc: 3/1,0 mode: --/PR res: [0x200025d90:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.237577:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc888 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.237589:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc888 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572075.237637:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200025d90:0x3f:0x0]: returning size 4096 00000004:00200000:2.0:1788572075.237642:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788572075.237679:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc881 lrc: 0/0,0 mode: --/CR res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb079 expref: 32 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.237699:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc888 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb079 expref: 31 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.237709:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3f:0x0].0x0 (ffff8e5a16272f00) 00010000:00010000:2.0:1788572075.237712:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572075.237727:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0c00, rc 0) 00000100:00100000:2.0:1788572075.237804:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+31:156945:x1875444569437184:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 415us (4350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.237811:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 800 00000100:00100000:2.0:1788572075.251391:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1788572075.257212:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572075.257229:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.257242:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572075.257250:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.257259:0:10395:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.257314:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 2/0,0 mode: --/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.257323:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572075.257364:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 1/0,0 mode: --/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.257373:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0e00/0x265cfe11109bc857 lrc: 0/0,0 mode: --/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bc85e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.257398:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572075.257400:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572075.257402:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572075.257530:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584172928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572075.257604:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572075.262296:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60de00/0x265cfe11109bc85e lrc: 0/0,0 mode: --/PW res: [0x240002728:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bc857 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.262316:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3f:0x0].0x0 (ffff8e5a318f4900) 00010000:00010000:0.0:1788572075.262322:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc896 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.262332:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc896 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.262340:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc896 lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.262387:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572075.262506:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584172928:12345-0@lo:103:ldlm_bl.0 Request processed in 4655us (4871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.262520:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12865 00000100:00100000:2.0:1788572075.271850:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569437568 00000100:00100000:2.0:1788572075.271861:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569437568 00000100:00100000:2.0:1788572075.271935:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 802 00000100:00100000:2.0:1788572075.271947:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+31:156945:x1875444569437568:12345-192.168.202.57@tcp:36:rmdir.0 00010000:00010000:2.0:1788572075.272013:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572075.272044:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bc87a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb072 expref: 31 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272067:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2034:0x0].0x0 (ffff8e5a16272c00) 00010000:00010000:2.0:1788572075.272073:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572075.272109:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272125:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272136:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272153:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272162:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272170:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272270:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272278:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272285:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272306:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272316:0:188050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc888 lrc: 2/0,0 mode: PR/PR res: [0x200025d90:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb079 expref: 30 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272326:0:188050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 4/0,1 mode: --/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272384:0:188050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc888 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb079 expref: 30 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.272409:0:188050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bc888 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb079 expref: 30 pid: 188050 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.272426:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:188050:1875444584173056:192.168.202.57@tcp:104: 00000100:00100000:2.0:1788572075.272575:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0b5ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.278247:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:188050:1875444584173056:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572075.278284:0:188050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.281990:0:188050:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.281998:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.282047:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.282054:0:188050:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.282064:0:188050:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.282094:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584173184:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1788572075.282139:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.282179:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0b5ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.286077:0:188050:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837371 gen 2 00000004:00080000:2.0:1788572075.286092:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837370 committed transno 21474837371 00000004:00080000:2.0:1788572075.286111:0:188050:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837371 committed transno 21474837371 00000100:00100000:2.0:1788572075.286133:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584173184:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788572075.286156:0:188050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.286168:0:188050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.286893:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569437824 00000100:00100000:0.0:1788572075.286902:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569437824 00010000:00010000:0.0:1788572075.286936:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc896 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb080 expref: 7 pid: 188833 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.286975:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12867 00000100:00100000:0.0:1788572075.286984:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2398:x1875444569437824:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572075.286999:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572075.287005:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc896 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb080 expref: 7 pid: 188833 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.287018:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc896 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb080 expref: 7 pid: 188833 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.287040:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bc896 lrc: 0/0,0 mode: --/PR res: [0x240002728:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb080 expref: 7 pid: 188833 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.287058:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x3f:0x0].0x0 (ffff8e5a318f4900) 00010000:00010000:0.0:1788572075.287063:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bc8c0 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc8b9 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.287072:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bc8c0 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bc8b9 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.287092:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bc8c0 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bc8b9 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.287134:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bc8c0 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc8b9 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.287148:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6503:1875444584173440:0@lo:105: 00000100:00100000:0.0:1788572075.287187:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.287231:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.287287:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584173440 00000100:00100000:2.0:1788572075.287291:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584173440 00000100:00100000:2.0:1788572075.287331:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5374 00000100:00100000:2.0:1788572075.287339:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6503:x1875444584173440:12345-0@lo:105: 00010000:00010000:2.0:1788572075.287349:0:6501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.287370:0:6501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.287379:0:6501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.287386:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.287394:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.287408:0:6501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.287431:0:6501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5905fe0000) 00000100:00100000:2.0:1788572075.287464:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6503:x1875444584173440:12345-0@lo:105: Request processed in 126us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.287470:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5374 00000100:00100000:0.0:1788572075.287746:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6503:1875444584173440:0@lo:105: 00010000:00010000:0.0:1788572075.287761:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572075.287802:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569437824:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 818us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.287809:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12867 00000100:00100000:0.0:1788572075.289597:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584173568 00000100:00100000:0.0:1788572075.289606:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584173568 00000100:00100000:0.0:1788572075.289670:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788572075.289680:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:188050:x1875444584173568:12345-0@lo:403:mdt00_002.0 00000100:00100000:0.0:1788572075.291613:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:188050:x1875444584173568:12345-0@lo:403:mdt00_002.0 Request processed in 1929us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.291626:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000004:00200000:2.0:1788572075.298541:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2034:0x0]: returning size 4096 00010000:00010000:2.0:1788572075.298565:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298574:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298582:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298587:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572075.298592:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298600:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298616:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3f:0x0].0x0 (ffff8e5a16272f00) 00010000:00010000:2.0:1788572075.298619:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572075.298624:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298669:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc8b2 lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298686:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298693:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298699:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0000/0x265cfe11109bc8b9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc8c0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298714:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788572075.298722:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x3f:0x0] 00010000:00010000:2.0:1788572075.298730:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298735:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298740:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298745:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572075.298747:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298753:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298763:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2034:0x0].0x0 (ffff8e5a16272c00) 00010000:00010000:2.0:1788572075.298765:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572075.298768:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298773:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8ab lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298787:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298793:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298799:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298804:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572075.298806:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298812:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298818:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.298820:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572075.298823:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298828:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc89d lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.298840:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e3be0cf reply state 0000000031b95f55 transno 330712481914 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298852:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.298859:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572075.298861:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.298863:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572075.298925:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+31:156945:x1875444569437568:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 26979us (27260us total) trans 330712481914 rc 0/0 00000100:00100000:2.0:1788572075.298932:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 802 00000100:00100000:0.0:1788572075.345273:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569437952 00000100:00100000:0.0:1788572075.345285:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569437952 00000100:00100000:0.0:1788572075.345366:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 803 00000100:00100000:0.0:1788572075.345378:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+31:156946:x1875444569437952:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572075.345406:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.345432:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc8c7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb087 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345555:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345572:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345585:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345597:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345605:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345612:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345653:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345661:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345668:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345675:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.345680:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345693:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345705:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.345708:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.345712:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345720:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bc8ce lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345734:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345741:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345747:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345752:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.345755:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345762:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345770:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.345772:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.345775:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345782:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc8d5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345810:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc8c7 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb087 expref: 32 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345820:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.345823:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.345827:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc8c7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb087 expref: 32 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.345836:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2200, rc 0) 00000100:00100000:0.0:1788572075.345902:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+31:156946:x1875444569437952:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 525us (742us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572075.345909:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 803 00000100:00100000:0.0:1788572075.349441:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569438080 00000100:00100000:0.0:1788572075.349452:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569438080 00000100:00100000:0.0:1788572075.349668:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 804 00000100:00100000:0.0:1788572075.349682:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+31:156946:x1875444569438080:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572075.349705:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.349728:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc8dc lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb08e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349806:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349821:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349834:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349846:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349853:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349860:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349899:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349906:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349913:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349919:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.349924:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349932:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349943:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.349947:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.349952:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349958:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc8e3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349973:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349980:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349985:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.349990:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.349993:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.350000:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.350008:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.350010:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.350014:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.350019:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc8ea lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.350049:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc8dc lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb08e expref: 32 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.350064:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.350067:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.350071:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc8dc lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb08e expref: 32 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.350097:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3200, rc 0) 00000100:00100000:0.0:1788572075.350166:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+31:156946:x1875444569438080:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 487us (948us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572075.350174:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 804 00000100:00100000:0.0:1788572075.367427:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.368698:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569438208 00000100:00100000:2.0:1788572075.368714:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569438208 00000100:00100000:2.0:1788572075.368885:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 805 00000100:00100000:2.0:1788572075.368898:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+31:156946:x1875444569438208:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572075.368921:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.368943:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb095 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.369023:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8f8 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.369039:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8f8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.369051:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8f8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572075.369127:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:2.0:1788572075.369131:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572075.369155:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8f8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.369180:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb095 expref: 33 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.369207:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8f8 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb095 expref: 32 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.369216:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.369219:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572075.369223:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1200, rc 0) 00000100:00100000:2.0:1788572075.369290:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+32:156946:x1875444569438208:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 395us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.369298:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 805 00000100:00100000:2.0:1788572075.390209:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569438464 00000100:00100000:2.0:1788572075.390221:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569438464 00000100:00100000:2.0:1788572075.390291:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 806 00000100:00100000:2.0:1788572075.390303:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+32:156946:x1875444569438464:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1788572075.390362:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572075.390393:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bc8f8 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb095 expref: 32 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.390414:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.390420:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572075.390537:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.390551:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.390560:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.390572:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.390580:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.390587:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572075.401961:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 895 rpc_version 895 00000020:00100000:2.0:1788572075.402016:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572075.402026:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36eab100 x1875444584174208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572075.402054:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584174208:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.402135:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.402174:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.403019:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584174208:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572075.403851:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584174336:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788572075.403864:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60ce00/0x265cfe11109bc91b lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc922 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.403873:0:188050:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60ce00/0x265cfe11109bc91b lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc922 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572075.403893:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdb34ad7 reply state 00000000b33a39a5 transno 330712481915 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc914 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.403905:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc914 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.403912:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x40:0x0].0x0 (ffff8e5a318f4c00) 00010000:00010000:0.0:1788572075.403914:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572075.403917:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572075.403923:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60ce00/0x265cfe11109bc91b lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc922 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.403931:0:188050:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60ce00/0x265cfe11109bc91b lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc922 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572075.403939:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x40:0x0] 00000004:00010000:0.0:1788572075.403945:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdb34ad7 reply state 00000000b33a39a5 transno 330712481915 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc90d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.403953:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc90d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.403959:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2035:0x0].0x0 (ffff8e5a318f4900) 00010000:00010000:0.0:1788572075.403962:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572075.403963:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1788572075.403968:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2035:0x0]: returning size 4096 00010000:00010000:0.0:1788572075.403988:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.403995:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.404002:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.404008:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.404012:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.404020:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.404034:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.404037:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.404040:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.404047:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bc8ff lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572075.404060:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdb34ad7 reply state 00000000b33a39a5 transno 330712481915 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.404069:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.404085:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.404088:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572075.404090:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1788572075.404174:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+33:156946:x1875444569438464:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 13871us (14798us total) trans 330712481915 rc 0/0 00000100:00100000:0.0:1788572075.404191:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 806 00010000:00010000:2.0:1788572075.452998:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572075.453140:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569438720 00000100:00100000:0.0:1788572075.453150:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569438720 00000100:00100000:0.0:1788572075.453214:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 808 00000100:00100000:0.0:1788572075.453225:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+34:156947:x1875444569438720:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572075.453246:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.453267:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc945 lrc: 2/0,0 mode: --/CR res: [0x200025d90:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb0a3 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.453338:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc94c lrc: 3/1,0 mode: --/PR res: [0x200025d90:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.453353:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc94c lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.453364:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc94c lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572075.453418:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200025d90:0x40:0x0]: returning size 4096 00000004:00200000:0.0:1788572075.453424:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1788572075.453467:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bc945 lrc: 0/0,0 mode: --/CR res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0a3 expref: 36 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.453527:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc94c lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0a3 expref: 35 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.453537:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x40:0x0].0x0 (ffff8e5a318f4c00) 00010000:00010000:0.0:1788572075.453541:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788572075.453544:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2800, rc 0) 00000100:00100000:0.0:1788572075.453607:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+35:156947:x1875444569438720:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 383us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.453614:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 808 00000100:00100000:0.0:1788572075.461869:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788572075.461892:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584174464 00000100:00100000:0.0:1788572075.461902:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584174464 00000100:00100000:0.0:1788572075.461944:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5375 00000100:00100000:0.0:1788572075.461953:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59062c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188833:x1875444584174464:12345-0@lo:104: 00010000:00010000:0.0:1788572075.461969:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60ce00/0x265cfe11109bc91b lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bc922 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.462065:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572075.462081:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59062c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188833:x1875444584174464:12345-0@lo:104: Request processed in 120us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.462089:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5375 00000100:00100000:2.0:1788572075.462574:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572075.462590:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584174592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572075.462627:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.468853:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584174592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572075.492803:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.492884:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569439232 00000100:00100000:0.0:1788572075.492895:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569439232 00010000:00010000:0.0:1788572075.492938:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc94c lrc: 5/0,0 mode: PR/PR res: [0x200025d90:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0a3 expref: 35 pid: 188048 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.492990:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12869 00000100:00100000:0.0:1788572075.493001:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+35:2397:x1875444569439232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572075.493017:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572075.493024:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc94c lrc: 5/0,0 mode: PR/PR res: [0x200025d90:0x40:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0a3 expref: 35 pid: 188048 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.493038:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bc94c lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x40:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0a3 expref: 35 pid: 188048 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.493060:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x40:0x0].0x0 (ffff8e5a318f4c00) 00010000:00010000:0.0:1788572075.493066:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.493087:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.493100:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 4/0,1 mode: EX/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.493119:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572075.493177:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+35:2397:x1875444569439232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 177us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.493185:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12869 00000100:00100000:0.0:1788572075.493841:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584174848 00000100:00100000:0.0:1788572075.493846:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584174848 00000100:00100000:0.0:1788572075.493888:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788572075.493896:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:188050:x1875444584174848:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788572075.493910:0:188054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.493925:0:188054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc984 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bc97d expref: -99 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.493946:0:188054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bc95a lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0aa expref: 6 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.493955:0:188054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc984 lrc: 4/0,0 mode: --/EX res: [0x240002728:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bc97d expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.493989:0:188054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bc95a lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0aa expref: 6 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.494002:0:188054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bc95a lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0aa expref: 6 pid: 188833 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.494019:0:188054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:188054:1875444584174976:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572075.494068:0:188054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572075.496786:0:188054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:188054:1875444584174976:192.168.202.57@tcp:104: 00010000:00010000:0.0:1788572075.496821:0:188054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc984 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc97d expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.496835:0:188054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x40:0x0].0x0 (ffff8e5a36aab200) 00010000:00010000:0.0:1788572075.496839:0:188054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572075.496843:0:188054:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc984 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc97d expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.496853:0:188054:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3200/0x265cfe11109bc984 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bc97d expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.496861:0:188054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3200, rc 0) 00000100:00100000:0.0:1788572075.497568:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:188050:x1875444584174848:12345-0@lo:101:mdt00_002.0 Request processed in 3660us (3997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.497578:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788572075.504328:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.516512:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188050:x1875444584175232:12345-0@lo:403:mdt00_002.0 Request processed in 10052us (10278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.516526:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000004:00080000:2.0:1788572075.521942:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 896 rpc_version 896 00000020:00100000:2.0:1788572075.521993:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572075.522004:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36eaad80 x1875444584175488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572075.522028:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584175488:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.522108:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.522145:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572075.522301:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584175488 00000100:00100000:0.0:1788572075.522310:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584175488 00000100:00100000:0.0:1788572075.522369:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788572075.522379:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584175488:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572075.522774:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584175488:12345-0@lo:1000:osp_up1-0.0 Request processed in 395us (664us total) trans 21474837374 rc 0/0 00000100:00100000:0.0:1788572075.522782:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788572075.523245:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584175488:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1788572075.523777:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2035:0x0]: returning size 4096 00010000:00010000:0.0:1788572075.523801:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523811:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523819:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523826:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60da00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.523831:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523839:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523855:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x40:0x0].0x0 (ffff8e5a318f4c00) 00010000:00010000:0.0:1788572075.523858:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572075.523864:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523870:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bc976 lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523887:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60d800/0x265cfe11109bc97d lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc984 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523895:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60d800/0x265cfe11109bc97d lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc984 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523902:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60d800/0x265cfe11109bc97d lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bc984 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523926:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572075.523935:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x40:0x0] 00010000:00010000:0.0:1788572075.523942:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bc96f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523948:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bc96f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523954:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bc96f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523960:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.523963:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bc96f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.523969:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bc96f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524045:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2035:0x0].0x0 (ffff8e5a318f4900) 00010000:00010000:0.0:1788572075.524048:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572075.524052:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bc96f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524058:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bc96f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524082:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc961 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524089:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc961 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524095:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc961 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524100:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60ce00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.524103:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc961 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524109:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc961 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524117:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.524120:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.524123:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc961 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524128:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc961 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572075.524139:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000596b9f7 reply state 000000002215a0e3 transno 330712481916 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bc968 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524152:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bc968 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.524160:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.524162:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572075.524165:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572075.524838:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+35:156947:x1875444569439104:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 49123us (49575us total) trans 330712481916 rc 0/0 00000100:00100000:0.0:1788572075.524847:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 810 00000100:00100000:2.0:1788572075.585779:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.591839:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569439488 00000100:00100000:0.0:1788572075.591855:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569439488 00000100:00100000:2.0:1788572075.602583:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.602693:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569439616 00000100:00100000:0.0:1788572075.602703:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569439616 00000100:00100000:0.0:1788572075.602763:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 812 00000100:00100000:0.0:1788572075.602773:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+35:156948:x1875444569439616:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572075.602791:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.602810:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc9a0 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb0b8 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602866:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602881:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602893:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602913:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602921:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602927:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602967:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602974:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602982:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602988:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.602992:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.602999:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603010:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.603013:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.603018:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603024:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9a7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603038:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603044:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603050:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603054:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.603057:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603085:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603094:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.603096:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.603098:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603104:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9ae lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603130:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc9a0 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0b8 expref: 36 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603140:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.603142:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.603146:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc9a0 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0b8 expref: 36 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.603156:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3600, rc 0) 00000100:00100000:0.0:1788572075.603217:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+35:156948:x1875444569439616:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 445us (644us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572075.603224:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 812 00000100:00100000:2.0:1788572075.610424:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.617325:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000004:00080000:2.0:1788572075.625960:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 897 rpc_version 897 00000020:00100000:2.0:1788572075.626011:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572075.626022:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27420a80 x1875444584175872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572075.626049:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584175872:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.626145:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.626186:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.636173:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584175872:12345-0@lo:1000:osp_up1-0.0 Request processed in 9545us (10021us total) trans 21474837375 rc 0/0 00000100:00100000:2.0:1788572075.636187:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:2.0:1788572075.636702:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.636719:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.636732:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.636754:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 3/0,1 mode: --/PW res: [0x200025d90:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.636761:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.636768:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.636805:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 3/0,1 mode: --/PW res: [0x240002728:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.636812:0:188050:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 3/0,1 mode: --/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.636821:0:188050:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 3/0,1 mode: --/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.636838:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584176000:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1788572075.636873:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.636897:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.638024:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584176000:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788572075.638042:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638053:0:188050:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.638089:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d8691ab reply state 00000000e7d42fb9 transno 330712481917 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638102:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638109:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x41:0x0].0x0 (ffff8e5a16272200) 00010000:00010000:2.0:1788572075.638112:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.638115:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572075.638121:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638130:0:188050:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572075.638141:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x41:0x0] 00000004:00010000:2.0:1788572075.638147:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d8691ab reply state 00000000e7d42fb9 transno 330712481917 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638155:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638161:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2036:0x0].0x0 (ffff8e5a16272900) 00010000:00010000:2.0:1788572075.638165:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.638167:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1788572075.638173:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2036:0x0]: returning size 4096 00010000:00010000:2.0:1788572075.638181:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc9c3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638188:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc9c3 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638195:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc9c3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638201:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60ce00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572075.638206:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc9c3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638214:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc9c3 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638224:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.638226:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572075.638230:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc9c3 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638236:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bc9c3 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.638262:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d8691ab reply state 00000000e7d42fb9 transno 330712481917 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bc9ca lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638279:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bc9ca lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.638290:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572075.638292:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572075.638294:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1788572075.638382:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+37:156948:x1875444569440000:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 20796us (21065us total) trans 330712481917 rc 0/0 00000100:00100000:2.0:1788572075.638391:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 814 00000100:00100000:2.0:1788572075.660077:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.660186:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569440128 00000100:00100000:0.0:1788572075.660197:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569440128 00000100:00100000:0.0:1788572075.660310:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 815 00000100:00100000:0.0:1788572075.660322:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+37:156949:x1875444569440128:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572075.660353:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.660374:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc9ed lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb0c6 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660434:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660448:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660459:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660467:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660474:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660507:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660587:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bca02 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660596:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bca02 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660602:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bca02 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572075.660694:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2036:0x0]: returning size 4096 00000004:00200000:0.0:1788572075.660699:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1788572075.660721:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bca02 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.660748:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661081:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661088:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661094:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.661098:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661107:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661120:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.661122:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.661127:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661134:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bc9f4 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661150:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661156:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661165:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661170:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.661173:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661178:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661186:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.661189:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.661192:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661198:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bc9fb lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661227:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bc9ed lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0c6 expref: 39 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661240:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bca02 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0c6 expref: 38 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.661342:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2036:0x0].0x0 (ffff8e5a16272900) 00010000:00010000:0.0:1788572075.661345:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572075.661349:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2e00, rc 0) 00000100:00100000:0.0:1788572075.661455:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+38:156949:x1875444569440128:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 1134us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.661463:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 815 00000100:00100000:2.0:1788572075.692008:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569440256 00000100:00100000:2.0:1788572075.692024:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569440256 00000100:00100000:2.0:1788572075.692141:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 816 00000100:00100000:2.0:1788572075.692152:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+38:156949:x1875444569440256:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:2.0:1788572075.692184:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.692208:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca09 lrc: 2/0,0 mode: --/CR res: [0x200025d90:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb0cd expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.692296:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bca10 lrc: 3/1,0 mode: --/PR res: [0x200025d90:0x41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.692311:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bca10 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.692323:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bca10 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572075.692377:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200025d90:0x41:0x0]: returning size 4096 00000004:00200000:2.0:1788572075.692383:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788572075.692425:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca09 lrc: 0/0,0 mode: --/CR res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0cd expref: 40 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.692452:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bca10 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0cd expref: 39 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.692461:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x41:0x0].0x0 (ffff8e5a16272200) 00010000:00010000:2.0:1788572075.692464:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572075.692468:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0e00, rc 0) 00000100:00100000:2.0:1788572075.692585:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+39:156949:x1875444569440256:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 435us (13173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.692593:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 816 00000100:00100000:0.0:1788572075.707358:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.716017:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584176128 00000100:00100000:2.0:1788572075.716022:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584176128 00010000:00010000:0.0:1788572075.716392:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572075.716400:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.716407:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:0.0:1788572075.716413:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572075.716422:0:10395:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.716449:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 2/0,0 mode: --/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.716455:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572075.716505:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 1/0,0 mode: --/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.716513:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe0200/0x265cfe11109bc9df lrc: 0/0,0 mode: --/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bc9e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.716535:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572075.716536:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572075.716538:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572075.716547:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572075.716558:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584176256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572075.716593:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.716636:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584176256 00000100:00100000:0.0:1788572075.716641:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584176256 00010000:00010000:0.0:1788572075.716661:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60d400/0x265cfe11109bc9e6 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x265cfe11109bc9df expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.716685:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12871 00000100:00100000:0.0:1788572075.716692:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3641:x1875444584176256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572075.716701:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1788572075.720816:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837375 is committed 00010000:00010000:2.0:1788572075.721722:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60d400/0x265cfe11109bc9e6 lrc: 0/0,0 mode: --/PW res: [0x240002728:0x41:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bc9df expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.721756:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x41:0x0].0x0 (ffff8e5a0a4b7400) 00010000:00010000:2.0:1788572075.721762:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60da00/0x265cfe11109bca1e lrc: 3/1,0 mode: --/PR res: [0x240002728:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.721772:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60da00/0x265cfe11109bca1e lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.721780:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60da00/0x265cfe11109bca1e lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.721818:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572075.721909:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584176256:12345-0@lo:103:ldlm_bl.0 Request processed in 5212us (5309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.721929:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12871 00000100:00100000:0.0:1788572075.722713:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584176256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572075.728009:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.737565:0:188049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:188049:1875444584176384:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572075.737600:0:188049:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bca3a lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.740467:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572075.740613:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12aa4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+38:2398:x1875444569440768:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2672us (3186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.740637:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12872 00000100:00100000:2.0:1788572075.744235:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584176512 00000100:00100000:2.0:1788572075.744314:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584176512 00000100:00100000:2.0:1788572075.744526:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788572075.744538:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:188049:x1875444584176512:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788572075.744561:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.744588:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bca48 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bca41 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.744638:0:189111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60da00/0x265cfe11109bca1e lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0d4 expref: 6 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.744650:0:189111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bca48 lrc: 4/0,0 mode: --/EX res: [0x240002728:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bca41 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.744688:0:189111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60da00/0x265cfe11109bca1e lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0d4 expref: 6 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.744704:0:189111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60da00/0x265cfe11109bca1e lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0d4 expref: 6 pid: 188833 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.744726:0:189111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27423b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:189111:1875444584176640:192.168.202.57@tcp:104: 00000100:00100000:2.0:1788572075.744818:0:189111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4ac00 going to sleep for 11 seconds 00010000:00010000:2.0:1788572075.752899:0:189111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60da00/0x265cfe11109bca1e lrc: 0/0,0 mode: --/PR res: [0x240002728:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0d4 expref: 7 pid: 188833 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.752924:0:189111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27423b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:189111:1875444584176640:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572075.752966:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bca48 lrc: 4/0,0 mode: EX/EX res: [0x240002728:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bca41 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.752977:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x41:0x0].0x0 (ffff8e5a0a4b7400) 00010000:00010000:2.0:1788572075.752979:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572075.752983:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1200, rc 0) 00000100:00100000:2.0:1788572075.753265:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188049:x1875444584176512:12345-0@lo:101:mdt00_001.0 Request processed in 8728us (9875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.753275:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788572075.758427:0:188049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837375 gen 2 00000004:00080000:0.0:1788572075.758446:0:188049:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837374 committed transno 21474837375 00000004:00080000:0.0:1788572075.758757:0:188049:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837375 committed transno 21474837375 00000100:00100000:0.0:1788572075.758793:0:188049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:188049:1875444584176512:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788572075.758827:0:188049:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3a00/0x265cfe11109bca41 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bca48 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572075.759720:0:188049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:188049:1875444584176896:0@lo:403:mdt00_001.0 00000100:00100000:0.0:1788572075.759822:0:188049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.759866:0:188049:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572075.763737:0:188049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:188049:1875444584176896:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1788572075.766838:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].445, 656 off666592 00000040:00080000:0.0:1788572075.767475:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].477, 736 off769104 00000004:00080000:0.0:1788572075.767570:0:188049:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590b186480 with version 898 00000100:00100000:2.0:1788572075.768213:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584177152 00000100:00100000:2.0:1788572075.768225:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584177152 00000100:00100000:2.0:1788572075.768667:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788572075.768681:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584177152:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.769036:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584177152:12345-0@lo:1000:osp_up1-0.0 Request processed in 357us (1081us total) trans 21474837376 rc 0/0 00000100:00100000:2.0:1788572075.769045:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000004:00200000:0.0:1788572075.769605:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2036:0x0]: returning size 4096 00010000:00010000:0.0:1788572075.769648:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bca3a lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769662:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bca3a lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769671:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bca3a lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769678:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.769683:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bca3a lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769692:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bca3a lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769714:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x41:0x0].0x0 (ffff8e5a16272200) 00010000:00010000:0.0:1788572075.769717:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572075.769724:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bca3a lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769731:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bca3a lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769752:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3a00/0x265cfe11109bca41 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bca48 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769761:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3a00/0x265cfe11109bca41 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bca48 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769770:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3a00/0x265cfe11109bca41 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bca48 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769792:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572075.769803:0:188049:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x41:0x0] 00010000:00010000:0.0:1788572075.769811:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2800/0x265cfe11109bca33 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769818:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2800/0x265cfe11109bca33 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769825:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2800/0x265cfe11109bca33 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769830:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.769833:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2800/0x265cfe11109bca33 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769838:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2800/0x265cfe11109bca33 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769846:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2036:0x0].0x0 (ffff8e5a16272900) 00010000:00010000:0.0:1788572075.769848:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572075.769851:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2800/0x265cfe11109bca33 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769856:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2800/0x265cfe11109bca33 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769873:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bca25 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769880:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bca25 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769887:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bca25 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769892:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.769895:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bca25 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769901:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bca25 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769909:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.769911:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.769914:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bca25 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769921:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bca25 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572075.769933:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d842d8f5 reply state 00000000f9d82278 transno 330712481918 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bca2c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769950:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bca2c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.769958:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.769961:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572075.769964:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572075.770249:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+39:156949:x1875444569440640:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 41931us (42247us total) trans 330712481918 rc 0/0 00000100:00100000:0.0:1788572075.770259:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 818 00000100:00100000:0.0:1788572075.774229:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584177280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572075.774361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.775406:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584177280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572075.808651:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569441024 00000100:00100000:0.0:1788572075.808668:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569441024 00000100:00100000:0.0:1788572075.808765:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 819 00000100:00100000:0.0:1788572075.808779:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+39:156950:x1875444569441024:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572075.808814:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572075.808839:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bca4f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb0db expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.808924:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.808942:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809441:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809463:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809473:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809542:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809604:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809624:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809632:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809639:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.809644:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809653:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809668:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.809672:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.809677:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809685:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bca56 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809704:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809711:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809716:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809724:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572075.809727:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809734:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809742:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572075.809745:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.809748:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809859:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bca5d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809900:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bca4f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0db expref: 40 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809911:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572075.809914:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572075.809918:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bca4f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0db expref: 40 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.809927:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3400, rc 0) 00000100:00100000:0.0:1788572075.810233:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+39:156950:x1875444569441024:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1455us (2021us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572075.810242:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 819 00000100:00100000:0.0:1788572075.818323:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.818705:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569441152 00000100:00100000:2.0:1788572075.818720:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569441152 00000100:00100000:2.0:1788572075.818800:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 820 00000100:00100000:2.0:1788572075.818812:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+39:156950:x1875444569441152:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572075.818839:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.818864:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bca64 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb0e2 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.818948:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.818965:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.818979:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819010:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819019:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819026:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819471:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819523:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819531:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819543:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572075.819548:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819557:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819572:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.819576:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572075.819582:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819589:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bca6b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819606:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819612:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819618:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819623:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572075.819626:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819632:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819645:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572075.819648:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572075.819652:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.819658:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bca72 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.820946:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bca64 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0e2 expref: 40 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.820979:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.820982:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572075.820989:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bca64 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0e2 expref: 40 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.821013:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0c00, rc 0) 00000100:00100000:2.0:1788572075.830714:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 821 00000100:00100000:2.0:1788572075.830730:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+39:156950:x1875444569441280:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572075.830758:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.830786:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bca79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb0e9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.830879:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bca80 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.830899:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bca80 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.830915:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bca80 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572075.831001:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:2.0:1788572075.831006:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572075.831033:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bca80 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.831136:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bca79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0e9 expref: 41 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.831162:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bca80 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0e9 expref: 40 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.831173:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572075.831176:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572075.831181:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0200, rc 0) 00000100:00100000:2.0:1788572075.831276:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+40:156950:x1875444569441280:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 549us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.831284:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 821 00000100:00100000:0.0:1788572075.843365:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569441536 00000100:00100000:0.0:1788572075.843380:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569441536 00000004:00080000:2.0:1788572075.848141:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 899 rpc_version 899 00000020:00100000:2.0:1788572075.848199:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572075.848214:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27423b80 x1875444584177536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572075.848364:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27423b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584177536:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.848685:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.848774:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572075.848829:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584177536 00000100:00100000:0.0:1788572075.848839:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584177536 00000100:00100000:0.0:1788572075.848935:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788572075.848946:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41336c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584177536:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572075.850202:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41336c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584177536:12345-0@lo:1000:osp_up1-0.0 Request processed in 1250us (1511us total) trans 21474837377 rc 0/0 00000100:00100000:0.0:1788572075.850216:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788572075.851259:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27423b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584177536:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.854875:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584177664 00000100:00100000:2.0:1788572075.854898:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584177664 00000100:00100000:2.0:1788572075.855011:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788572075.855024:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:188049:x1875444584177664:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788572075.855446:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.855509:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcaaa lrc: 2/0,0 mode: --/PW res: [0x240002728:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bcaa3 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.855552:0:189111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcaaa lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bcaa3 expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.855570:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcaaa lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcaa3 expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.855580:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x42:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572075.855583:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572075.855588:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0e00, rc 0) 00000100:00100000:2.0:1788572075.855753:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:188049:x1875444584177664:12345-0@lo:101:mdt00_001.0 Request processed in 731us (3512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.855761:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788572075.887185:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572075.898872:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.899211:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569441920 00000100:00100000:2.0:1788572075.899228:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569441920 00000100:00100000:2.0:1788572075.899425:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 825 00000100:00100000:2.0:1788572075.899439:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:156951:x1875444569441920:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:2.0:1788572075.899469:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.899526:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcadb lrc: 2/0,0 mode: --/CR res: [0x240002728:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb0fe expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.899628:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcae2 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.899645:0:188048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcaaa lrc: 2/0,0 mode: PW/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcaa3 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.899655:0:188048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcae2 lrc: 4/1,0 mode: --/PR res: [0x240002728:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.899695:0:188048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcaaa lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bcaa3 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.899713:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27421c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:188048:1875444584177792:0@lo:104: 00000100:00100000:2.0:1788572075.899981:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.900282:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584177792 00000100:00100000:0.0:1788572075.900290:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584177792 00000100:00100000:0.0:1788572075.900341:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5379 00000100:00100000:0.0:1788572075.900351:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:188048:x1875444584177792:12345-0@lo:104: 00010000:00010000:0.0:1788572075.900369:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3200/0x265cfe11109bcaa3 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bcaaa expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.900436:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572075.900444:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:188048:x1875444584177792:12345-0@lo:104: Request processed in 94us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.900452:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5379 00010000:00010000:0.0:1788572075.900507:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572075.900514:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3200/0x265cfe11109bcaa3 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bcaaa expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.900524:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3200 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:0.0:1788572075.900530:0:10396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3200/0x265cfe11109bcaa3 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x265cfe11109bcaaa expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572075.900554:0:10396:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3200/0x265cfe11109bcaa3 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x265cfe11109bcaaa expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.900588:0:10396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3200/0x265cfe11109bcaa3 lrc: 2/0,0 mode: --/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bcaaa expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.900595:0:10396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572075.900630:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3200/0x265cfe11109bcaa3 lrc: 1/0,0 mode: --/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bcaaa expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.900639:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3200/0x265cfe11109bcaa3 lrc: 0/0,0 mode: --/PW res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bcaaa expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572075.900664:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572075.900666:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572075.900668:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572075.900685:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584177920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572075.901374:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.903447:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.903527:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27421c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:188048:1875444584177792:0@lo:104: 00010000:00010000:2.0:1788572075.903567:0:188048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcae2 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572075.906857:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837377 is committed 00000100:00100000:0.0:1788572075.908153:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584177920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572075.908263:0:188048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcae2 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.908274:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcae2 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572075.908359:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002728:0x42:0x0]: returning size 4096 00000004:00200000:2.0:1788572075.908367:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788572075.908429:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcadb lrc: 0/0,0 mode: --/CR res: [0x240002728:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0fe expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.908451:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcae2 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0fe expref: 7 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.908462:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x42:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572075.908465:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572075.908469:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1200, rc 0) 00000100:00100000:2.0:1788572075.908606:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:156951:x1875444569441920:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 9169us (9750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.908615:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 825 00000100:00100000:0.0:1788572075.912346:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584178048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.912394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.912439:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584178560:0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.912466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.912504:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584179072:0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.912529:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.912544:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572075.912550:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584178176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.912573:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.912585:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584178688:0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.912610:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.912631:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584179200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.912654:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572075.912684:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584179200 00000100:00100000:0.0:1788572075.912688:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584179200 00000100:00100000:0.0:1788572075.912720:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7509 00000100:00100000:0.0:1788572075.912727:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584179200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.912765:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584179200:12345-0@lo:400:kworker.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.912771:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7509 00000100:00100000:0.0:1788572075.912804:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584179200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.912823:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584178688 00000100:00100000:0.0:1788572075.912826:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584178688 00000100:00100000:0.0:1788572075.912848:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788572075.912854:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584178688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.912887:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584178688:12345-0@lo:400:kworker.0 Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572075.912893:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788572075.912914:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584178688:0@lo:400:kworker.0 00000100:00080000:0.0:1788572075.913448:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572075.913452:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572075.913474:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584178176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.913531:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584178560:0@lo:400:kworker.0 00000100:00100000:0.0:1788572075.913542:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584179072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572075.921942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572075.930195:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569442304 00000100:00100000:2.0:1788572075.930209:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569442304 00010000:00010000:2.0:1788572075.930279:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcad4 lrc: 5/0,0 mode: PR/PR res: [0x200025d90:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0f7 expref: 43 pid: 188050 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.930334:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12875 00000100:00100000:2.0:1788572075.930347:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+43:2397:x1875444569442304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572075.930369:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572075.930378:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcad4 lrc: 5/0,0 mode: PR/PR res: [0x200025d90:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0f7 expref: 43 pid: 188050 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.930396:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcad4 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0f7 expref: 43 pid: 188050 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.930426:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x42:0x0].0x0 (ffff8e5a36aab300) 00010000:00010000:2.0:1788572075.930434:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcafe lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.930448:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcafe lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.930458:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcafe lrc: 4/0,1 mode: EX/EX res: [0x200025d90:0x42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.930512:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572075.930578:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+43:2397:x1875444569442304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 234us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.930587:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12875 00000100:00100000:2.0:1788572075.932376:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584179712 00000100:00100000:2.0:1788572075.932386:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584179712 00000100:00100000:2.0:1788572075.932446:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788572075.932457:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:188833:x1875444584179712:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1788572075.932497:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572075.932518:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb0c lrc: 2/0,0 mode: --/EX res: [0x240002728:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bcb05 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.932549:0:189111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcae2 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0fe expref: 6 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.932560:0:189111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb0c lrc: 4/0,0 mode: --/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bcb05 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.932592:0:189111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcae2 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0fe expref: 6 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.932625:0:189111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcae2 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb0fe expref: 6 pid: 188048 timeout: 8928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.932639:0:189111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27423100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:189111:1875444584179840:192.168.202.57@tcp:104: 00000100:00100000:2.0:1788572075.932717:0:189111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.939044:0:189111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27423100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:189111:1875444584179840:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572075.939108:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb0c lrc: 3/0,0 mode: --/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcb05 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.939123:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x42:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572075.939126:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572075.939131:0:189111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb0c lrc: 3/0,0 mode: --/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcb05 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.939142:0:189111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb0c lrc: 3/0,0 mode: --/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcb05 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.939150:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0000, rc 0) 00000100:00100000:2.0:1788572075.939225:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188833:x1875444584179712:12345-0@lo:101:mdt00_003.0 Request processed in 6768us (7362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.939236:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788572075.944469:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1788572075.958020:0:188833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60c800/0x265cfe11109bcb05 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcb0c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.958063:0:188833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60c800/0x265cfe11109bcb05 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcb0c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572075.961389:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584180096:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1788572075.961550:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.965215:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.969260:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584180096:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1788572075.971366:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].447, 656 off669400 00000040:00080000:2.0:1788572075.972383:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].479, 736 off772192 00000004:00080000:2.0:1788572075.972395:0:188833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a3fb4a780 with version 900 00000020:00100000:2.0:1788572075.981888:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572075.981913:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27420a80 x1875444584180352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572075.981960:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584180352:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572075.983198:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.983277:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788572075.985782:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584180352:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1788572075.989759:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572075.989770:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60c800/0x265cfe11109bcb05 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bcb0c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.989779:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c800 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572075.989784:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60c800/0x265cfe11109bcb05 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bcb0c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572075.989799:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60c800/0x265cfe11109bcb05 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bcb0c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.989847:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60c800/0x265cfe11109bcb05 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcb0c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.989855:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572075.989893:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60c800/0x265cfe11109bcb05 lrc: 1/0,0 mode: --/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcb0c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.989901:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60c800/0x265cfe11109bcb05 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcb0c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.989926:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572075.989929:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572075.989931:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572075.989942:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572075.989966:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584180480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572075.990042:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572075.991161:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584180480 00000100:00100000:2.0:1788572075.991177:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584180480 00000100:00100000:2.0:1788572075.991266:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4628 00000100:00100000:2.0:1788572075.991278:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3642:x1875444584180480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572075.991296:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572075.991320:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb0c lrc: 0/0,0 mode: --/EX res: [0x240002728:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bcb05 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572075.991347:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x42:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572075.991360:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572075.991427:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3642:x1875444584180480:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572075.991435:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4628 00000100:00100000:2.0:1788572075.991511:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584180480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572076.021463:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.021637:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569442560 00000100:00100000:0.0:1788572076.021651:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569442560 00000100:00100000:0.0:1788572076.021743:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 827 00000100:00100000:0.0:1788572076.021766:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+43:156957:x1875444569442560:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572076.021798:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.021824:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcb13 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb105 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.021911:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.021930:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.021960:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.021976:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.021985:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.021993:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022068:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022082:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022090:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022096:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.022102:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022111:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022125:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.022129:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.022135:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022142:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb1a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022160:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022167:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022173:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022179:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.022183:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022189:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022196:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572076.022198:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.022202:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022207:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb21 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022253:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcb13 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb105 expref: 44 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022264:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.022266:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.022270:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcb13 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb105 expref: 44 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.022280:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3e00, rc 0) 00000100:00100000:0.0:1788572076.022365:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+43:156957:x1875444569442560:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 612us (918us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572076.022373:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 827 00000100:00100000:2.0:1788572076.048514:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569442688 00000100:00100000:2.0:1788572076.048527:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569442688 00000100:00100000:2.0:1788572076.048618:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 828 00000100:00100000:2.0:1788572076.048630:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+43:156957:x1875444569442688:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572076.048659:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572076.048689:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcb28 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb10c expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048777:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048795:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048810:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048823:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048835:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048842:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048897:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048904:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048911:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048918:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572076.048923:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048932:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048958:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572076.048962:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572076.048969:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048976:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb2f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.048993:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.049000:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.049006:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.049010:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572076.049013:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.049019:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.049026:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572076.049028:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572076.049031:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.049037:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb36 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.049078:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcb28 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb10c expref: 44 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.049090:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572076.049093:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572076.049096:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcb28 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb10c expref: 44 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.049111:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0c00, rc 0) 00000100:00100000:2.0:1788572076.049199:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+43:156957:x1875444569442688:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 571us (941us total) trans 0 rc 301/301 00000100:00100000:2.0:1788572076.049208:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 828 00000100:00100000:2.0:1788572076.060026:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.060156:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569442816 00000100:00100000:0.0:1788572076.060172:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569442816 00000100:00100000:0.0:1788572076.060261:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 829 00000100:00100000:0.0:1788572076.060274:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+43:156957:x1875444569442816:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572076.060302:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.060330:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb113 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.060439:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb44 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.060458:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb44 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.060473:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb44 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572076.060586:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:0.0:1788572076.060591:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572076.060773:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb44 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.060808:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb113 expref: 45 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.060832:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb44 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb113 expref: 44 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.060841:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.060844:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572076.060849:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3c00, rc 0) 00000100:00100000:0.0:1788572076.060980:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+44:156957:x1875444569442816:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 709us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.060994:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 829 00000100:00100000:0.0:1788572076.076003:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572076.076170:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569443072 00000100:00100000:2.0:1788572076.076184:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569443072 00000100:00100000:2.0:1788572076.076270:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 830 00000100:00100000:2.0:1788572076.076282:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+44:156957:x1875444569443072:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1788572076.076362:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572076.076399:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcb44 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb113 expref: 44 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.076424:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572076.076431:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572076.076564:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.076582:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.076595:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.076765:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.076783:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.076791:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572076.084792:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 901 rpc_version 901 00000020:00100000:2.0:1788572076.084854:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572076.084868:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36ea9c00 x1875444584180736/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572076.084900:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584180736:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572076.084995:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572076.085030:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.085112:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584180736 00000100:00100000:0.0:1788572076.085124:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584180736 00000100:00100000:0.0:1788572076.085192:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788572076.085204:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584180736:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572076.088816:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584180736:12345-0@lo:1000:osp_up1-0.0 Request processed in 3599us (3806us total) trans 21474837379 rc 0/0 00000100:00100000:0.0:1788572076.088837:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788572076.098298:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584180736:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572076.099370:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584180864 00000100:00100000:2.0:1788572076.099380:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584180864 00000100:00100000:2.0:1788572076.099448:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788572076.099460:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:188050:x1875444584180864:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788572076.099517:0:188054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572076.099539:0:188054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcb6e lrc: 2/0,0 mode: --/PW res: [0x240002728:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bcb67 expref: -99 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.099566:0:188054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcb6e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bcb67 expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.099582:0:188054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcb6e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcb67 expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.099597:0:188054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x43:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572076.099613:0:188054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572076.099618:0:188054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1200, rc 0) 00000100:00100000:2.0:1788572076.099673:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:188050:x1875444584180864:12345-0@lo:101:mdt00_002.0 Request processed in 216us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.099681:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788572076.100060:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:188050:1875444584180864:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788572076.100081:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60dc00/0x265cfe11109bcb67 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcb6e expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100093:0:188050:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60dc00/0x265cfe11109bcb67 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcb6e expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572076.100122:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e34d816e reply state 00000000f9e1c10b transno 330712481921 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bcb60 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100137:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bcb60 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100144:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x43:0x0].0x0 (ffff8e590430c600) 00010000:00010000:0.0:1788572076.100147:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.100151:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572076.100158:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60dc00/0x265cfe11109bcb67 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcb6e expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100172:0:188050:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60dc00/0x265cfe11109bcb67 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcb6e expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572076.100187:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x43:0x0] 00000004:00010000:0.0:1788572076.100198:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e34d816e reply state 00000000f9e1c10b transno 330712481921 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bcb59 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100208:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bcb59 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100214:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2038:0x0].0x0 (ffff8e590430c200) 00010000:00010000:0.0:1788572076.100217:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.100219:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1788572076.100225:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2038:0x0]: returning size 4096 00010000:00010000:0.0:1788572076.100305:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100313:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100321:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100327:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.100332:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100351:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100368:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.100371:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.100375:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100382:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bcb4b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572076.100399:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e34d816e reply state 00000000f9e1c10b transno 330712481921 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100410:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.100416:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572076.100419:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.100421:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1788572076.100741:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+45:156957:x1875444569443072:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 24459us (24752us total) trans 330712481921 rc 0/0 00000100:00100000:0.0:1788572076.100749:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 830 00000100:00100000:2.0:1788572076.127037:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.127166:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569443200 00000100:00100000:0.0:1788572076.127181:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569443200 00000100:00100000:0.0:1788572076.127267:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 831 00000100:00100000:0.0:1788572076.127280:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+45:156958:x1875444569443200:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572076.127311:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.127352:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb75 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb11a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.127453:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.127470:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.127526:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.127541:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.127550:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.127557:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128024:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcb8a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128035:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcb8a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128044:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcb8a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572076.128165:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2038:0x0]: returning size 4096 00000004:00200000:0.0:1788572076.128172:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1788572076.128199:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcb8a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128218:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128226:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128507:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128515:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.128520:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128529:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128545:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.128550:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.128556:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128562:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcb7c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128582:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128589:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128596:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.128602:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.129413:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.129427:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.129441:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572076.129444:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.129448:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.129455:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcb83 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.129799:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcb75 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb11a expref: 47 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.129820:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcb8a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb11a expref: 46 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.129830:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2038:0x0].0x0 (ffff8e590430c200) 00010000:00010000:0.0:1788572076.129832:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572076.129837:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2e00, rc 0) 00000100:00100000:2.0:1788572076.140783:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.150439:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572076.150828:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569443456 00000100:00100000:2.0:1788572076.150841:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569443456 00000100:00100000:2.0:1788572076.150915:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 833 00000100:00100000:2.0:1788572076.150926:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:156958:x1875444569443456:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:2.0:1788572076.150952:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572076.150979:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bcb9f lrc: 2/0,0 mode: --/CR res: [0x240002728:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb128 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.151075:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.151092:0:188049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcb6e lrc: 2/0,0 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcb67 expref: 8 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.151102:0:188049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 4/1,0 mode: --/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.151143:0:188049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcb6e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bcb67 expref: 8 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.151167:0:188049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:188049:1875444584180992:0@lo:104: 00000100:00100000:2.0:1788572076.151231:0:188049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572076.151288:0:188049:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.151437:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584180992 00000100:00100000:0.0:1788572076.151442:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584180992 00000100:00100000:0.0:1788572076.151516:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5381 00000100:00100000:0.0:1788572076.151525:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188049:x1875444584180992:12345-0@lo:104: 00010000:00010000:0.0:1788572076.151540:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60dc00/0x265cfe11109bcb67 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bcb6e expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.152264:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572076.152274:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188049:x1875444584180992:12345-0@lo:104: Request processed in 749us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.152281:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5381 00000100:00100000:2.0:1788572076.153001:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584181120 00000100:00100000:2.0:1788572076.153011:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584181120 00010000:00010000:2.0:1788572076.153062:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcb6e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x265cfe11109bcb67 expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.153104:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12877 00000100:00100000:2.0:1788572076.153115:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3641:x1875444584181120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572076.153131:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572076.167715:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109bcb6e lrc: 0/0,0 mode: --/PW res: [0x240002728:0x43:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bcb67 expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.167746:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x43:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572076.167753:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.167765:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.167774:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.167822:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572076.167932:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584181120:12345-0@lo:103:ldlm_bl.0 Request processed in 14817us (15953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.167944:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12877 00000100:00100000:0.0:1788572076.168176:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584181120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572076.178193:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572076.191533:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.192080:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569443840 00000100:00100000:0.0:1788572076.192091:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569443840 00010000:00010000:0.0:1788572076.192142:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcb98 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb121 expref: 47 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.192188:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12878 00000100:00100000:0.0:1788572076.192200:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+47:2398:x1875444569443840:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572076.192220:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572076.192228:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcb98 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb121 expref: 47 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.192243:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcb98 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb121 expref: 47 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.192270:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcb98 lrc: 0/0,0 mode: --/PR res: [0x200025d90:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb121 expref: 47 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.192293:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x43:0x0].0x0 (ffff8e590430c600) 00010000:00010000:0.0:1788572076.192300:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.192313:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.192323:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 4/0,1 mode: EX/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.192444:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572076.192799:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+46:2398:x1875444569443840:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 599us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.192808:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12878 00010000:00010000:2.0:1788572076.192879:0:188833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.192888:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.192951:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.192960:0:188833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.192971:0:188833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.192997:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584181376:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1788572076.193074:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572076.193118:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.193242:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584181376 00000100:00100000:0.0:1788572076.193248:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584181376 00000100:00100000:0.0:1788572076.193292:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788572076.193301:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:188833:x1875444584181376:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788572076.193322:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.193358:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2200/0x265cfe11109bcbd0 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bcbc9 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.193386:0:188053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb128 expref: 6 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.193395:0:188053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2200/0x265cfe11109bcbd0 lrc: 4/0,0 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bcbc9 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.193421:0:188053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb128 expref: 6 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.193441:0:188053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb128 expref: 6 pid: 188049 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.193452:0:188053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c83100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:188053:1875444584181504:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572076.193885:0:188053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.200117:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572076.200219:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569443968 00000100:00100000:2.0:1788572076.200232:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569443968 00010000:00010000:2.0:1788572076.200288:0:43930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 5/0,0 mode: PR/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb128 expref: 7 pid: 188049 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.200338:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12879 00000100:00100000:2.0:1788572076.200360:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2397:x1875444569443968:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572076.200381:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572076.200389:0:43930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 5/0,0 mode: PR/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb128 expref: 7 pid: 188049 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.200411:0:43930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109bcba6 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb128 expref: 7 pid: 188049 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.200438:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x43:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572076.200445:0:43930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2200/0x265cfe11109bcbd0 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bcbc9 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.200459:0:43930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2200/0x265cfe11109bcbd0 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109bcbc9 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.200471:0:43930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2200/0x265cfe11109bcbd0 lrc: 4/0,0 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109bcbc9 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.200556:0:43930:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2200/0x265cfe11109bcbd0 lrc: 4/0,0 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcbc9 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.200575:0:43930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27423100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:43930:1875444584181632:0@lo:105: 00000100:00100000:2.0:1788572076.200654:0:43930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572076.200702:0:43930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.200981:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788572076.200997:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584181632 00000100:00100000:0.0:1788572076.201001:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584181632 00000100:00100000:0.0:1788572076.201037:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5382 00000100:00100000:0.0:1788572076.201056:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cc21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:43930:x1875444584181632:12345-0@lo:105: 00010000:00010000:0.0:1788572076.201070:0:6501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.201081:0:6501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.201090:0:6501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.201097:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.201104:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.201118:0:6501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.201135:0:6501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5905fe1200) 00000100:00100000:0.0:1788572076.201186:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cc21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:43930:x1875444584181632:12345-0@lo:105: Request processed in 141us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.201195:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5382 00000100:00100000:2.0:1788572076.202148:0:43930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27423100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:43930:1875444584181632:0@lo:105: 00010000:00010000:2.0:1788572076.202162:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572076.202237:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569443968:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1872us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.202247:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12879 00000100:00100000:0.0:1788572076.202392:0:188833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837379 gen 2 00000004:00080000:0.0:1788572076.202400:0:188833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837378 committed transno 21474837379 00000004:00080000:0.0:1788572076.202426:0:188833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837379 committed transno 21474837379 00000100:00100000:0.0:1788572076.202444:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584181376:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788572076.202464:0:188833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.203374:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584181760:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1788572076.203458:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.203536:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.204265:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584181760 00000100:00100000:2.0:1788572076.204277:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584181760 00000100:00100000:2.0:1788572076.204351:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788572076.204362:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188833:x1875444584181760:12345-0@lo:403:mdt00_003.0 00000100:00100000:2.0:1788572076.211678:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188833:x1875444584181760:12345-0@lo:403:mdt00_003.0 Request processed in 7301us (8203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.211697:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788572076.212326:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584181760:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1788572076.213727:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].449, 656 off672208 00000040:00080000:0.0:1788572076.213933:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].481, 736 off775280 00000004:00080000:0.0:1788572076.213940:0:188833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590b186600 with version 902 00000004:00200000:0.0:1788572076.216857:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2038:0x0]: returning size 4096 00010000:00010000:0.0:1788572076.216891:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.216905:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.216915:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.216922:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.216928:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.216937:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.216957:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x43:0x0].0x0 (ffff8e590430c600) 00010000:00010000:0.0:1788572076.216960:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572076.216965:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.216972:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcbc2 lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.216994:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217003:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217009:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217054:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572076.217066:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x43:0x0] 00010000:00010000:0.0:1788572076.217075:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcbbb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217082:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcbbb lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217088:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcbbb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217093:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60da00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.217095:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcbbb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217101:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcbbb lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217110:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2038:0x0].0x0 (ffff8e590430c200) 00010000:00010000:0.0:1788572076.217112:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572076.217115:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcbbb lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217120:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcbbb lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217137:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcbad lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217144:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcbad lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217149:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcbad lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217159:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60dc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.217162:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcbad lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217168:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcbad lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217177:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.217179:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.217182:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcbad lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217188:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcbad lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572076.217199:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd6633b9 reply state 0000000065cbce51 transno 330712481922 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcbb4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217214:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcbb4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.217222:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572076.217224:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.217228:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572076.217368:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+47:156958:x1875444569443712:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 38923us (39189us total) trans 330712481922 rc 0/0 00000100:00100000:0.0:1788572076.217378:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 834 00010000:00010000:2.0:1788572076.218753:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572076.218770:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.218782:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572076.218790:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572076.218799:0:10395:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.218853:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.218860:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572076.218900:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 1/0,0 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.218909:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905fe1200/0x265cfe11109bcbc9 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcbd0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.218935:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572076.218938:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572076.218940:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572076.218997:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584182144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572076.219091:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572076.220003:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584182144 00000100:00100000:2.0:1788572076.220017:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584182144 00000100:00100000:2.0:1788572076.220115:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4629 00000100:00100000:2.0:1788572076.220128:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3643:x1875444584182144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572076.220148:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572076.220173:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2200/0x265cfe11109bcbd0 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bcbc9 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.220196:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x43:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572076.220208:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572076.220291:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875444584182144:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.220299:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4629 00000100:00100000:0.0:1788572076.221092:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584182144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572076.254259:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.282899:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572076.295217:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000040:00080000:0.0:1788572076.305200:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].450, 2152 off674360 00000040:00080000:0.0:1788572076.305382:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].482, 2352 off777632 00000004:00080000:0.0:1788572076.305391:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a0f3d3900 with version 903 00000100:00100000:2.0:1788572076.309951:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584182400 00000100:00100000:2.0:1788572076.309966:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584182400 00000100:00100000:2.0:1788572076.310064:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788572076.310078:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584182400:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572076.316975:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584182400:12345-0@lo:1000:osp_up1-0.0 Request processed in 6888us (7988us total) trans 21474837381 rc 0/0 00000100:00100000:2.0:1788572076.316996:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:0.0:1788572076.318889:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.318910:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.318926:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.318950:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 3/0,1 mode: --/PW res: [0x200025d90:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.318957:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.318964:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.319014:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 3/0,1 mode: --/PW res: [0x240002728:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.319023:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 3/0,1 mode: --/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.319034:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 3/0,1 mode: --/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.319075:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584182528:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788572076.320439:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.321332:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f073c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.321457:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584182528 00000100:00100000:2.0:1788572076.321472:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584182528 00000100:00100000:2.0:1788572076.322952:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788572076.322979:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:188048:x1875444584182528:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572076.323016:0:188054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572076.323059:0:188054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcc32 lrc: 2/0,0 mode: --/PW res: [0x240002728:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bcc2b expref: -99 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.323120:0:188054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcc32 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bcc2b expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.323140:0:188054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcc32 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcc2b expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.323151:0:188054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x44:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572076.323154:0:188054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572076.323159:0:188054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0c00, rc 0) 00000100:00100000:2.0:1788572076.323285:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:188048:x1875444584182528:12345-0@lo:101:mdt00_000.0 Request processed in 318us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.323293:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788572076.323617:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584182528:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788572076.323643:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323659:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572076.323695:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031d95f78 reply state 00000000c10a64c9 transno 330712481923 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323710:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323717:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x44:0x0].0x0 (ffff8e590b3b4700) 00010000:00010000:0.0:1788572076.323719:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.323723:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572076.323730:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323739:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572076.323754:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x44:0x0] 00000004:00010000:0.0:1788572076.323761:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031d95f78 reply state 00000000c10a64c9 transno 330712481923 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323774:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323780:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2039:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:0.0:1788572076.323782:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.323783:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1788572076.323790:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2039:0x0]: returning size 4096 00010000:00010000:0.0:1788572076.323801:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcc0f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323807:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcc0f lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323814:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcc0f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323821:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.323826:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcc0f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323835:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcc0f lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323846:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.323848:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.323852:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcc0f lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323858:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcc0f lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572076.323880:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031d95f78 reply state 00000000c10a64c9 transno 330712481923 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bcc16 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323889:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bcc16 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.323895:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572076.323897:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.323899:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1788572076.323993:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+49:156961:x1875444569444608:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 28463us (29590us total) trans 330712481923 rc 0/0 00000100:00100000:0.0:1788572076.323999:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 838 00000100:00100000:0.0:1788572076.382951:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572076.384694:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569444736 00000100:00100000:2.0:1788572076.384713:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569444736 00000100:00100000:2.0:1788572076.384807:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 839 00000100:00100000:2.0:1788572076.384817:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+49:156967:x1875444569444736:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:2.0:1788572076.384852:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572076.384879:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcc39 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb144 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.384962:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcc40 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.384979:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcc40 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.384995:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcc40 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.385007:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bcc47 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.385015:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bcc47 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.385022:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bcc47 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.385364:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcc4e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.385375:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcc4e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.385382:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcc4e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572076.385687:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2039:0x0]: returning size 4096 00000004:00200000:2.0:1788572076.385693:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1788572076.396964:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.397077:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569444864 00000100:00100000:0.0:1788572076.397090:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569444864 00000100:00100000:0.0:1788572076.397184:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 840 00000100:00100000:0.0:1788572076.397196:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+50:156967:x1875444569444864:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572076.397222:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.397258:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcc55 lrc: 2/0,0 mode: --/CR res: [0x200025d90:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb14b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.397335:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcc5c lrc: 3/1,0 mode: --/PR res: [0x200025d90:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.397352:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcc5c lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x44:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.397367:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcc5c lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x44:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572076.397432:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200025d90:0x44:0x0]: returning size 4096 00000004:00200000:0.0:1788572076.397439:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1788572076.397542:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcc55 lrc: 0/0,0 mode: --/CR res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb14b expref: 52 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.397568:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcc5c lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb14b expref: 51 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.397578:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x44:0x0].0x0 (ffff8e590b3b4700) 00010000:00010000:0.0:1788572076.397582:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788572076.397586:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2c00, rc 0) 00000100:00100000:0.0:1788572076.397673:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+51:156967:x1875444569444864:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 479us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.397681:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 840 00000100:00100000:2.0:1788572076.402687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1788572076.404000:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572076.404009:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.404018:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3200 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572076.404025:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572076.404052:0:6505:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.404088:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 2/0,0 mode: --/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.404095:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572076.404249:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 1/0,0 mode: --/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.404259:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3200/0x265cfe11109bcc2b lrc: 0/0,0 mode: --/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bcc32 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.404285:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572076.404287:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572076.404289:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572076.404320:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572076.404336:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584182784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572076.404378:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572076.404593:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584182784 00000100:00100000:2.0:1788572076.404600:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584182784 00010000:00010000:2.0:1788572076.404625:0:152004:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcc32 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x265cfe11109bcc2b expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.404654:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12880 00000100:00100000:2.0:1788572076.404661:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3643:x1875444584182784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572076.404671:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1788572076.427404:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837381 is committed 00000100:00100000:0.0:1788572076.428327:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584182784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572076.428730:0:188049:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bcc6a lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.428740:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bcc6a lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572076.428820:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002728:0x44:0x0]: returning size 4096 00000004:00200000:2.0:1788572076.428828:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788572076.428890:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bcc63 lrc: 0/0,0 mode: --/CR res: [0x240002728:0x44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb152 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.428910:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bcc6a lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x44:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb152 expref: 7 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.428919:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x44:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572076.428922:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572076.428925:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60c800, rc 0) 00000100:00100000:2.0:1788572076.429002:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:156967:x1875444569444992:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 26058us (26332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.429010:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 841 00000100:00100000:0.0:1788572076.450117:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569445248 00000100:00100000:0.0:1788572076.450151:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569445248 00000100:00100000:0.0:1788572076.450239:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 842 00000100:00100000:0.0:1788572076.450253:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+51:156967:x1875444569445248:12345-192.168.202.57@tcp:36:rmdir.0 00010000:00010000:0.0:1788572076.450333:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572076.450371:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcc4e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb144 expref: 51 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450398:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2039:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:0.0:1788572076.450405:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572076.450436:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450453:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450464:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450476:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450541:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450548:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450666:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450675:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450682:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450702:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450712:0:188833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcc5c lrc: 2/0,0 mode: PR/PR res: [0x200025d90:0x44:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb14b expref: 50 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450721:0:188833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 4/0,1 mode: --/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450764:0:188833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcc5c lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x44:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb14b expref: 50 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.450781:0:188833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcc5c lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x44:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb14b expref: 50 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.450799:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188833:1875444584182912:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572076.450925:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f073c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.454686:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572076.454813:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188833:1875444584182912:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572076.454848:0:188833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.455539:0:188833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.455547:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.455610:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 3/0,1 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.455619:0:188833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 3/0,1 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.455630:0:188833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 3/0,1 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.455658:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584183040:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1788572076.455710:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.455742:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f073900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.470294:0:188833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837381 gen 2 00000004:00080000:0.0:1788572076.470302:0:188833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837380 committed transno 21474837381 00000004:00080000:0.0:1788572076.470325:0:188833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837381 committed transno 21474837381 00000100:00100000:0.0:1788572076.470342:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584183040:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788572076.470365:0:188833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 4/0,1 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.470378:0:188833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 4/0,1 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.470856:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569445504 00000100:00100000:2.0:1788572076.470866:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569445504 00010000:00010000:2.0:1788572076.470910:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bcc6a lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb152 expref: 7 pid: 188049 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.470955:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12882 00000100:00100000:2.0:1788572076.470965:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2398:x1875444569445504:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572076.470984:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572076.470993:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bcc6a lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x44:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb152 expref: 7 pid: 188049 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.471006:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bcc6a lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x44:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb152 expref: 7 pid: 188049 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.471042:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60c800/0x265cfe11109bcc6a lrc: 0/0,0 mode: --/PR res: [0x240002728:0x44:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb152 expref: 7 pid: 188049 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.471062:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x44:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572076.471068:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bcc94 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcc8d expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.471080:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bcc94 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bcc8d expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.471090:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bcc94 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bcc8d expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.471261:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bcc94 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcc8d expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.471280:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6504:1875444584183296:0@lo:105: 00000100:00100000:2.0:1788572076.471340:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572076.471391:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.471461:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584183296 00000100:00100000:0.0:1788572076.471466:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584183296 00000100:00100000:0.0:1788572076.471560:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5384 00000100:00100000:0.0:1788572076.471569:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6504:x1875444584183296:12345-0@lo:105: 00010000:00010000:0.0:1788572076.471581:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 5/0,1 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.471591:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 5/0,1 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.471600:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 5/0,1 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.471613:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.471619:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.471628:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.471652:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a370b3e00) 00000100:00100000:0.0:1788572076.471701:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6504:x1875444584183296:12345-0@lo:105: Request processed in 133us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.471707:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5384 00000100:00100000:0.0:1788572076.471748:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6504:1875444584183296:0@lo:105: 00010000:00010000:0.0:1788572076.471765:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572076.471812:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569445504:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 847us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.471819:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12882 00010000:00010000:2.0:1788572076.472079:0:188833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.472094:0:188833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.478160:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572076.480410:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584183424:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1788572076.480560:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572076.480622:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572076.483623:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584183424:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1788572076.485975:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].451, 944 off675304 00000040:00080000:0.0:1788572076.486955:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].483, 1024 off778656 00000004:00080000:0.0:1788572076.486970:0:188833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a0f073900 with version 904 00000004:00080000:3.0:1788572076.487698:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 904 rpc_version 904 00000020:00100000:3.0:1788572076.487752:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572076.487767:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cb9f80 x1875444584183680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1984/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572076.487802:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584183680:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572076.487900:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572076.487951:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.488044:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584183680 00000100:00100000:2.0:1788572076.488056:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584183680 00000100:00100000:2.0:1788572076.488134:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788572076.488153:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584183680:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572076.488683:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584183680:12345-0@lo:1000:osp_up1-0.0 Request processed in 530us (779us total) trans 21474837382 rc 0/0 00000100:00100000:2.0:1788572076.488693:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788572076.489029:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584183680:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1788572076.489172:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2039:0x0]: returning size 4096 00010000:00010000:0.0:1788572076.489204:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489214:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489224:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489230:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.489235:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489243:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489263:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x44:0x0].0x0 (ffff8e590b3b4700) 00010000:00010000:0.0:1788572076.489267:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572076.489273:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489280:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcc86 lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489299:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489307:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489313:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489347:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572076.489359:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x44:0x0] 00010000:00010000:0.0:1788572076.489369:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489376:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489382:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489387:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.489390:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489396:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489404:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2039:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:0.0:1788572076.489406:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572076.489409:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489415:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcc7f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489431:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489437:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489442:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489452:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.489454:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489459:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489467:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.489469:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.489472:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489503:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc71 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572076.489516:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb01583e reply state 00000000621e5672 transno 330712481924 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489531:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.489538:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572076.489541:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.489544:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572076.489731:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572076.489740:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.489748:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3e00 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:3.0:1788572076.489754:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572076.489763:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.489802:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 2/0,0 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.489810:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572076.489839:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 1/0,0 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.489847:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a370b3e00/0x265cfe11109bcc8d lrc: 0/0,0 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcc94 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.489870:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572076.489872:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572076.489874:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572076.489892:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584183808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572076.489980:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+51:156967:x1875444569445248:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 39727us (40498us total) trans 330712481924 rc 0/0 00000100:00100000:0.0:1788572076.489988:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 842 00000100:00100000:3.0:1788572076.492613:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572076.496229:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584183808 00000100:00100000:2.0:1788572076.496254:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584183808 00000100:00100000:2.0:1788572076.496364:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4630 00000100:00100000:2.0:1788572076.496378:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3641:x1875444584183808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572076.496402:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572076.496438:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60cc00/0x265cfe11109bcc94 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bcc8d expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.496468:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x44:0x0].0x0 (ffff8e5a16272d00) 00010000:00010000:2.0:1788572076.496510:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572076.496611:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1875444584183808:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (4010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.496619:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4630 00000100:00100000:0.0:1788572076.496939:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584183808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572076.513543:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569445632 00000100:00100000:0.0:1788572076.513559:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569445632 00000100:00100000:0.0:1788572076.513638:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 843 00000100:00100000:0.0:1788572076.513650:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+51:156969:x1875444569445632:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572076.513681:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.513709:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc9b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb159 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513793:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513813:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513826:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513835:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513841:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513845:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513891:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513896:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513900:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513905:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.513909:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513915:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513924:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.513927:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.513931:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513935:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcca2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513947:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513952:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513955:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513958:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.513959:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513963:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513970:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572076.513972:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.513974:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.513977:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcca9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.514001:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc9b lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb159 expref: 52 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.514009:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.514010:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.514012:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcc9b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb159 expref: 52 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.514019:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2e00, rc 0) 00000100:00100000:0.0:1788572076.514106:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+51:156969:x1875444569445632:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 459us (743us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572076.514114:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 843 00000100:00100000:0.0:1788572076.518668:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572076.518918:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569445760 00000100:00100000:3.0:1788572076.518932:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569445760 00000100:00100000:3.0:1788572076.519013:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 844 00000100:00100000:3.0:1788572076.519026:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+51:156969:x1875444569445760:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572076.519066:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572076.519095:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bccb0 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb160 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519191:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519211:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519342:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519357:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519370:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519376:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519428:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519437:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519444:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519451:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60dc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.519456:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519465:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519522:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572076.519526:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.519532:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519540:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bccb7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519557:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519565:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519571:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519576:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60da00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.519579:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519795:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519808:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572076.519811:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.519815:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519821:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccbe lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519855:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bccb0 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb160 expref: 52 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519867:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572076.519870:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.519874:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bccb0 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb160 expref: 52 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.519890:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60ce00, rc 0) 00000100:00100000:0.0:1788572076.526765:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569445888 00000100:00100000:0.0:1788572076.526778:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569445888 00000100:00100000:0.0:1788572076.526855:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 845 00000100:00100000:0.0:1788572076.526868:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+51:156969:x1875444569445888:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572076.526897:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.526926:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bccc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb167 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.527017:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcccc lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.527047:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcccc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.527062:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcccc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572076.527119:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:0.0:1788572076.527124:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572076.527332:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcccc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.527367:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bccc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb167 expref: 53 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.527391:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcccc lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb167 expref: 52 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.527402:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.527406:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572076.527411:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3c00, rc 0) 00000100:00100000:0.0:1788572076.527574:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+52:156969:x1875444569445888:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 708us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.527582:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 845 00000100:00100000:0.0:1788572076.535047:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572076.535174:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569446144 00000100:00100000:2.0:1788572076.535189:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569446144 00000100:00100000:2.0:1788572076.535269:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 846 00000100:00100000:2.0:1788572076.535282:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+52:156969:x1875444569446144:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1788572076.535360:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572076.535395:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcccc lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb167 expref: 52 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.535421:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572076.535427:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572076.535567:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bccd3 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.535585:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bccd3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.535604:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bccd3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.535616:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.535628:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.535634:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572076.536681:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].452, 2152 off677456 00000040:00080000:2.0:1788572076.536780:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].484, 2352 off781008 00000004:00080000:2.0:1788572076.536787:0:188833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a36b4d600 with version 905 00000004:00080000:0.0:1788572076.537169:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 905 rpc_version 905 00000020:00100000:0.0:1788572076.537219:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572076.537233:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590a2d0e00 x1875444584184064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572076.537264:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584184064:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572076.537357:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.537406:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.539430:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584184064 00000100:00100000:2.0:1788572076.539454:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584184064 00000100:00100000:2.0:1788572076.540545:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788572076.540562:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584184064:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572076.541328:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584184064:12345-0@lo:1000:osp_up1-0.0 Request processed in 766us (3967us total) trans 21474837383 rc 0/0 00000100:00100000:2.0:1788572076.541339:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788572076.541527:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584184064:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572076.556393:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584184192 00000100:00100000:3.0:1788572076.556419:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584184192 00000100:00100000:3.0:1788572076.556530:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788572076.556545:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:188833:x1875444584184192:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1788572076.556581:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572076.556628:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60ce00/0x265cfe11109bccf6 lrc: 2/0,0 mode: --/PW res: [0x240002728:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bccef expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.556671:0:189111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60ce00/0x265cfe11109bccf6 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bccef expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.556690:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60ce00/0x265cfe11109bccf6 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bccef expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.556700:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x45:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:3.0:1788572076.556703:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.556708:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60ce00, rc 0) 00000100:00100000:3.0:1788572076.557090:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:188833:x1875444584184192:12345-0@lo:101:mdt00_003.0 Request processed in 544us (14889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572076.557099:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788572076.584254:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572076.584471:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569446272 00000100:00100000:3.0:1788572076.584534:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569446272 00000100:00100000:3.0:1788572076.584622:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 847 00000100:00100000:3.0:1788572076.584637:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+53:156972:x1875444569446272:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:3.0:1788572076.584670:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572076.584699:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccfd lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb16e expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.584791:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.584810:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.584825:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.584838:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 24 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.584847:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.584854:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.584953:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcd12 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.584963:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcd12 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.584970:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcd12 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572076.585095:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x203a:0x0]: returning size 4096 00000004:00200000:3.0:1788572076.585101:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1788572076.585128:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcd12 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585334:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585342:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585350:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585357:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60dc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.585362:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585371:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585386:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572076.585389:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.585395:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585401:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd04 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585417:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585423:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585429:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585435:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.585438:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585445:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585453:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572076.585456:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.585459:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585465:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd0b lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585560:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bccfd lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb16e expref: 55 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585578:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcd12 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb16e expref: 54 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.585723:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203a:0x0].0x0 (ffff8e5a16354b00) 00010000:00010000:3.0:1788572076.585726:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572076.585729:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60cc00, rc 0) 00000100:00100000:3.0:1788572076.585845:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+54:156972:x1875444569446272:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 1211us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572076.585853:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 847 00000100:00100000:0.0:1788572076.603658:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569446400 00000100:00100000:0.0:1788572076.603673:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569446400 00000100:00100000:2.0:1788572076.622505:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.623492:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569446528 00000100:00100000:0.0:1788572076.623514:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569446528 00000100:00100000:0.0:1788572076.623622:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 849 00000100:00100000:0.0:1788572076.623637:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:156972:x1875444569446528:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572076.623665:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.623693:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcd27 lrc: 2/0,0 mode: --/CR res: [0x240002728:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb17c expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.623772:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 3/1,0 mode: --/PR res: [0x240002728:0x45:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.623791:0:188050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60ce00/0x265cfe11109bccf6 lrc: 2/0,0 mode: PW/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bccef expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.623803:0:188050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 4/1,0 mode: --/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.623851:0:188050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60ce00/0x265cfe11109bccf6 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bccef expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.623877:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:188050:1875444584184320:0@lo:104: 00000100:00100000:0.0:1788572076.623955:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.624012:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.624079:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584184320 00000100:00100000:2.0:1788572076.624085:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584184320 00000100:00100000:2.0:1788572076.624126:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5385 00000100:00100000:2.0:1788572076.624133:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:188050:x1875444584184320:12345-0@lo:104: 00010000:00010000:2.0:1788572076.624149:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3800/0x265cfe11109bccef lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bccf6 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.624230:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572076.624237:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:188050:x1875444584184320:12345-0@lo:104: Request processed in 105us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.624245:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5385 00010000:00010000:2.0:1788572076.624272:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572076.624281:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3800/0x265cfe11109bccef lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bccf6 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.624290:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3800 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572076.624297:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3800/0x265cfe11109bccef lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x265cfe11109bccf6 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572076.624307:0:82817:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3800/0x265cfe11109bccef lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x265cfe11109bccf6 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.624344:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3800/0x265cfe11109bccef lrc: 2/0,0 mode: --/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bccf6 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.624352:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572076.624376:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3800/0x265cfe11109bccef lrc: 1/0,0 mode: --/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bccf6 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.624383:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd3800/0x265cfe11109bccef lrc: 0/0,0 mode: --/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bccf6 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.624407:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572076.624409:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572076.624410:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572076.624425:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584184448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572076.624461:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572076.624531:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584184448 00000100:00100000:2.0:1788572076.624535:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584184448 00010000:00010000:2.0:1788572076.624555:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60ce00/0x265cfe11109bccf6 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x265cfe11109bccef expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.624581:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12883 00000100:00100000:2.0:1788572076.624602:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3642:x1875444584184448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572076.624613:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788572076.625357:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:188050:1875444584184320:0@lo:104: 00010000:00010000:3.0:1788572076.625386:0:188050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 3/1,0 mode: --/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572076.629163:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837383 is committed 00010000:00010000:2.0:1788572076.629392:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590a60ce00/0x265cfe11109bccf6 lrc: 0/0,0 mode: --/PW res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bccef expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.629418:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x45:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:2.0:1788572076.629424:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 3/1,0 mode: --/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.629435:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.629443:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.629518:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572076.629643:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584184448:12345-0@lo:103:ldlm_bl.0 Request processed in 5040us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.629654:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12883 00010000:00010000:3.0:1788572076.629749:0:188050:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.629770:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572076.629849:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002728:0x45:0x0]: returning size 4096 00000004:00200000:3.0:1788572076.629855:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1788572076.629912:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2e00/0x265cfe11109bcd27 lrc: 0/0,0 mode: --/CR res: [0x240002728:0x45:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb17c expref: 8 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.629933:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb17c expref: 7 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.629941:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x45:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:3.0:1788572076.629944:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788572076.629947:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3600, rc 0) 00000100:00100000:3.0:1788572076.630014:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:156972:x1875444569446528:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 6380us (7537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572076.630021:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 849 00000100:00100000:2.0:1788572076.635824:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.636118:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569446784 00000100:00100000:0.0:1788572076.636134:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569446784 00000100:00100000:0.0:1788572076.636215:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 850 00000100:00100000:0.0:1788572076.636237:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+55:156972:x1875444569446784:12345-192.168.202.57@tcp:36:rmdir.0 00010000:00010000:0.0:1788572076.636359:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572076.636396:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60cc00/0x265cfe11109bcd12 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb16e expref: 55 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636423:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203a:0x0].0x0 (ffff8e5a16354b00) 00010000:00010000:0.0:1788572076.636431:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572076.636465:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636526:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636539:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636552:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 24 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636566:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636579:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636696:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636705:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636713:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636732:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636742:0:188048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bcd20 lrc: 2/0,0 mode: PR/PR res: [0x200025d90:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb175 expref: 54 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636751:0:188048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 4/0,1 mode: --/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636791:0:188048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bcd20 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb175 expref: 54 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.636808:0:188048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bcd20 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb175 expref: 54 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.636825:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188048:1875444584184576:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572076.636950:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.643036:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188048:1875444584184576:192.168.202.57@tcp:104: 00010000:00010000:0.0:1788572076.643076:0:188048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.646464:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.646770:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569446912 00000100:00100000:0.0:1788572076.646785:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569446912 00010000:00010000:0.0:1788572076.646844:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bcd20 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb175 expref: 55 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.646901:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12884 00000100:00100000:0.0:1788572076.646914:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+55:2397:x1875444569446912:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572076.646933:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572076.646942:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bcd20 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb175 expref: 55 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.646958:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bcd20 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb175 expref: 55 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.646985:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2a00/0x265cfe11109bcd20 lrc: 0/0,0 mode: --/PR res: [0x200025d90:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb175 expref: 55 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.647006:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x45:0x0].0x0 (ffff8e5a16354600) 00010000:00010000:0.0:1788572076.647014:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.647037:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.647047:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 4/0,1 mode: EX/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.647079:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572076.647155:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+54:2397:x1875444569446912:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 243us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.647163:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12884 00000100:00100000:0.0:1788572076.648332:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584184704 00000100:00100000:0.0:1788572076.648344:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584184704 00000100:00100000:0.0:1788572076.648396:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788572076.648407:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:188048:x1875444584184704:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788572076.648429:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.648451:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bcd51 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.648511:0:189111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb17c expref: 6 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.648523:0:189111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 4/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bcd51 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.648561:0:189111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb17c expref: 6 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.648577:0:189111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb17c expref: 6 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.648602:0:189111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:189111:1875444584184832:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572076.648693:0:189111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.655672:0:189111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:189111:1875444584184832:192.168.202.57@tcp:104: 00010000:00010000:0.0:1788572076.655722:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcd51 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.655739:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x45:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:0.0:1788572076.655743:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572076.655748:0:189111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcd51 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.655771:0:189111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 3/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcd51 expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.655780:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2c00, rc 0) 00000100:00100000:0.0:1788572076.655854:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188048:x1875444584184704:12345-0@lo:101:mdt00_000.0 Request processed in 7448us (8413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.655865:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788572076.656345:0:188048:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837383 gen 2 00000004:00080000:2.0:1788572076.656354:0:188048:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837382 committed transno 21474837383 00000004:00080000:2.0:1788572076.656380:0:188048:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837383 committed transno 21474837383 00000100:00100000:2.0:1788572076.656398:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d87ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584184704:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572076.656421:0:188048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.656435:0:188048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.669380:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.669631:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569447040 00000100:00100000:0.0:1788572076.669646:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569447040 00010000:00010000:0.0:1788572076.669703:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb17c expref: 7 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.669757:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12885 00000100:00100000:0.0:1788572076.669769:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2398:x1875444569447040:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572076.669789:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572076.669796:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb17c expref: 7 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.669819:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb17c expref: 7 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.669848:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd2e lrc: 0/0,0 mode: --/PR res: [0x240002728:0x45:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb17c expref: 7 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.669869:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x45:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:0.0:1788572076.669877:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcd51 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.669890:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bcd51 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.669900:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bcd51 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.669944:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcd51 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.669963:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6503:1875444584184960:0@lo:105: 00000100:00100000:0.0:1788572076.670037:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.670092:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788572076.670608:0:188048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.670620:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572076.671461:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584185088:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1788572076.671579:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572076.671634:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.671918:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6503:1875444584184960:0@lo:105: 00010000:00010000:0.0:1788572076.671940:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572076.672010:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569447040:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2240us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.672035:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12885 00000100:00100000:3.0:1788572076.700140:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584185088:0@lo:403:mdt00_000.0 00000040:00080000:3.0:1788572076.706250:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].453, 656 off678112 00000040:00080000:3.0:1788572076.706549:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].485, 736 off781744 00000004:00080000:3.0:1788572076.706558:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a1fdbcb40 with version 906 00000004:00080000:0.0:1788572076.706858:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 906 rpc_version 906 00000020:00100000:0.0:1788572076.706908:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572076.706921:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462ce00 x1875444584185344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572076.706952:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584185344:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572076.707057:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.707114:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.708743:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584185344:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1788572076.712048:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x203a:0x0]: returning size 4096 00010000:00010000:3.0:1788572076.712097:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712165:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712175:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712181:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.712187:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712195:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712216:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x45:0x0].0x0 (ffff8e5a16354600) 00010000:00010000:3.0:1788572076.712220:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572076.712237:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712249:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bcd4a lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712274:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712284:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712291:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712324:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788572076.712336:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x45:0x0] 00010000:00010000:3.0:1788572076.712347:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712354:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712362:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712368:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.712371:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712377:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712391:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203a:0x0].0x0 (ffff8e5a16354b00) 00010000:00010000:3.0:1788572076.712393:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572076.712397:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712403:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcd43 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712423:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712429:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712435:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712440:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.712443:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712449:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712457:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572076.712459:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.712463:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712469:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcd35 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.712700:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572076.712709:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.712721:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2800 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572076.712726:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572076.712734:0:10395:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.712797:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.712804:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572076.712837:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 1/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572076.712838:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b22c64e4 reply state 000000005e48e5d5 transno 330712481926 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.712844:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a1fcd2800/0x265cfe11109bcd51 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcd58 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712854:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.712864:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572076.712865:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572076.712866:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572076.712867:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572076.712869:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572076.712870:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572076.712933:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584185472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572076.712983:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+55:156972:x1875444569446784:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 76747us (77171us total) trans 330712481926 rc 0/0 00000100:00100000:3.0:1788572076.712993:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 850 00000100:00100000:0.0:1788572076.713006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572076.713073:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584185472 00000100:00100000:3.0:1788572076.713082:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584185472 00000100:00100000:3.0:1788572076.713157:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4631 00000100:00100000:3.0:1788572076.713167:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3643:x1875444584185472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572076.713182:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572076.713203:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd58 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bcd51 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.713215:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x45:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:3.0:1788572076.713654:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572076.713708:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3643:x1875444584185472:12345-0@lo:103:ldlm_bl.0 Request processed in 543us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572076.713716:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4631 00000100:00100000:0.0:1788572076.713849:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584185472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572076.756808:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572076.760359:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569447168 00000100:00100000:3.0:1788572076.760384:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569447168 00000100:00100000:3.0:1788572076.760713:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 851 00000100:00100000:3.0:1788572076.760727:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+55:156978:x1875444569447168:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572076.760777:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572076.760814:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd5f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb183 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.760905:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.760923:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.760938:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.760951:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.760959:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.760967:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.761036:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.761045:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.761053:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.761060:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.761065:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.761073:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.761087:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572076.761090:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.761097:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.761103:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcd66 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763316:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763337:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763346:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763351:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60dc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.763357:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763365:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763391:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572076.763395:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.763400:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763407:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd6d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763466:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd5f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb183 expref: 56 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763654:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572076.763658:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.763663:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd5f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb183 expref: 56 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.763675:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60da00, rc 0) 00000100:00100000:3.0:1788572076.763910:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+55:156978:x1875444569447168:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3184us (7116us total) trans 0 rc 301/301 00000100:00100000:3.0:1788572076.763923:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 851 00000100:00100000:2.0:1788572076.776944:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.786861:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569447424 00000100:00100000:0.0:1788572076.786876:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569447424 00000100:00100000:0.0:1788572076.786964:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 853 00000100:00100000:0.0:1788572076.786978:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+55:156978:x1875444569447424:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572076.787007:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.787047:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb191 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.787322:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd90 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.787342:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd90 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.787357:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd90 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572076.787418:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:0.0:1788572076.787423:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572076.787453:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd90 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.787634:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3600/0x265cfe11109bcd89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb191 expref: 57 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.787659:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd90 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb191 expref: 56 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.787669:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.787673:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572076.787678:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2c00, rc 0) 00000100:00100000:0.0:1788572076.788387:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+56:156978:x1875444569447424:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1404us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.788401:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 853 00000100:00100000:0.0:1788572076.813737:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572076.813950:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569447680 00000100:00100000:3.0:1788572076.813966:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569447680 00000100:00100000:3.0:1788572076.814117:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 854 00000100:00100000:3.0:1788572076.814142:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+56:156978:x1875444569447680:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:3.0:1788572076.814248:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572076.814283:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bcd90 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb191 expref: 56 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.814316:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572076.814324:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572076.814413:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.814432:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.814445:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.814458:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.814475:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.814533:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572076.815634:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].454, 2152 off680264 00000040:00080000:3.0:1788572076.815728:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].486, 2352 off784096 00000004:00080000:3.0:1788572076.815735:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a1fdbc180 with version 907 00000004:00080000:0.0:1788572076.815932:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 907 rpc_version 907 00000020:00100000:0.0:1788572076.815982:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572076.815996:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462d180 x1875444584185728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572076.816039:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584185728:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572076.816168:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.816221:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.816900:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584185728 00000100:00100000:2.0:1788572076.816911:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584185728 00000100:00100000:2.0:1788572076.816984:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788572076.816995:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a71c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584185728:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572076.820113:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a71c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584185728:12345-0@lo:1000:osp_up1-0.0 Request processed in 3096us (3922us total) trans 21474837385 rc 0/0 00000100:00100000:2.0:1788572076.820144:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788572076.821087:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584185728:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1788572076.821831:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.821855:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.821869:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.821899:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 3/0,1 mode: --/PW res: [0x200025d90:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.821907:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.821914:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.821961:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 3/0,1 mode: --/PW res: [0x240002728:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.821969:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 3/0,1 mode: --/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.821980:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 3/0,1 mode: --/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572076.822006:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584185856:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1788572076.822094:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572076.822690:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572076.823729:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584185856:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788572076.824350:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.824368:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572076.824470:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093b645a8 reply state 00000000bcb7566e transno 330712481927 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.824839:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.824849:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x46:0x0].0x0 (ffff8e590430c100) 00010000:00010000:3.0:1788572076.824852:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572076.824857:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572076.824866:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.824875:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572076.824888:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x46:0x0] 00000004:00010000:0.0:1788572076.829653:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093b645a8 reply state 00000000bcb7566e transno 330712481927 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.829692:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.829703:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203b:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:0.0:1788572076.829706:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.829711:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1788572076.829720:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x203b:0x0]: returning size 4096 00010000:00010000:0.0:1788572076.829734:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.829741:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.830045:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.830052:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60da00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572076.830058:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.830068:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.830082:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:0.0:1788572076.830085:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572076.830090:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.830103:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcd97 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572076.830352:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093b645a8 reply state 00000000bcb7566e transno 330712481927 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.830364:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.830370:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572076.830373:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572076.830376:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1788572076.830915:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+57:156978:x1875444569447680:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 16769us (17186us total) trans 330712481927 rc 0/0 00000100:00100000:0.0:1788572076.830927:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 854 00000100:00100000:2.0:1788572076.859177:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572076.859890:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569447808 00000100:00100000:3.0:1788572076.859905:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569447808 00000100:00100000:3.0:1788572076.860832:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 855 00000100:00100000:3.0:1788572076.860852:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+57:156982:x1875444569447808:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:3.0:1788572076.860884:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572076.860911:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bcdc1 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb198 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.860995:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861011:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861038:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861052:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 26 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861060:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861066:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861171:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcdd6 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861181:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcdd6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861190:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcdd6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572076.861359:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x203b:0x0]: returning size 4096 00000004:00200000:3.0:1788572076.861365:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1788572076.861395:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcdd6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861410:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861418:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861426:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861437:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60da00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.861442:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861450:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861465:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572076.861469:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.861475:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861510:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60da00/0x265cfe11109bcdc8 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861528:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861534:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861540:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861545:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.861549:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861556:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861569:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572076.861572:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.861575:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861581:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcdcf lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.861620:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ce00/0x265cfe11109bcdc1 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb198 expref: 59 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.862884:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcdd6 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb198 expref: 58 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.862903:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203b:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:3.0:1788572076.862906:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572076.862910:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00031800, rc 0) 00000100:00100000:3.0:1788572076.863033:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+58:156982:x1875444569447808:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 2188us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572076.863043:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 855 00000100:00100000:2.0:1788572076.876081:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569447936 00000100:00100000:2.0:1788572076.876097:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569447936 00000100:00100000:2.0:1788572076.876239:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 856 00000100:00100000:2.0:1788572076.876254:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+58:156982:x1875444569447936:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:2.0:1788572076.876287:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572076.876316:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcddd lrc: 2/0,0 mode: --/CR res: [0x200025d90:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb19f expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.876400:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 3/1,0 mode: --/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.876420:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.876437:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572076.876551:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200025d90:0x46:0x0]: returning size 4096 00000004:00200000:2.0:1788572076.876558:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788572076.876615:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcddd lrc: 0/0,0 mode: --/CR res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb19f expref: 60 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.877325:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb19f expref: 59 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.877341:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x46:0x0].0x0 (ffff8e590430c100) 00010000:00010000:2.0:1788572076.877347:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572076.877354:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1200, rc 0) 00000100:00100000:2.0:1788572076.877461:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+59:156982:x1875444569447936:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 1210us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.877470:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 856 00000100:00100000:0.0:1788572076.885070:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569448064 00000100:00100000:0.0:1788572076.885085:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569448064 00000100:00100000:0.0:1788572076.885183:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 857 00000100:00100000:0.0:1788572076.885197:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:156982:x1875444569448064:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:0.0:1788572076.885471:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572076.885764:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcdeb lrc: 2/0,0 mode: --/CR res: [0x240002728:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1a6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.885850:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.885869:0:188050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcdba lrc: 2/0,0 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcdb3 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.885887:0:188050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 4/1,0 mode: --/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.885934:0:188050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcdba lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bcdb3 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.885954:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:188050:1875444584185984:0@lo:104: 00000100:00100000:0.0:1788572076.886045:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.886138:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.887441:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584185984 00000100:00100000:2.0:1788572076.887458:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584185984 00000100:00100000:2.0:1788572076.887734:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5387 00000100:00100000:2.0:1788572076.887748:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188050:x1875444584185984:12345-0@lo:104: 00010000:00010000:2.0:1788572076.887771:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.889798:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572076.889822:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188050:x1875444584185984:12345-0@lo:104: Request processed in 2071us (3768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.889835:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5387 00010000:00010000:3.0:1788572076.890048:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572076.890062:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.890074:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60cc00 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:3.0:1788572076.890082:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572076.890097:0:6505:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.890155:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 2/0,0 mode: --/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.890163:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572076.890200:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 1/0,0 mode: --/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.890209:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e590a60cc00/0x265cfe11109bcdb3 lrc: 0/0,0 mode: --/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bcdba expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.890238:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572076.890240:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572076.890242:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572076.890646:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584186112 00000100:00100000:3.0:1788572076.890656:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584186112 00010000:00010000:3.0:1788572076.890698:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcdba lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x265cfe11109bcdb3 expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572076.890740:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12886 00000100:00100000:3.0:1788572076.890751:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3644:x1875444584186112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572076.890769:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1788572076.894151:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837385 is committed 00000100:00100000:0.0:1788572076.894442:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:188050:1875444584185984:0@lo:104: 00010000:00010000:0.0:1788572076.894503:0:188050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.896775:0:188050:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.896784:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572076.896874:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002728:0x46:0x0]: returning size 4096 00000004:00200000:0.0:1788572076.896881:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1788572076.896942:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3600/0x265cfe11109bcdeb lrc: 0/0,0 mode: --/CR res: [0x240002728:0x46:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1a6 expref: 8 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.896965:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1a6 expref: 7 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.896974:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x46:0x0].0x0 (ffff8e5a16354a00) 00010000:00010000:0.0:1788572076.896978:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788572076.896980:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3c00, rc 0) 00000100:00100000:0.0:1788572076.897058:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:156982:x1875444569448064:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 11865us (12106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.897065:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 857 00000100:00100000:3.0:1788572076.897166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584186112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572076.900084:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.900198:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569448320 00000100:00100000:0.0:1788572076.900222:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569448320 00000100:00100000:0.0:1788572076.900304:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 858 00000100:00100000:0.0:1788572076.900316:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+59:156982:x1875444569448320:12345-192.168.202.57@tcp:36:rmdir.0 00010000:00010000:0.0:1788572076.900396:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572076.900430:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcdd6 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb198 expref: 59 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900455:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203b:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:0.0:1788572076.900461:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572076.900531:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900549:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900562:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900586:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 26 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900601:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900613:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900840:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900849:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900856:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900880:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900890:0:188048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 2/0,0 mode: PR/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb19f expref: 58 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900899:0:188048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 4/0,1 mode: --/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900941:0:188048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb19f expref: 58 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.900958:0:188048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb19f expref: 58 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.900976:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188048:1875444584186240:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572076.901251:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.905374:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188048:1875444584186240:192.168.202.57@tcp:104: 00010000:00010000:0.0:1788572076.905420:0:188048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572076.909155:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.909298:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569448448 00000100:00100000:0.0:1788572076.909312:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569448448 00010000:00010000:0.0:1788572076.909370:0:152004:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb19f expref: 59 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.909428:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12887 00000100:00100000:0.0:1788572076.909441:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+59:2398:x1875444569448448:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572076.909461:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572076.909470:0:152004:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb19f expref: 59 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.913338:0:152004:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb19f expref: 59 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.913386:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcde4 lrc: 0/0,0 mode: --/PR res: [0x200025d90:0x46:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb19f expref: 59 pid: 188833 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.913417:0:152004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x46:0x0].0x0 (ffff8e590430c100) 00010000:00010000:0.0:1788572076.913422:0:152004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.913435:0:152004:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.913446:0:152004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 4/0,1 mode: EX/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.914120:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572076.914238:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+58:2398:x1875444569448448:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4794us (5092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.914252:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12887 00010000:00010000:0.0:1788572076.915080:0:188048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.915095:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.915168:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.915177:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.915192:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.915228:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584186368:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788572076.915302:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.915347:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.915418:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584186368 00000100:00100000:2.0:1788572076.915430:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584186368 00000100:00100000:2.0:1788572076.915514:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788572076.915525:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:188048:x1875444584186368:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572076.915546:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572076.915567:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 2/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bce15 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.915619:0:188053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1a6 expref: 6 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.915639:0:188053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 4/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bce15 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.915670:0:188053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1a6 expref: 6 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.915685:0:188053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1a6 expref: 6 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572076.915697:0:188053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99f100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:188053:1875444584186496:192.168.202.57@tcp:104: 00000100:00100000:2.0:1788572076.915936:0:188053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.919601:0:188053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99f100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:188053:1875444584186496:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572076.919820:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 3/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bce15 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.919838:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x46:0x0].0x0 (ffff8e5a16354a00) 00010000:00010000:2.0:1788572076.919841:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572076.919846:0:188053:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 3/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bce15 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.919857:0:188053:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 3/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bce15 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.919871:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0e00, rc 0) 00000100:00100000:2.0:1788572076.919952:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188048:x1875444584186368:12345-0@lo:101:mdt00_000.0 Request processed in 4429us (4649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.919962:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788572076.920075:0:188048:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837385 gen 2 00000004:00080000:0.0:1788572076.920085:0:188048:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837384 committed transno 21474837385 00000004:00080000:0.0:1788572076.920109:0:188048:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837385 committed transno 21474837385 00000100:00100000:0.0:1788572076.920124:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584186368:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788572076.920149:0:188048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.920162:0:188048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572076.926525:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572076.926776:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569448576 00000100:00100000:0.0:1788572076.926792:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569448576 00010000:00010000:0.0:1788572076.926848:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1a6 expref: 7 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.926900:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12888 00000100:00100000:0.0:1788572076.926912:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2397:x1875444569448576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572076.926932:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572076.926939:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1a6 expref: 7 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.926955:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1a6 expref: 7 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.926982:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a370b3c00/0x265cfe11109bcdf2 lrc: 0/0,0 mode: --/PR res: [0x240002728:0x46:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1a6 expref: 7 pid: 188050 timeout: 8929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.927005:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x46:0x0].0x0 (ffff8e5a16354a00) 00010000:00010000:0.0:1788572076.927028:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 2/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bce15 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.927043:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bce15 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.927054:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bce15 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.927102:0:8447:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bce15 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.927127:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8447:1875444584186624:0@lo:105: 00000100:00100000:0.0:1788572076.927193:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.927255:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.928087:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584186624 00000100:00100000:2.0:1788572076.928099:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584186624 00000100:00100000:2.0:1788572076.928161:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5388 00000100:00100000:2.0:1788572076.928171:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8447:x1875444584186624:12345-0@lo:105: 00010000:00010000:2.0:1788572076.928187:0:6501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.928201:0:6501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.928220:0:6501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.928230:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.928238:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.928248:0:6501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572076.928280:0:6501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5905bb4800) 00000100:00100000:2.0:1788572076.928364:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8447:x1875444584186624:12345-0@lo:105: Request processed in 194us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.928372:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5388 00000100:00100000:2.0:1788572076.928426:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8447:1875444584186624:0@lo:105: 00010000:00010000:2.0:1788572076.928450:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572076.928549:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569448576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1637us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572076.928559:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12888 00010000:00010000:0.0:1788572076.929701:0:188048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.929721:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572076.930569:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584186752:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1788572076.930662:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.930706:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572076.931872:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584186752 00000100:00100000:0.0:1788572076.931888:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584186752 00000100:00100000:0.0:1788572076.931955:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788572076.931968:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188048:x1875444584186752:12345-0@lo:403:mdt00_000.0 00000100:00100000:2.0:1788572076.948129:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584186752:0@lo:403:mdt00_000.0 00000040:00080000:2.0:1788572076.951700:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].455, 656 off680920 00000040:00080000:2.0:1788572076.951899:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].487, 736 off784832 00000004:00080000:2.0:1788572076.951906:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590b186cc0 with version 908 00000004:00080000:0.0:1788572076.953330:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 908 rpc_version 908 00000020:00100000:0.0:1788572076.953408:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572076.953425:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462d180 x1875444584187008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572076.953457:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584187008:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572076.953595:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.953653:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572076.954917:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584187008 00000100:00100000:2.0:1788572076.954933:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584187008 00000100:00100000:2.0:1788572076.955026:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788572076.955040:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584187008:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572076.957798:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584187008:12345-0@lo:1000:osp_up1-0.0 Request processed in 2753us (4193us total) trans 21474837386 rc 0/0 00000100:00100000:2.0:1788572076.957812:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788572076.958070:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584187008:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1788572076.958986:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x203b:0x0]: returning size 4096 00010000:00010000:3.0:1788572076.959315:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959333:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959342:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959350:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.959355:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959365:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959388:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x46:0x0].0x0 (ffff8e590430c100) 00010000:00010000:3.0:1788572076.959391:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572076.959399:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959406:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2c00/0x265cfe11109bce0e lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959432:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959441:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959454:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959549:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788572076.959566:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x46:0x0] 00010000:00010000:3.0:1788572076.959578:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959585:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959591:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959596:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.959599:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959606:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959615:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203b:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:3.0:1788572076.959618:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572076.959622:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.959628:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2e00/0x265cfe11109bce07 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.959731:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572076.959741:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.959760:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4800 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:0.0:1788572076.959765:0:10396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572076.959773:0:10396:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.959827:0:10396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.959834:0:10396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572076.959867:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 1/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.959875:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb4800/0x265cfe11109bce15 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bce1c expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.959899:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572076.959900:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572076.959902:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572076.959927:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584187136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572076.960042:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572076.960132:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584187136 00000100:00100000:0.0:1788572076.960142:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584187136 00000100:00100000:0.0:1788572076.960230:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4632 00000100:00100000:0.0:1788572076.960241:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3641:x1875444584187136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572076.960264:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572076.960293:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce1c lrc: 0/0,0 mode: --/EX res: [0x240002728:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bce15 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572076.960309:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x46:0x0].0x0 (ffff8e5a16354a00) 00010000:00010000:0.0:1788572076.960321:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572076.960367:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1875444584187136:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572076.960374:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4632 00000100:00100000:0.0:1788572076.960428:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584187136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572076.960822:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.960831:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.960838:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.960844:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572076.960849:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.960858:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.960869:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572076.960872:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572076.960876:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.960882:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3e00/0x265cfe11109bcdf9 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572076.960893:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e09eca47 reply state 000000009fab76d3 transno 330712481928 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.960908:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572076.960918:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572076.960920:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572076.960924:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572076.961035:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+59:156982:x1875444569448320:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 60720us (60965us total) trans 330712481928 rc 0/0 00000100:00100000:3.0:1788572076.961044:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 858 00000100:00100000:3.0:1788572077.024622:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572077.024860:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569448704 00000100:00100000:2.0:1788572077.024871:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569448704 00000100:00100000:2.0:1788572077.024943:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 859 00000100:00100000:2.0:1788572077.024954:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+59:156991:x1875444569448704:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572077.024980:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572077.025003:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bce23 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1ad expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025090:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025106:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025119:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025131:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 27 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025138:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025145:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025195:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025202:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025210:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025216:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572077.025222:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025229:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025242:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572077.025245:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572077.025249:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025256:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bce2a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025273:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025278:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025284:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025289:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572077.025292:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025298:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025306:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572077.025309:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572077.025312:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025318:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce31 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025346:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bce23 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1ad expref: 60 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025356:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572077.025358:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572077.025362:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bce23 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1ad expref: 60 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.025372:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1000, rc 0) 00000100:00100000:2.0:1788572077.025440:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+59:156991:x1875444569448704:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 488us (832us total) trans 0 rc 301/301 00000100:00100000:2.0:1788572077.025447:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 859 00000100:00100000:2.0:1788572077.042584:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572077.047862:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572077.048519:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569448960 00000100:00100000:3.0:1788572077.048535:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569448960 00000100:00100000:3.0:1788572077.048689:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 861 00000100:00100000:3.0:1788572077.048701:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+59:156991:x1875444569448960:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572077.048729:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572077.048762:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bce4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1bb expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.049251:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce54 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.049275:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce54 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.049291:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce54 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572077.049351:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00200000:2.0:1788572077.049356:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572077.049381:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce54 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.049415:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bce4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1bb expref: 61 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.049437:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce54 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1bb expref: 60 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.049448:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572077.049451:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572077.049455:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0e00, rc 0) 00000100:00100000:2.0:1788572077.049562:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+60:156991:x1875444569448960:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 862us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572077.049572:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 861 00000100:00100000:2.0:1788572077.057119:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572077.057268:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569449216 00000100:00100000:3.0:1788572077.057283:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569449216 00000100:00100000:3.0:1788572077.057361:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 862 00000100:00100000:3.0:1788572077.057374:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+60:156991:x1875444569449216:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:3.0:1788572077.057450:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572077.057523:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bce54 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1bb expref: 60 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.057550:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572077.057556:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572077.057851:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.057870:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.057883:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.057897:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 27 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.057911:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.057918:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572077.062620:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].456, 2152 off683072 00000040:00080000:3.0:1788572077.062723:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].489, 2352 off788784 00000004:00080000:3.0:1788572077.062731:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a1fdbc9c0 with version 909 00000004:00080000:0.0:1788572077.063041:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 909 rpc_version 909 00000020:00100000:0.0:1788572077.063089:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572077.063101:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5905c80e00 x1875444584187392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572077.063126:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584187392:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572077.063207:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572077.063248:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572077.065095:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584187392:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1788572077.065455:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.065475:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.065521:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.065544:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 3/0,1 mode: --/PW res: [0x200025d90:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.065554:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.065559:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.065599:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 3/0,1 mode: --/PW res: [0x240002728:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.065605:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 3/0,1 mode: --/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.065614:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 3/0,1 mode: --/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572077.065636:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584187520:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788572077.065692:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572077.065791:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572077.066069:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584187520 00000100:00100000:2.0:1788572077.066077:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584187520 00000100:00100000:2.0:1788572077.068423:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788572077.068457:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:188048:x1875444584187520:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572077.068515:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572077.068551:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bce7e lrc: 2/0,0 mode: --/PW res: [0x240002728:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bce77 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.068595:0:188053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bce7e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bce77 expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.068615:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bce7e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bce77 expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.068626:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x47:0x0].0x0 (ffff8e5a0a54bb00) 00010000:00010000:2.0:1788572077.068629:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572077.068634:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0200, rc 0) 00000100:00100000:2.0:1788572077.068769:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:188048:x1875444584187520:12345-0@lo:101:mdt00_000.0 Request processed in 327us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572077.068777:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788572077.068841:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584187520:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788572077.068878:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.068893:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572077.068924:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a29ad9be reply state 00000000eef2f186 transno 330712481929 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 3/0,1 mode: PW/PW res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.068939:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.068947:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x47:0x0].0x0 (ffff8e590d5ec000) 00010000:00010000:3.0:1788572077.068950:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572077.068956:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572077.068963:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 4/0,1 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.068972:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572077.068985:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x47:0x0] 00000004:00010000:3.0:1788572077.068993:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a29ad9be reply state 00000000eef2f186 transno 330712481929 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069001:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069020:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203c:0x0].0x0 (ffff8e590d5ec900) 00010000:00010000:3.0:1788572077.069023:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572077.069025:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1788572077.069031:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x203c:0x0]: returning size 4096 00010000:00010000:3.0:1788572077.069041:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069048:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069055:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069062:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572077.069068:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069094:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069107:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:3.0:1788572077.069110:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572077.069114:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069121:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bce5b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572077.069141:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a29ad9be reply state 00000000eef2f186 transno 330712481929 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069150:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.069157:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572077.069159:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572077.069162:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1788572077.069297:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+61:156991:x1875444569449216:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 11924us (12186us total) trans 330712481929 rc 0/0 00000100:00100000:3.0:1788572077.069306:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 862 00000100:00100000:3.0:1788572077.080421:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572077.089750:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569449472 00000100:00100000:3.0:1788572077.089766:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569449472 00000100:00100000:3.0:1788572077.089846:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569449600 00000100:00100000:3.0:1788572077.089849:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569449600 00000100:00100000:3.0:1788572077.089934:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 864 00000100:00100000:3.0:1788572077.089945:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+63:156985:x1875444569449472:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572077.089988:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:3.0:1788572077.090093:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+63:156985:x1875444569449472:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 148us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572077.090111:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 864 00000100:00100000:3.0:1788572077.090285:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 865 00000100:00100000:3.0:1788572077.090293:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+62:157001:x1875444569449600:12345-192.168.202.57@tcp:101:rmdir.0 00010000:00010000:3.0:1788572077.090304:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572077.090329:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcea1 lrc: 2/0,0 mode: --/CR res: [0x200025d90:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1c9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.090393:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 3/1,0 mode: --/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.090410:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.090424:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 3/1,0 mode: PR/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572077.090500:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200025d90:0x47:0x0]: returning size 4096 00000004:00200000:3.0:1788572077.090506:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1788572077.090543:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcea1 lrc: 0/0,0 mode: --/CR res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1c9 expref: 64 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.090563:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1c9 expref: 63 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.090571:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x47:0x0].0x0 (ffff8e590d5ec000) 00010000:00010000:3.0:1788572077.090573:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788572077.090576:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00031200, rc 0) 00000100:00100000:3.0:1788572077.090602:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+63:157001:x1875444569449600:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 311us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572077.090607:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 865 00000100:00100000:2.0:1788572077.093945:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572077.094520:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572077.094904:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569449728 00000100:00100000:0.0:1788572077.094917:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569449728 00000100:00100000:3.0:1788572077.095002:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569449856 00000100:00100000:3.0:1788572077.095015:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569449856 00000100:00100000:3.0:1788572077.095122:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 866 00000100:00100000:3.0:1788572077.095142:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:156985:x1875444569449856:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572077.095189:0:188833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445261312 avail 1299021824 00000100:00100000:3.0:1788572077.095281:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:156985:x1875444569449856:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 150us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572077.095289:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 866 00000100:00080000:0.0:1788572077.097121:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572077.097306:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788572077.097321:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584187648 00000100:00100000:2.0:1788572077.097328:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584187648 00000100:00100000:2.0:1788572077.097404:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5389 00000100:00100000:2.0:1788572077.097412:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cc21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188049:x1875444584187648:12345-0@lo:104: 00010000:00010000:2.0:1788572077.097428:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.097517:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572077.097523:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cc21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188049:x1875444584187648:12345-0@lo:104: Request processed in 112us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572077.097529:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5389 00010000:00010000:3.0:1788572077.097651:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572077.097660:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.097670:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5c00 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:3.0:1788572077.097676:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572077.097687:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 4/0,0 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.097718:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 2/0,0 mode: --/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.097725:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572077.097748:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 1/0,0 mode: --/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.097762:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5905bb5c00/0x265cfe11109bce77 lrc: 0/0,0 mode: --/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bce7e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.097785:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572077.097786:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572077.097788:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572077.098051:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584187776 00000100:00100000:3.0:1788572077.098055:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584187776 00010000:00010000:3.0:1788572077.098080:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bce7e lrc: 3/0,0 mode: PW/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x265cfe11109bce77 expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572077.098120:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12889 00000100:00100000:3.0:1788572077.098128:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3642:x1875444584187776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572077.098147:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788572077.101664:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1788572077.102323:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572077.106206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1788572077.107095:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788572077.108397:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837387 is committed 00010000:00010000:3.0:1788572077.108922:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bce7e lrc: 0/0,0 mode: --/PW res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bce77 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.108949:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x47:0x0].0x0 (ffff8e5a0a54bb00) 00010000:00010000:3.0:1788572077.108957:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 3/1,0 mode: --/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.108968:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.108978:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.109037:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572077.109857:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584187776:12345-0@lo:103:ldlm_bl.0 Request processed in 11723us (11947us total) trans 0 rc 0/0 00010000:00010000:2.0:1788572077.109868:0:188049:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572077.109875:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12889 00010000:00010000:2.0:1788572077.109893:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572077.109987:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002728:0x47:0x0]: returning size 4096 00000004:00200000:2.0:1788572077.109994:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788572077.110074:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bceaf lrc: 0/0,0 mode: --/CR res: [0x240002728:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d0 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.110111:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d0 expref: 7 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.110122:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x47:0x0].0x0 (ffff8e5a0a54bb00) 00010000:00010000:2.0:1788572077.110125:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572077.110129:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3200, rc 0) 00000100:00100000:2.0:1788572077.110292:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:157001:x1875444569449728:12345-192.168.202.57@tcp:101:rmdir.0 Request processed in 13661us (16357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572077.110301:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 867 00000100:00100000:3.0:1788572077.135737:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1788572077.138220:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.138243:0:188833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 2/0,0 mode: PR/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1c9 expref: 62 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.138259:0:188833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 4/0,1 mode: --/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.138300:0:188833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1c9 expref: 62 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.138318:0:188833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1c9 expref: 62 pid: 188048 timeout: 8930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572077.138334:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188833:1875444584187904:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572077.138622:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0013c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572077.146611:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188833:1875444584187904:192.168.202.57@tcp:104: 00010000:00010000:0.0:1788572077.146644:0:188833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572077.147671:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572077.147768:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569450496 00000100:00100000:2.0:1788572077.147779:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569450496 00010000:00010000:2.0:1788572077.147827:0:43930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1c9 expref: 63 pid: 188048 timeout: 8930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572077.147874:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12890 00000100:00100000:2.0:1788572077.147884:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+63:2398:x1875444569450496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572077.147899:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572077.147906:0:43930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 4/0,0 mode: PR/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1c9 expref: 63 pid: 188048 timeout: 8930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.147919:0:43930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 3/0,0 mode: PR/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1c9 expref: 63 pid: 188048 timeout: 8930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.147952:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bcea8 lrc: 0/0,0 mode: --/PR res: [0x200025d90:0x47:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1c9 expref: 63 pid: 188048 timeout: 8930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.147973:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x47:0x0].0x0 (ffff8e590d5ec000) 00010000:00010000:2.0:1788572077.147979:0:43930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 3/0,1 mode: --/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.147989:0:43930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.147998:0:43930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 4/0,1 mode: EX/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.148042:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572077.148104:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+62:2398:x1875444569450496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 222us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572077.148112:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12890 00010000:00010000:3.0:1788572077.148750:0:188833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.148771:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.148839:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.148847:0:188833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.148861:0:188833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 3/0,1 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572077.148888:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584188032:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1788572077.148946:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572077.148985:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572077.153768:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572077.153892:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569450624 00000100:00100000:0.0:1788572077.153905:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569450624 00010000:00010000:0.0:1788572077.153957:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d0 expref: 7 pid: 188049 timeout: 8930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572077.154016:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12891 00000100:00100000:0.0:1788572077.154030:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2400:x1875444569450624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572077.154050:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572077.154059:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 4/0,0 mode: PR/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d0 expref: 7 pid: 188049 timeout: 8930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.154116:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d0 expref: 7 pid: 188049 timeout: 8930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.154155:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bceb6 lrc: 0/0,0 mode: --/PR res: [0x240002728:0x47:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d0 expref: 7 pid: 188049 timeout: 8930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.154177:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x47:0x0].0x0 (ffff8e5a0a54bb00) 00010000:00010000:0.0:1788572077.154183:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcee0 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bced9 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572077.154242:0:188833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837387 gen 2 00000004:00080000:3.0:1788572077.154250:0:188833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837386 committed transno 21474837387 00000004:00080000:3.0:1788572077.154271:0:188833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837387 committed transno 21474837387 00000100:00100000:3.0:1788572077.154296:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584188032:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1788572077.154315:0:188833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.154326:0:188833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 4/0,1 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.154373:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcee0 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bced9 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.154385:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcee0 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bced9 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572077.154431:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcee0 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bced9 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572077.154448:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6502:1875444584188288:0@lo:105: 00000100:00100000:0.0:1788572077.154726:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572077.154775:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572077.154886:0:13337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584188288 00000100:00100000:3.0:1788572077.154896:0:13337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584188288 00000100:00100000:3.0:1788572077.154999:0:13337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5390 00000100:00100000:3.0:1788572077.155020:0:13337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6502:x1875444584188288:12345-0@lo:105: 00010000:00010000:3.0:1788572077.155031:0:13337:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.155040:0:13337:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.155049:0:13337:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 5/0,1 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.155058:0:13337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 5/0,1 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.155066:0:13337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.155075:0:13337:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 6/0,1 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.155109:0:13337:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a00030400) 00000100:00100000:3.0:1788572077.155174:0:13337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6502:x1875444584188288:12345-0@lo:105: Request processed in 157us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572077.155181:0:13337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5390 00000100:00100000:2.0:1788572077.155318:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6502:1875444584188288:0@lo:105: 00010000:00010000:2.0:1788572077.155340:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572077.155396:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2400:x1875444569450624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1368us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572077.155405:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12891 00000100:00100000:0.0:1788572077.157531:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584188416:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1788572077.157616:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572077.157668:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572077.157740:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584188416 00000100:00100000:2.0:1788572077.157748:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584188416 00000100:00100000:2.0:1788572077.157796:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788572077.157806:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188833:x1875444584188416:12345-0@lo:403:mdt00_003.0 00000100:00100000:2.0:1788572077.164618:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:188833:x1875444584188416:12345-0@lo:403:mdt00_003.0 Request processed in 6804us (6992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572077.164634:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788572077.164739:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188833:1875444584188416:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1788572077.166272:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200025d90:0x1:0x0].457, 656 off683728 00000040:00080000:0.0:1788572077.166458:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].490, 736 off789520 00000004:00080000:0.0:1788572077.166464:0:188833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a001300 with version 910 00000004:00080000:3.0:1788572077.166575:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 910 rpc_version 910 00000020:00100000:3.0:1788572077.167400:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572077.167412:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cb8a80 x1875444584188672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572077.167439:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584188672:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572077.167577:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572077.167617:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572077.168305:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584188672:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1788572077.168358:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x203c:0x0]: returning size 4096 00010000:00010000:2.0:1788572077.168387:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 3/0,1 mode: EX/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168398:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 2/0,0 mode: EX/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168407:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168413:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572077.168419:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 3/0,0 mode: EX/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168428:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 4/0,0 mode: EX/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168445:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x47:0x0].0x0 (ffff8e590d5ec000) 00010000:00010000:2.0:1788572077.168449:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572077.168455:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 2/0,0 mode: --/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168463:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4c00/0x265cfe11109bced2 lrc: 0/0,0 mode: --/EX res: [0x200025d90:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168580:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168590:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 4/0,1 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168598:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168616:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788572077.168625:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002728:0x47:0x0] 00010000:00010000:2.0:1788572077.168633:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcecb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168639:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcecb lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168646:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcecb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168652:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572077.168654:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcecb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168662:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcecb lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168671:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203c:0x0].0x0 (ffff8e590d5ec900) 00010000:00010000:2.0:1788572077.168675:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572077.168678:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcecb lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168683:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcecb lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168700:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcebd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168706:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcebd lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168711:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcebd lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168715:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572077.168717:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcebd lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168722:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcebd lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168729:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a4120fa00) 00010000:00010000:2.0:1788572077.168731:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572077.168734:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcebd lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168739:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcebd lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572077.168748:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c002c70 reply state 00000000d3c616fd transno 330712481930 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bcec4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168760:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bcec4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572077.168768:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:2.0:1788572077.168770:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572077.168774:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572077.168847:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+63:157001:x1875444569450368:12345-192.168.202.57@tcp:36:rmdir.0 Request processed in 32881us (33125us total) trans 330712481930 rc 0/0 00000100:00100000:2.0:1788572077.168855:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 868 00010000:00010000:3.0:1788572077.171900:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572077.171915:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 2/0,0 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.171927:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:3.0:1788572077.171936:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572077.171946:0:82817:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 3/0,0 mode: EX/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.171997:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 2/0,0 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.172020:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572077.172151:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 1/0,0 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.172160:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8e5a00030400/0x265cfe11109bced9 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcee0 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.172186:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572077.172188:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572077.172190:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572077.172211:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572077.172232:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584188800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572077.172306:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572077.172678:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584188800 00000100:00100000:3.0:1788572077.172688:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584188800 00000100:00100000:3.0:1788572077.172753:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4633 00000100:00100000:3.0:1788572077.172762:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3644:x1875444584188800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572077.172776:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572077.172795:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcee0 lrc: 0/0,0 mode: --/EX res: [0x240002728:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bced9 expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572077.172812:0:152004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002728:0x47:0x0].0x0 (ffff8e5a0a54bb00) 00010000:00010000:3.0:1788572077.172826:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572077.172867:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3644:x1875444584188800:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572077.172875:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4633 00000100:00100000:3.0:1788572077.172912:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584188800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572077.500782:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572078.525840:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572078.964927:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572078.964983:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572078.968760:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572078.968809:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572078.971158:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572078.971319:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569451136 00000100:00100000:3.0:1788572078.971329:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569451136 00000100:00100000:3.0:1788572078.971414:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7511 00000100:00100000:3.0:1788572078.971425:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569451136:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572078.971498:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569451136:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 58us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572078.971505:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7511 00000100:00100000:2.0:1788572078.971996:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569451008 00000100:00100000:2.0:1788572078.972002:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569451008 00000100:00100000:2.0:1788572078.972150:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569450880 00000100:00100000:2.0:1788572078.972155:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569450880 00000100:00100000:2.0:1788572078.972191:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 39 00000100:00100000:2.0:1788572078.972199:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569451008:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572078.972244:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569451008:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 45us (7263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572078.972250:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 39 00000100:00100000:2.0:1788572078.972267:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 40 00000100:00100000:2.0:1788572078.972274:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+63:2399:x1875444569450880:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572078.972302:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+63:2399:x1875444569450880:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (3496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572078.972309:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 40 00000100:00100000:2.0:1788572078.973388:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584189184 00000100:00100000:2.0:1788572078.973393:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584189184 00000100:00100000:2.0:1788572078.973429:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788572078.973436:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875444584189184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572078.973462:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:2.0:1788572078.973529:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875444584189184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572078.973536:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1788572078.974610:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572078.974615:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572078.974619:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572079.484806:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572079.484832:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584189312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572079.484908:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572079.485043:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584189312 00000100:00100000:0.0:1788572079.485052:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584189312 00000100:00100000:0.0:1788572079.485118:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6163 00000100:00100000:0.0:1788572079.485129:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584189312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572079.485158:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572079.485210:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584189312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572079.485217:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6163 00000100:00100000:0.0:1788572079.485270:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584189312:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572079.485335:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572079.486146:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572079.486157:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584189440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572079.486193:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572079.488762:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572079.488900:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584189440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572079.550948:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572080.000835:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bc4d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000847:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bc4d0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000855:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bc4d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000860:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.000864:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bc4d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000871:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bc4d0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000900:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.000903:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.000908:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bc4d0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000915:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bc4d0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000936:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000942:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000947:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000951:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.000954:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000959:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000967:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.000969:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.000971:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000977:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2600/0x265cfe11109bc532 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000989:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bc539 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.000996:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bc539 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001000:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bc539 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001023:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001026:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bc539 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001031:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bc539 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001039:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2030:0x0].0x0 (ffff8e5a36aaba00) 00010000:00010000:3.0:1788572080.001041:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001043:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bc539 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001049:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bc539 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2030:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001064:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bc540 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001070:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bc540 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001076:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bc540 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001081:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001083:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bc540 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001089:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bc540 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001097:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3b:0x0].0x0 (ffff8e5a36aab600) 00010000:00010000:3.0:1788572080.001098:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001101:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bc540 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001106:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bc540 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001119:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bc594 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001125:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bc594 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001130:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bc594 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001135:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001137:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bc594 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001143:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bc594 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001153:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.001155:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001158:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bc594 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001163:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bc594 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001172:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001177:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001183:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001187:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001190:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001195:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001203:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.001205:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001207:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001213:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bc5f6 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001223:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc5fd lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001228:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc5fd lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001233:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc5fd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001237:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001240:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc5fd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001245:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc5fd lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001252:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2031:0x0].0x0 (ffff8e5a16354800) 00010000:00010000:3.0:1788572080.001254:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001257:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc5fd lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001263:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bc5fd lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2031:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001274:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc604 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001281:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc604 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001286:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc604 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001291:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001294:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc604 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001299:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc604 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001306:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3c:0x0].0x0 (ffff8e5a16354200) 00010000:00010000:3.0:1788572080.001308:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001311:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc604 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001317:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bc604 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001328:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bc658 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001334:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bc658 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001340:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bc658 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001344:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001346:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bc658 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001352:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bc658 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001361:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.001364:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001366:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bc658 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001371:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bc658 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001381:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001387:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001392:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001398:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001400:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001406:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001413:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.001416:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001418:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001425:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2a00/0x265cfe11109bc6ba lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001435:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001441:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001447:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001452:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001456:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001462:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001469:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2032:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:3.0:1788572080.001471:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001474:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001803:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3000/0x265cfe11109bc6c1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2032:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001819:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001826:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001831:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001837:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001840:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001847:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001856:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3d:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:3.0:1788572080.001859:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001862:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001868:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3a00/0x265cfe11109bc6c8 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001882:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001889:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001906:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001911:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001914:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001920:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001932:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.001934:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001937:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001944:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bc71c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001955:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001961:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001966:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001972:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.001975:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001981:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001988:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.001990:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.001992:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.001999:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3800/0x265cfe11109bc77e lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788572080.002323:0:188127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522172 00000004:00080000:0.0:1788572080.002380:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a0013c0 with version 911 00000020:00080000:0.0:1788572080.002391:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522121 cancel update log [0x240002728:0x1:0x0].408: rc = 0 00000020:00080000:0.0:1788572080.002518:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522121 cancel update log [0x200025d90:0x1:0x0].376: rc = 0 00000004:00080000:0.0:1788572080.002545:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a001b40 with version 912 00000020:00080000:0.0:1788572080.002548:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522122 cancel update log [0x240002728:0x1:0x0].409: rc = 0 00000020:00080000:0.0:1788572080.002568:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522122 cancel update log [0x200025d90:0x1:0x0].377: rc = 0 00000004:00080000:0.0:1788572080.002584:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a001cc0 with version 913 00000020:00080000:0.0:1788572080.002587:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522123 cancel update log [0x240002728:0x1:0x0].410: rc = 0 00000020:00080000:0.0:1788572080.002604:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522123 cancel update log [0x200025d90:0x1:0x0].378: rc = 0 00000004:00080000:0.0:1788572080.002623:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a0019c0 with version 914 00000020:00080000:0.0:1788572080.002626:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522124 cancel update log [0x240002728:0x1:0x0].411: rc = 0 00000020:00080000:0.0:1788572080.002643:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522124 cancel update log [0x200025d90:0x1:0x0].379: rc = 0 00000004:00080000:0.0:1788572080.002661:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a001e40 with version 915 00000020:00080000:0.0:1788572080.002664:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522125 cancel update log [0x240002728:0x1:0x0].412: rc = 0 00000020:00080000:0.0:1788572080.002682:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522125 cancel update log [0x200025d90:0x1:0x0].380: rc = 0 00000004:00080000:0.0:1788572080.002700:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a0f073000 with version 916 00000020:00080000:0.0:1788572080.002703:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522126 cancel update log [0x240002728:0x1:0x0].413: rc = 0 00000020:00080000:0.0:1788572080.002721:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522126 cancel update log [0x200025d90:0x1:0x0].381: rc = 0 00000004:00080000:0.0:1788572080.002751:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a0f073300 with version 917 00000020:00080000:0.0:1788572080.002754:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522127 cancel update log [0x240002728:0x1:0x0].414: rc = 0 00000020:00080000:0.0:1788572080.002772:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522127 cancel update log [0x200025d90:0x1:0x0].382: rc = 0 00000004:00080000:0.0:1788572080.002791:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a0f073480 with version 918 00000020:00080000:0.0:1788572080.002794:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522128 cancel update log [0x240002728:0x1:0x0].415: rc = 0 00000020:00080000:0.0:1788572080.002812:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522128 cancel update log [0x200025d90:0x1:0x0].383: rc = 0 00000004:00080000:0.0:1788572080.002833:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a011ca3c0 with version 919 00000020:00080000:0.0:1788572080.002835:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522129 cancel update log [0x240002728:0x1:0x0].416: rc = 0 00000020:00080000:0.0:1788572080.002851:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522129 cancel update log [0x200025d90:0x1:0x0].384: rc = 0 00000004:00080000:0.0:1788572080.002874:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31da1780 with version 920 00000020:00080000:0.0:1788572080.002878:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522130 cancel update log [0x240002728:0x1:0x0].417: rc = 0 00000020:00080000:0.0:1788572080.002905:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522130 cancel update log [0x200025d90:0x1:0x0].385: rc = 0 00000004:00080000:0.0:1788572080.002924:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31da13c0 with version 921 00000020:00080000:0.0:1788572080.002927:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522131 cancel update log [0x240002728:0x1:0x0].418: rc = 0 00000020:00080000:0.0:1788572080.002943:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522131 cancel update log [0x200025d90:0x1:0x0].386: rc = 0 00000004:00080000:0.0:1788572080.002986:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31da1180 with version 922 00000020:00080000:0.0:1788572080.002989:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522132 cancel update log [0x240002728:0x1:0x0].419: rc = 0 00010000:00010000:3.0:1788572080.003202:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc785 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003210:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc785 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003216:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc785 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003223:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003226:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc785 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003234:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc785 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003244:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2033:0x0].0x0 (ffff8e5a318f4100) 00010000:00010000:3.0:1788572080.003247:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003251:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc785 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003258:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c000/0x265cfe11109bc785 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2033:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003272:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bc78c lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003278:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bc78c lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003285:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bc78c lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003290:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003294:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bc78c lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003300:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bc78c lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003306:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3e:0x0].0x0 (ffff8e5a318f4500) 00010000:00010000:3.0:1788572080.003308:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003311:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bc78c lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003318:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bc78c lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003332:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003339:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003344:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003350:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003353:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003359:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003371:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.003374:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003376:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003383:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1600/0x265cfe11109bc7e0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003393:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003399:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003405:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003411:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003414:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003420:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003427:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.003429:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003432:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003438:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2400/0x265cfe11109bc842 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003448:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003454:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003459:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003464:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003467:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003473:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003498:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2034:0x0].0x0 (ffff8e5a16272c00) 00010000:00010000:3.0:1788572080.003500:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003504:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003510:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bc849 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2034:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003524:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003530:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003537:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003542:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003545:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003550:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003557:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x3f:0x0].0x0 (ffff8e5a16272f00) 00010000:00010000:3.0:1788572080.003559:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003562:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003567:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0800/0x265cfe11109bc850 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003579:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003585:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003590:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003596:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003598:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003604:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003615:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.003617:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003620:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003625:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109bc8a4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003636:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003641:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003647:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003651:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003654:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003659:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003666:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.003669:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003671:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003677:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0a00/0x265cfe11109bc906 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003686:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc90d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003692:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc90d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003697:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc90d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003702:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003704:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc90d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003709:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc90d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003715:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2035:0x0].0x0 (ffff8e5a318f4900) 00010000:00010000:3.0:1788572080.003717:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003720:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc90d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003740:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bc90d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2035:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003752:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc914 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003758:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc914 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003762:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc914 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003767:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003769:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc914 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003775:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc914 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003781:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x40:0x0].0x0 (ffff8e5a318f4c00) 00010000:00010000:3.0:1788572080.003783:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.003786:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc914 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003792:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bc914 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003805:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bc968 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003811:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bc968 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003817:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bc968 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003822:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.003824:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bc968 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.003829:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bc968 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788572080.003952:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522132 cancel update log [0x200025d90:0x1:0x0].387: rc = 0 00000004:00080000:0.0:1788572080.003983:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31da16c0 with version 923 00000020:00080000:0.0:1788572080.003986:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522133 cancel update log [0x240002728:0x1:0x0].420: rc = 0 00000020:00080000:0.0:1788572080.004172:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522133 cancel update log [0x200025d90:0x1:0x0].388: rc = 0 00000004:00080000:0.0:1788572080.004197:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31da1b40 with version 924 00000020:00080000:0.0:1788572080.004201:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522134 cancel update log [0x240002728:0x1:0x0].421: rc = 0 00000020:00080000:0.0:1788572080.004219:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522134 cancel update log [0x200025d90:0x1:0x0].389: rc = 0 00000004:00080000:0.0:1788572080.004236:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31da1900 with version 925 00000020:00080000:0.0:1788572080.004238:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522135 cancel update log [0x240002728:0x1:0x0].422: rc = 0 00000020:00080000:0.0:1788572080.004253:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522135 cancel update log [0x200025d90:0x1:0x0].390: rc = 0 00000004:00080000:0.0:1788572080.004268:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31da10c0 with version 926 00000020:00080000:0.0:1788572080.004271:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522136 cancel update log [0x240002728:0x1:0x0].423: rc = 0 00000020:00080000:0.0:1788572080.004288:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522136 cancel update log [0x200025d90:0x1:0x0].392: rc = 0 00000004:00080000:0.0:1788572080.004303:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31da1840 with version 927 00000020:00080000:0.0:1788572080.004306:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522137 cancel update log [0x240002728:0x1:0x0].424: rc = 0 00000020:00080000:0.0:1788572080.004321:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522137 cancel update log [0x200025d90:0x1:0x0].393: rc = 0 00000004:00080000:0.0:1788572080.004338:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31da1d80 with version 928 00000020:00080000:0.0:1788572080.004341:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522138 cancel update log [0x240002728:0x1:0x0].426: rc = 0 00000020:00080000:0.0:1788572080.004356:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522138 cancel update log [0x200025d90:0x1:0x0].394: rc = 0 00000004:00080000:0.0:1788572080.004375:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a370dc000 with version 929 00000020:00080000:0.0:1788572080.004378:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522139 cancel update log [0x240002728:0x1:0x0].427: rc = 0 00000020:00080000:0.0:1788572080.004401:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522139 cancel update log [0x200025d90:0x1:0x0].395: rc = 0 00000004:00080000:0.0:1788572080.004450:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a370dc780 with version 930 00000020:00080000:0.0:1788572080.004454:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522140 cancel update log [0x240002728:0x1:0x0].428: rc = 0 00000020:00080000:0.0:1788572080.004496:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522140 cancel update log [0x200025d90:0x1:0x0].396: rc = 0 00000004:00080000:0.0:1788572080.004516:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a370dc480 with version 931 00000020:00080000:0.0:1788572080.004519:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522141 cancel update log [0x240002728:0x1:0x0].429: rc = 0 00000020:00080000:0.0:1788572080.004539:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522141 cancel update log [0x200025d90:0x1:0x0].397: rc = 0 00000004:00080000:0.0:1788572080.004557:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a370dcf00 with version 932 00000020:00080000:0.0:1788572080.004560:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522142 cancel update log [0x240002728:0x1:0x0].430: rc = 0 00000020:00080000:0.0:1788572080.004577:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522142 cancel update log [0x200025d90:0x1:0x0].398: rc = 0 00000004:00080000:0.0:1788572080.004595:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a370dcc00 with version 933 00000020:00080000:0.0:1788572080.004598:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522143 cancel update log [0x240002728:0x1:0x0].431: rc = 0 00000020:00080000:0.0:1788572080.004616:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522143 cancel update log [0x200025d90:0x1:0x0].399: rc = 0 00000004:00080000:0.0:1788572080.004632:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244ab0c0 with version 934 00000020:00080000:0.0:1788572080.004635:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522144 cancel update log [0x240002728:0x1:0x0].432: rc = 0 00000020:00080000:0.0:1788572080.004650:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522144 cancel update log [0x200025d90:0x1:0x0].400: rc = 0 00000004:00080000:0.0:1788572080.004665:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244ab600 with version 935 00000020:00080000:0.0:1788572080.004668:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522145 cancel update log [0x240002728:0x1:0x0].433: rc = 0 00000020:00080000:0.0:1788572080.004684:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522145 cancel update log [0x200025d90:0x1:0x0].401: rc = 0 00000004:00080000:0.0:1788572080.004699:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244abe40 with version 936 00000020:00080000:0.0:1788572080.004702:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522146 cancel update log [0x240002728:0x1:0x0].434: rc = 0 00000020:00080000:0.0:1788572080.004717:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522146 cancel update log [0x200025d90:0x1:0x0].402: rc = 0 00000004:00080000:0.0:1788572080.004759:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244ab900 with version 937 00000020:00080000:0.0:1788572080.004762:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522147 cancel update log [0x240002728:0x1:0x0].435: rc = 0 00000020:00080000:0.0:1788572080.004782:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522147 cancel update log [0x200025d90:0x1:0x0].403: rc = 0 00000004:00080000:0.0:1788572080.004810:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244aba80 with version 938 00000020:00080000:0.0:1788572080.004814:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522148 cancel update log [0x240002728:0x1:0x0].436: rc = 0 00000020:00080000:0.0:1788572080.004832:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522148 cancel update log [0x200025d90:0x1:0x0].404: rc = 0 00000004:00080000:0.0:1788572080.004848:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244ab840 with version 939 00000020:00080000:0.0:1788572080.004851:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522149 cancel update log [0x240002728:0x1:0x0].437: rc = 0 00000020:00080000:0.0:1788572080.004869:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522149 cancel update log [0x200025d90:0x1:0x0].405: rc = 0 00000004:00080000:0.0:1788572080.004886:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244ab3c0 with version 940 00000020:00080000:0.0:1788572080.004889:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522150 cancel update log [0x240002728:0x1:0x0].438: rc = 0 00000020:00080000:0.0:1788572080.004919:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522150 cancel update log [0x200025d90:0x1:0x0].406: rc = 0 00000004:00080000:0.0:1788572080.004935:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244ab240 with version 941 00000020:00080000:0.0:1788572080.004939:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522151 cancel update log [0x240002728:0x1:0x0].439: rc = 0 00000020:00080000:0.0:1788572080.004955:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522151 cancel update log [0x200025d90:0x1:0x0].407: rc = 0 00000004:00080000:0.0:1788572080.004971:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244abf00 with version 942 00000020:00080000:0.0:1788572080.004973:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522152 cancel update log [0x240002728:0x1:0x0].440: rc = 0 00000020:00080000:0.0:1788572080.004989:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522152 cancel update log [0x200025d90:0x1:0x0].408: rc = 0 00010000:00010000:3.0:1788572080.006833:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.006836:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.006844:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bc968 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006852:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bc968 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006874:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bc9ca lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006881:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bc9ca lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006888:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bc9ca lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006904:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.006908:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bc9ca lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006915:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bc9ca lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006924:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.006926:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.006929:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bc9ca lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006934:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bc9ca lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006946:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006952:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006958:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006963:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.006966:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006972:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006980:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2036:0x0].0x0 (ffff8e5a16272900) 00010000:00010000:3.0:1788572080.006982:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.006985:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.006991:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bc9d1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2036:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007210:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007218:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007223:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007228:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.007231:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007236:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007244:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x41:0x0].0x0 (ffff8e5a16272200) 00010000:00010000:3.0:1788572080.007246:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.007249:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007254:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109bc9d8 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007269:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bca2c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007275:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bca2c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007280:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bca2c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007285:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.007288:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bca2c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007293:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bca2c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007304:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.007306:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.007308:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bca2c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007314:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2c00/0x265cfe11109bca2c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007325:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bca8e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007332:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bca8e lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007338:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bca8e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007343:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.007345:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bca8e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007351:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bca8e lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007357:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.007359:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.007362:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bca8e lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007367:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bca8e lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007376:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bca95 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2037:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007381:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bca95 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2037:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007387:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bca95 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2037:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007392:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.007395:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bca95 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2037:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007400:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bca95 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2037:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007406:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2037:0x0].0x0 (ffff8e5a36aabb00) 00010000:00010000:3.0:1788572080.007408:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.007410:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bca95 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2037:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007415:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bca95 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2037:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007427:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bca9c lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.007444:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bca9c lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572080.007554:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590651f3c0 with version 943 00000020:00080000:0.0:1788572080.007561:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522153 cancel update log [0x240002728:0x1:0x0].441: rc = 0 00000020:00080000:0.0:1788572080.007636:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522153 cancel update log [0x200025d90:0x1:0x0].409: rc = 0 00000004:00080000:0.0:1788572080.007670:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590651f600 with version 944 00000020:00080000:0.0:1788572080.007674:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522154 cancel update log [0x240002728:0x1:0x0].442: rc = 0 00000020:00080000:0.0:1788572080.007695:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522154 cancel update log [0x200025d90:0x1:0x0].410: rc = 0 00000004:00080000:0.0:1788572080.007720:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590651f9c0 with version 945 00000020:00080000:0.0:1788572080.007723:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522155 cancel update log [0x240002728:0x1:0x0].443: rc = 0 00000020:00080000:0.0:1788572080.008237:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522155 cancel update log [0x200025d90:0x1:0x0].411: rc = 0 00000004:00080000:0.0:1788572080.008287:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a04528f00 with version 946 00000020:00080000:0.0:1788572080.008291:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522156 cancel update log [0x240002728:0x1:0x0].444: rc = 0 00000020:00080000:0.0:1788572080.008314:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522156 cancel update log [0x200025d90:0x1:0x0].412: rc = 0 00000004:00080000:0.0:1788572080.008334:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590651f840 with version 947 00000020:00080000:0.0:1788572080.008337:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522157 cancel update log [0x240002728:0x1:0x0].445: rc = 0 00000020:00080000:0.0:1788572080.008358:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522157 cancel update log [0x200025d90:0x1:0x0].413: rc = 0 00000004:00080000:0.0:1788572080.008378:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0600 with version 948 00000020:00080000:0.0:1788572080.008381:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522158 cancel update log [0x240002728:0x1:0x0].447: rc = 0 00000020:00080000:0.0:1788572080.008399:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522158 cancel update log [0x200025d90:0x1:0x0].415: rc = 0 00000004:00080000:0.0:1788572080.008420:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0c00 with version 949 00000020:00080000:0.0:1788572080.008423:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522159 cancel update log [0x240002728:0x1:0x0].448: rc = 0 00010000:00010000:3.0:1788572080.009241:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bca9c lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009249:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.009254:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bca9c lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009263:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bca9c lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009278:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x42:0x0].0x0 (ffff8e5a36aab300) 00010000:00010000:3.0:1788572080.009281:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.009285:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bca9c lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009291:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bca9c lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009316:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bcaf0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009323:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bcaf0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009328:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bcaf0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009333:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60de00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.009336:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bcaf0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009342:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bcaf0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009353:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.009355:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.009358:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bcaf0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009364:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bcaf0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009374:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009381:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009386:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009391:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.009394:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009399:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009406:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.009409:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.009411:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009417:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bcb52 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009429:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bcb59 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009447:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bcb59 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009967:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bcb59 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009972:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.009975:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bcb59 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009981:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bcb59 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.009990:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2038:0x0].0x0 (ffff8e590430c200) 00010000:00010000:3.0:1788572080.009992:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.009995:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bcb59 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010001:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bcb59 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2038:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010033:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bcb60 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010039:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bcb60 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010045:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bcb60 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010050:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.010053:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bcb60 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010059:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bcb60 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010067:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x43:0x0].0x0 (ffff8e590430c600) 00010000:00010000:3.0:1788572080.010069:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.010072:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bcb60 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010077:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bcb60 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010091:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcbb4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010096:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcbb4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010101:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcbb4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010105:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60ca00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.010108:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcbb4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010114:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcbb4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010125:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.010127:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.010129:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcbb4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010134:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bcbb4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010144:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bcc16 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010151:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bcc16 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010156:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bcc16 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010160:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.010162:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bcc16 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010167:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bcc16 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010174:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.010176:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.010178:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bcc16 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010183:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3600/0x265cfe11109bcc16 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010193:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010199:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010204:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010209:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.010212:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010217:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010224:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2039:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:3.0:1788572080.010226:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.010229:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010233:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2800/0x265cfe11109bcc1d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x2039:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010248:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010254:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010258:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010264:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.010267:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010273:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010280:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x44:0x0].0x0 (ffff8e590b3b4700) 00010000:00010000:3.0:1788572080.010282:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.010285:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010291:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2000/0x265cfe11109bcc24 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010303:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010310:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010316:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010320:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.010323:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010330:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010342:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.010344:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.010347:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010352:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3400/0x265cfe11109bcc78 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010364:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010370:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010376:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010381:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.010383:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010389:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010396:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.010398:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.010401:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010406:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bccda lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010417:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bcce1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010424:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bcce1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010430:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bcce1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010435:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.010438:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bcce1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.010444:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bcce1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788572080.010621:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522159 cancel update log [0x200025d90:0x1:0x0].416: rc = 0 00000004:00080000:0.0:1788572080.010664:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0240 with version 950 00000020:00080000:0.0:1788572080.010668:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522160 cancel update log [0x240002728:0x1:0x0].449: rc = 0 00000020:00080000:0.0:1788572080.010699:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522160 cancel update log [0x200025d90:0x1:0x0].417: rc = 0 00000004:00080000:0.0:1788572080.010719:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0540 with version 951 00000020:00080000:0.0:1788572080.010722:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522161 cancel update log [0x240002728:0x1:0x0].450: rc = 0 00000020:00080000:0.0:1788572080.010740:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522161 cancel update log [0x200025d90:0x1:0x0].418: rc = 0 00000004:00080000:0.0:1788572080.010756:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0840 with version 952 00000020:00080000:0.0:1788572080.010759:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522162 cancel update log [0x240002728:0x1:0x0].451: rc = 0 00000020:00080000:0.0:1788572080.010774:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522162 cancel update log [0x200025d90:0x1:0x0].419: rc = 0 00000004:00080000:0.0:1788572080.010789:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0f00 with version 953 00000020:00080000:0.0:1788572080.010792:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522163 cancel update log [0x240002728:0x1:0x0].452: rc = 0 00000020:00080000:0.0:1788572080.010808:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522163 cancel update log [0x200025d90:0x1:0x0].420: rc = 0 00000004:00080000:0.0:1788572080.010847:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a00c0 with version 954 00000020:00080000:0.0:1788572080.010850:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522164 cancel update log [0x240002728:0x1:0x0].453: rc = 0 00000020:00080000:0.0:1788572080.010869:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522164 cancel update log [0x200025d90:0x1:0x0].421: rc = 0 00000004:00080000:0.0:1788572080.010886:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0180 with version 955 00000020:00080000:0.0:1788572080.010889:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522165 cancel update log [0x240002728:0x1:0x0].454: rc = 0 00000020:00080000:0.0:1788572080.010921:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522165 cancel update log [0x200025d90:0x1:0x0].422: rc = 0 00000004:00080000:0.0:1788572080.010939:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0cc0 with version 956 00000020:00080000:0.0:1788572080.010942:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522166 cancel update log [0x240002728:0x1:0x0].455: rc = 0 00000020:00080000:0.0:1788572080.010957:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522166 cancel update log [0x200025d90:0x1:0x0].423: rc = 0 00000004:00080000:0.0:1788572080.010974:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a06c0 with version 957 00000020:00080000:0.0:1788572080.010977:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522167 cancel update log [0x240002728:0x1:0x0].456: rc = 0 00000020:00080000:0.0:1788572080.010993:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522167 cancel update log [0x200025d90:0x1:0x0].424: rc = 0 00000004:00080000:0.0:1788572080.011299:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590651fd80 with version 958 00000020:00080000:0.0:1788572080.011305:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522168 cancel update log [0x240002728:0x1:0x0].457: rc = 0 00000020:00080000:0.0:1788572080.011328:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522168 cancel update log [0x200025d90:0x1:0x0].425: rc = 0 00000004:00080000:0.0:1788572080.011346:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a414a7600 with version 959 00000020:00080000:0.0:1788572080.011349:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522169 cancel update log [0x240002728:0x1:0x0].458: rc = 0 00000020:00080000:0.0:1788572080.011365:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522169 cancel update log [0x200025d90:0x1:0x0].426: rc = 0 00000004:00080000:0.0:1788572080.011383:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a414a7cc0 with version 960 00000020:00080000:0.0:1788572080.011386:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522170 cancel update log [0x240002728:0x1:0x0].459: rc = 0 00000020:00080000:0.0:1788572080.011404:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522170 cancel update log [0x200025d90:0x1:0x0].427: rc = 0 00000004:00080000:0.0:1788572080.011423:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a414a7240 with version 961 00000020:00080000:0.0:1788572080.011426:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522171 cancel update log [0x240002728:0x1:0x0].460: rc = 0 00000020:00080000:0.0:1788572080.011461:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522171 cancel update log [0x200025d90:0x1:0x0].428: rc = 0 00000004:00080000:0.0:1788572080.011517:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a414a7780 with version 962 00000020:00080000:0.0:1788572080.011521:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522172 cancel update log [0x240002728:0x1:0x0].461: rc = 0 00000020:00080000:0.0:1788572080.011547:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522172 cancel update log [0x200025d90:0x1:0x0].429: rc = 0 00000020:00080000:0.0:1788572080.011561:0:188127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 326417522198 committed batchid 326417522172 00000020:00080000:0.0:1788572080.011588:0:188127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522172 00000100:00100000:0.0:1788572080.011705:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8aca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584190336:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572080.011718:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 914 rpc_version 914 00010000:00010000:3.0:1788572080.012408:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203a:0x0].0x0 (ffff8e5a16354b00) 00010000:00010000:3.0:1788572080.012412:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.012417:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bcce1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012426:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bcce1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x203a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012464:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bcce8 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012471:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bcce8 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012490:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bcce8 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012497:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.012500:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bcce8 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012507:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bcce8 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012514:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x45:0x0].0x0 (ffff8e5a16354600) 00010000:00010000:3.0:1788572080.012516:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.012520:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bcce8 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012525:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bcce8 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012544:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012550:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012556:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012560:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.012563:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012569:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012581:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.012584:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.012586:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012593:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bcd3c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.012605:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014122:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014140:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014147:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60dc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.014151:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014160:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014173:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.014177:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.014181:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014187:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60dc00/0x265cfe11109bcd9e lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014205:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014212:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014218:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014223:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.014226:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014232:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014239:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203b:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:3.0:1788572080.014241:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.014244:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014250:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d400/0x265cfe11109bcda5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x203b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014265:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014271:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014276:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014282:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.014285:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014290:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014299:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x46:0x0].0x0 (ffff8e590430c100) 00010000:00010000:3.0:1788572080.014301:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.014304:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014310:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c800/0x265cfe11109bcdac lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014330:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014337:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014342:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014347:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.014350:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014356:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014368:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.014371:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.014373:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014379:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bce00 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014393:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014400:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014405:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014410:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.014413:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014419:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014427:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.014430:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.014615:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014624:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bce62 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014636:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014642:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014648:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014652:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.014654:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014660:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014668:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203c:0x0].0x0 (ffff8e590d5ec900) 00010000:00010000:3.0:1788572080.014670:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.014673:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014678:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4800/0x265cfe11109bce69 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x203c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014689:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 3/0,1 mode: TXN/TXN res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014695:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 2/0,0 mode: TXN/TXN res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014699:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014705:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.014708:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 3/0,0 mode: TXN/TXN res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014713:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 4/0,0 mode: TXN/TXN res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014719:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200025d90:0x47:0x0].0x0 (ffff8e590d5ec000) 00010000:00010000:3.0:1788572080.014721:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.014808:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 2/0,0 mode: --/TXN res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014816:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bce70 lrc: 0/0,0 mode: --/TXN res: [0x200025d90:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014831:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bcec4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014838:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bcec4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014844:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bcec4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014849:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572080.014851:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bcec4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014858:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bcec4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014881:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x1ccea250 (ffff8e5a36aabd00) 00010000:00010000:3.0:1788572080.014884:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572080.014887:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bcec4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572080.014902:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bcec4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1b8b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788572080.015057:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572080.015069:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1f8fca80 x1875444584190592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572080.015093:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584190592:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.015156:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572080.018689:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.018881:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584190592 00000100:00100000:2.0:1788572080.018901:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584190592 00000100:00100000:3.0:1788572080.018992:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788572080.019021:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:188107:x1875444584190592:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.019230:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:188107:x1875444584190592:12345-0@lo:1000:osp_up1-0.0 Request processed in 228us (4072us total) trans 21474837392 rc 0/0 00000100:00100000:3.0:1788572080.019238:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788572080.019340:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584190592:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572080.019354:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 915 rpc_version 915 00000020:00100000:0.0:1788572080.019378:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572080.019384:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1f8fc700 x1875444584190848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572080.019405:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584190848:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.019441:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572080.019473:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.023243:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584190848 00000100:00100000:3.0:1788572080.023259:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584190848 00000100:00100000:3.0:1788572080.023317:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788572080.023329:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:188107:x1875444584190848:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.023587:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:188107:x1875444584190848:12345-0@lo:1000:osp_up1-0.0 Request processed in 260us (4144us total) trans 21474837393 rc 0/0 00000100:00100000:3.0:1788572080.023595:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788572080.023913:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584190848:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572080.023929:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 916 rpc_version 916 00000020:00100000:0.0:1788572080.023953:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572080.023961:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1f8ff800 x1875444584191104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572080.023981:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ff800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584191104:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.024036:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572080.024077:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.024243:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584191104 00000100:00100000:3.0:1788572080.024249:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584191104 00000100:00100000:3.0:1788572080.024273:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788572080.024280:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:188107:x1875444584191104:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.024384:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:188107:x1875444584191104:12345-0@lo:1000:osp_up1-0.0 Request processed in 104us (348us total) trans 21474837394 rc 0/0 00000100:00100000:3.0:1788572080.024396:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788572080.027228:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ff800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584191104:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572080.027248:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 917 rpc_version 917 00000020:00100000:0.0:1788572080.027278:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572080.027286:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1f8fce00 x1875444584191360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572080.027309:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584191360:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.027386:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572080.027412:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.027671:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584191360 00000100:00100000:3.0:1788572080.027678:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584191360 00000100:00100000:3.0:1788572080.027723:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788572080.027743:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:188107:x1875444584191360:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.027910:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:188107:x1875444584191360:12345-0@lo:1000:osp_up1-0.0 Request processed in 168us (536us total) trans 21474837395 rc 0/0 00000100:00100000:3.0:1788572080.027918:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788572080.028345:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584191360:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572080.028355:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 918 rpc_version 918 00000020:00100000:0.0:1788572080.028369:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572080.028385:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1f8fe680 x1875444584191616/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572080.028402:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584191616:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.028430:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572080.028467:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.029282:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584191616:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572080.029291:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 919 rpc_version 919 00000020:00100000:0.0:1788572080.029308:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572080.029313:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1fbb5180 x1875444584191872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572080.029326:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584191872:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.029356:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572080.029390:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.031519:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584191872:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572080.031533:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 920 rpc_version 920 00000020:00100000:0.0:1788572080.031552:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572080.031558:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36bd4a80 x1875444584192128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572080.031574:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584192128:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.031607:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572080.031632:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.031742:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584192128 00000100:00100000:3.0:1788572080.031748:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584192128 00000100:00100000:3.0:1788572080.031817:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788572080.031825:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:188107:x1875444584192128:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.031960:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:188107:x1875444584192128:12345-0@lo:1000:osp_up1-0.0 Request processed in 135us (352us total) trans 21474837398 rc 0/0 00000100:00100000:3.0:1788572080.031968:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788572080.032204:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584192128:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.032213:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 921 rpc_version 921 00000020:00100000:2.0:1788572080.032227:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.032233:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5905f6ea00 x1875444584192384/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.032246:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584192384:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.032278:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.032301:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.032571:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584192384 00000100:00100000:3.0:1788572080.032576:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584192384 00000100:00100000:3.0:1788572080.032597:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788572080.032604:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:188107:x1875444584192384:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.032685:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:188107:x1875444584192384:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (405us total) trans 21474837399 rc 0/0 00000100:00100000:3.0:1788572080.032691:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788572080.032856:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584192384:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.032864:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 922 rpc_version 922 00000020:00100000:2.0:1788572080.032876:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.032881:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462c700 x1875444584192640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.032908:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584192640:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.032935:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.032957:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.033020:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584192640 00000100:00100000:0.0:1788572080.033024:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584192640 00000100:00100000:0.0:1788572080.033068:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788572080.033075:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:188107:x1875444584192640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.033167:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:188107:x1875444584192640:12345-0@lo:1000:osp_up1-0.0 Request processed in 92us (230us total) trans 21474837400 rc 0/0 00000100:00100000:0.0:1788572080.033174:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788572080.033579:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584192640:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.033587:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 923 rpc_version 923 00000020:00100000:2.0:1788572080.033600:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.033605:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a2462ce00 x1875444584192896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.033618:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584192896:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.033646:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.033673:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.034017:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584192896:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.034024:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 924 rpc_version 924 00000020:00100000:2.0:1788572080.034036:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.034041:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36ea9f80 x1875444584193152/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.034054:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584193152:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.034078:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.034099:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.034352:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584193152:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.034359:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 925 rpc_version 925 00000020:00100000:2.0:1788572080.034370:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.034375:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36ea8e00 x1875444584193408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.034399:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584193408:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.034424:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.034457:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.034679:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584193408 00000100:00100000:3.0:1788572080.034684:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584193408 00000100:00100000:3.0:1788572080.034704:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788572080.034710:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:188107:x1875444584193408:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.034810:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+22:188107:x1875444584193408:12345-0@lo:1000:osp_up1-0.0 Request processed in 99us (384us total) trans 21474837403 rc 0/0 00000100:00100000:3.0:1788572080.034817:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788572080.036610:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584193408:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.036625:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 926 rpc_version 926 00000020:00100000:2.0:1788572080.036648:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.036654:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31c81180 x1875444584193664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.036669:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c81180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584193664:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.036722:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.036763:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.036836:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584193664 00000100:00100000:3.0:1788572080.036842:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584193664 00000100:00100000:3.0:1788572080.036901:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788572080.036910:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+22:188107:x1875444584193664:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.037057:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+23:188107:x1875444584193664:12345-0@lo:1000:osp_up1-0.0 Request processed in 148us (334us total) trans 21474837404 rc 0/0 00000100:00100000:3.0:1788572080.037064:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788572080.037432:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c81180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584193664:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.037457:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 927 rpc_version 927 00000020:00100000:2.0:1788572080.037472:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.037522:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31c82680 x1875444584193920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.037538:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584193920:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.037567:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.037581:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.037926:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584193920 00000100:00100000:0.0:1788572080.037931:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584193920 00000100:00100000:0.0:1788572080.037968:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788572080.037975:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+23:188107:x1875444584193920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.038072:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+24:188107:x1875444584193920:12345-0@lo:1000:osp_up1-0.0 Request processed in 96us (503us total) trans 21474837405 rc 0/0 00000100:00100000:0.0:1788572080.038079:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788572080.038175:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584193920:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.038183:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 928 rpc_version 928 00000020:00100000:2.0:1788572080.038195:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.038200:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a3729ed80 x1875444584194176/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.038211:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584194176:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.038234:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.038254:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.038844:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584194176:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.038852:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 929 rpc_version 929 00000020:00100000:2.0:1788572080.038864:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.038869:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a3729f480 x1875444584194432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.038882:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584194432:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.038918:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.038940:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.038988:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584194432 00000100:00100000:3.0:1788572080.038993:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584194432 00000100:00100000:3.0:1788572080.039024:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788572080.039031:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+25:188107:x1875444584194432:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.039127:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+26:188107:x1875444584194432:12345-0@lo:1000:osp_up1-0.0 Request processed in 95us (207us total) trans 21474837407 rc 0/0 00000100:00100000:3.0:1788572080.039134:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788572080.039207:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584194432:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.039214:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 930 rpc_version 930 00000020:00100000:2.0:1788572080.039226:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.039231:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a3729ca80 x1875444584194688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.039243:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584194688:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.039265:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.039288:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.039335:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584194688 00000100:00100000:0.0:1788572080.039340:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584194688 00000100:00100000:0.0:1788572080.039378:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788572080.039386:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+26:188107:x1875444584194688:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.039639:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+27:188107:x1875444584194688:12345-0@lo:1000:osp_up1-0.0 Request processed in 253us (372us total) trans 21474837408 rc 0/0 00000100:00100000:0.0:1788572080.039647:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788572080.039810:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584194688:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.039818:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 931 rpc_version 931 00000020:00100000:2.0:1788572080.039831:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.039835:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a3729d500 x1875444584194944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.039848:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584194944:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.039872:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.039904:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.040584:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584194944:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.040592:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 932 rpc_version 932 00000020:00100000:2.0:1788572080.040605:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.040609:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a3729d880 x1875444584195200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.040622:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584195200:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.040648:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.040669:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.040720:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584195200 00000100:00100000:0.0:1788572080.040734:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584195200 00000100:00100000:0.0:1788572080.040764:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788572080.040772:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+28:188107:x1875444584195200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.040853:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+29:188107:x1875444584195200:12345-0@lo:1000:osp_up1-0.0 Request processed in 81us (203us total) trans 21474837410 rc 0/0 00000100:00100000:0.0:1788572080.040860:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788572080.046340:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584195200:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.046359:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 933 rpc_version 933 00000020:00100000:2.0:1788572080.046403:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.046411:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a3729c000 x1875444584195456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.046431:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584195456:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.046554:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.046581:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.047016:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584195456 00000100:00100000:0.0:1788572080.047024:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584195456 00000100:00100000:0.0:1788572080.047086:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788572080.047096:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+29:188107:x1875444584195456:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.047257:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+30:188107:x1875444584195456:12345-0@lo:1000:osp_up1-0.0 Request processed in 162us (702us total) trans 21474837411 rc 0/0 00000100:00100000:0.0:1788572080.047265:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788572080.050118:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584195456:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.050136:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 934 rpc_version 934 00000020:00100000:2.0:1788572080.050165:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.050173:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f33480 x1875444584195712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.050195:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584195712:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.050249:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.050284:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.052124:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584195712:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.052137:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 935 rpc_version 935 00000020:00100000:2.0:1788572080.052155:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.052162:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f31f80 x1875444584195968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.052179:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584195968:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.052211:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.052241:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.052307:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584195968 00000100:00100000:3.0:1788572080.052312:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584195968 00000100:00100000:3.0:1788572080.052345:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788572080.052353:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+31:188107:x1875444584195968:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.052510:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+32:188107:x1875444584195968:12345-0@lo:1000:osp_up1-0.0 Request processed in 126us (266us total) trans 21474837413 rc 0/0 00000100:00100000:3.0:1788572080.052518:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788572080.052765:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584195968:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.052773:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 936 rpc_version 936 00000020:00100000:2.0:1788572080.052786:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.052791:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f30380 x1875444584196224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.052804:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584196224:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.052831:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.052854:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.053297:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584196224:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.053305:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 937 rpc_version 937 00000020:00100000:2.0:1788572080.053317:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.053322:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f32d80 x1875444584196480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.053335:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584196480:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.053362:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.053393:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.053917:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584196480:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.053925:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 938 rpc_version 938 00000020:00100000:2.0:1788572080.053937:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.053942:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f31c00 x1875444584196736/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.053955:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584196736:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.053979:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.054002:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.054049:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584196736 00000100:00100000:0.0:1788572080.054054:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584196736 00000100:00100000:0.0:1788572080.054086:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788572080.054094:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+34:188107:x1875444584196736:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.054179:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+35:188107:x1875444584196736:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (199us total) trans 21474837416 rc 0/0 00000100:00100000:0.0:1788572080.054186:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788572080.054283:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584196736:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.054289:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 939 rpc_version 939 00000020:00100000:2.0:1788572080.054300:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.054306:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f33b80 x1875444584196992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.054318:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584196992:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.054344:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.054365:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.057199:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584196992:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.057217:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 940 rpc_version 940 00000020:00100000:2.0:1788572080.057248:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.057255:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f30000 x1875444584197248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.057275:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584197248:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.057334:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.061415:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.061701:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584197248 00000100:00100000:3.0:1788572080.061711:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584197248 00000100:00100000:3.0:1788572080.061922:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788572080.061934:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+36:188107:x1875444584197248:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.062162:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+37:188107:x1875444584197248:12345-0@lo:1000:osp_up1-0.0 Request processed in 231us (4827us total) trans 21474837418 rc 0/0 00000100:00100000:3.0:1788572080.062171:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788572080.062332:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584197248:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.062345:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 941 rpc_version 941 00000020:00100000:2.0:1788572080.062368:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.062387:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f30a80 x1875444584197504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.062408:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584197504:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.062461:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.062501:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.062745:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584197504 00000100:00100000:3.0:1788572080.062750:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584197504 00000100:00100000:3.0:1788572080.062770:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788572080.062776:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+37:188107:x1875444584197504:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.062867:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+38:188107:x1875444584197504:12345-0@lo:1000:osp_up1-0.0 Request processed in 91us (405us total) trans 21474837419 rc 0/0 00000100:00100000:3.0:1788572080.062875:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788572080.063097:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584197504:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.063106:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 942 rpc_version 942 00000020:00100000:2.0:1788572080.063119:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.063124:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd3100 x1875444584197760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.063140:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584197760:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.063166:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.063191:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.063260:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584197760 00000100:00100000:0.0:1788572080.063265:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584197760 00000100:00100000:0.0:1788572080.063293:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788572080.063300:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+38:188107:x1875444584197760:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.063387:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+39:188107:x1875444584197760:12345-0@lo:1000:osp_up1-0.0 Request processed in 88us (220us total) trans 21474837420 rc 0/0 00000100:00100000:0.0:1788572080.063394:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788572080.063625:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584197760:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.063632:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 943 rpc_version 943 00000020:00100000:2.0:1788572080.063644:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.063649:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd2d80 x1875444584198016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.063661:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584198016:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.063688:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.063710:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.063819:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584198016 00000100:00100000:0.0:1788572080.063824:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584198016 00000100:00100000:0.0:1788572080.063842:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788572080.063849:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+39:188107:x1875444584198016:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.063935:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+40:188107:x1875444584198016:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (246us total) trans 21474837421 rc 0/0 00000100:00100000:0.0:1788572080.063945:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788572080.064258:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584198016:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.064266:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 944 rpc_version 944 00000020:00100000:2.0:1788572080.064279:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.064284:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd2a00 x1875444584198272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.064296:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584198272:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.064322:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.064341:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.064691:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584198272 00000100:00100000:0.0:1788572080.064696:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584198272 00000100:00100000:0.0:1788572080.064736:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788572080.064745:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+40:188107:x1875444584198272:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.064834:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+41:188107:x1875444584198272:12345-0@lo:1000:osp_up1-0.0 Request processed in 90us (510us total) trans 21474837422 rc 0/0 00000100:00100000:0.0:1788572080.064840:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788572080.064975:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584198272:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.064983:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 945 rpc_version 945 00000020:00100000:2.0:1788572080.064996:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.065002:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd1f80 x1875444584198528/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.065034:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584198528:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.065058:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.065079:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.065224:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584198528 00000100:00100000:0.0:1788572080.065229:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584198528 00000100:00100000:0.0:1788572080.065246:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788572080.065252:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+41:188107:x1875444584198528:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.065328:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+42:188107:x1875444584198528:12345-0@lo:1000:osp_up1-0.0 Request processed in 76us (269us total) trans 21474837423 rc 0/0 00000100:00100000:0.0:1788572080.065335:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788572080.065593:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584198528:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.065600:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 946 rpc_version 946 00000020:00100000:2.0:1788572080.065612:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.065617:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd1500 x1875444584198784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.065629:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584198784:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.065655:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.065678:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.065783:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584198784 00000100:00100000:0.0:1788572080.065787:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584198784 00000100:00100000:0.0:1788572080.065815:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788572080.065821:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+42:188107:x1875444584198784:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.065905:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+43:188107:x1875444584198784:12345-0@lo:1000:osp_up1-0.0 Request processed in 83us (248us total) trans 21474837424 rc 0/0 00000100:00100000:0.0:1788572080.065911:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788572080.066086:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584198784:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.066094:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 947 rpc_version 947 00000020:00100000:2.0:1788572080.066106:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.066111:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd0700 x1875444584199040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.066122:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd0700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584199040:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.066149:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.066170:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.066217:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584199040 00000100:00100000:0.0:1788572080.066221:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584199040 00000100:00100000:0.0:1788572080.066248:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788572080.066254:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+43:188107:x1875444584199040:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.066327:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+44:188107:x1875444584199040:12345-0@lo:1000:osp_up1-0.0 Request processed in 73us (177us total) trans 21474837425 rc 0/0 00000100:00100000:0.0:1788572080.066334:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788572080.066609:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd0700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584199040:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.066616:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 948 rpc_version 948 00000020:00100000:2.0:1788572080.066627:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.066632:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd2680 x1875444584199296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.066651:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584199296:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.066675:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.066697:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.066803:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584199296 00000100:00100000:3.0:1788572080.066808:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584199296 00000100:00100000:3.0:1788572080.066830:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788572080.066837:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+44:188107:x1875444584199296:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.066944:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+45:188107:x1875444584199296:12345-0@lo:1000:osp_up1-0.0 Request processed in 107us (267us total) trans 21474837426 rc 0/0 00000100:00100000:3.0:1788572080.066952:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788572080.071753:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584199296:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.071771:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 949 rpc_version 949 00000020:00100000:2.0:1788572080.071804:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.071811:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd3480 x1875444584199552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.071833:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584199552:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.071906:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.071935:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.072070:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584199552 00000100:00100000:3.0:1788572080.072077:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584199552 00000100:00100000:3.0:1788572080.072133:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788572080.072143:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+45:188107:x1875444584199552:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.072309:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+46:188107:x1875444584199552:12345-0@lo:1000:osp_up1-0.0 Request processed in 167us (402us total) trans 21474837427 rc 0/0 00000100:00100000:3.0:1788572080.072317:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788572080.072806:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584199552:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.072816:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 950 rpc_version 950 00000020:00100000:2.0:1788572080.072832:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.072838:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd3800 x1875444584199808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.072854:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584199808:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.072885:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.072923:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.072978:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584199808 00000100:00100000:3.0:1788572080.072982:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584199808 00000100:00100000:3.0:1788572080.073020:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788572080.073028:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+46:188107:x1875444584199808:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.073128:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+47:188107:x1875444584199808:12345-0@lo:1000:osp_up1-0.0 Request processed in 100us (242us total) trans 21474837428 rc 0/0 00000100:00100000:3.0:1788572080.073135:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788572080.073201:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584199808:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.073207:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 951 rpc_version 951 00000020:00100000:2.0:1788572080.073218:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.073223:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd1880 x1875444584200064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.073240:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584200064:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.073265:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.073287:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.073341:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584200064 00000100:00100000:0.0:1788572080.073346:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584200064 00000100:00100000:0.0:1788572080.073387:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788572080.073395:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+47:188107:x1875444584200064:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.073710:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+48:188107:x1875444584200064:12345-0@lo:1000:osp_up1-0.0 Request processed in 315us (442us total) trans 21474837429 rc 0/0 00000100:00100000:0.0:1788572080.073717:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788572080.073915:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584200064:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.073922:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 952 rpc_version 952 00000020:00100000:2.0:1788572080.073936:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.073941:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590c441c00 x1875444584200320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.073955:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c441c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584200320:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.073983:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.074040:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572080.082596:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584200320 00000100:00100000:3.0:1788572080.082612:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584200320 00000100:00100000:3.0:1788572080.082679:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788572080.082691:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+48:188107:x1875444584200320:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572080.085120:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+49:188107:x1875444584200320:12345-0@lo:1000:osp_up1-0.0 Request processed in 2423us (11126us total) trans 21474837430 rc 0/0 00000100:00100000:3.0:1788572080.085133:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788572080.086695:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c441c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584200320:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.086715:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 953 rpc_version 953 00000020:00100000:2.0:1788572080.086760:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.086769:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590c441500 x1875444584200576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.086793:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c441500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584200576:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.086856:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.086882:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.087667:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c441500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584200576:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.087676:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 954 rpc_version 954 00000020:00100000:2.0:1788572080.087690:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.087695:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590c443800 x1875444584200832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.087716:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c443800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584200832:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.087756:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.087780:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.087896:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584200832 00000100:00100000:0.0:1788572080.087902:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584200832 00000100:00100000:0.0:1788572080.087941:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788572080.087949:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+50:188107:x1875444584200832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.088044:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+51:188107:x1875444584200832:12345-0@lo:1000:osp_up1-0.0 Request processed in 97us (287us total) trans 21474837432 rc 0/0 00000100:00100000:0.0:1788572080.088051:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788572080.088589:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c443800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584200832:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.088596:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 955 rpc_version 955 00000020:00100000:2.0:1788572080.088611:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.088616:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a37102d80 x1875444584201088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.088630:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a37102d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584201088:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.088660:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.088685:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.088748:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584201088 00000100:00100000:0.0:1788572080.088752:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584201088 00000100:00100000:0.0:1788572080.088791:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788572080.088799:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+51:188107:x1875444584201088:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.088900:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+52:188107:x1875444584201088:12345-0@lo:1000:osp_up1-0.0 Request processed in 101us (238us total) trans 21474837433 rc 0/0 00000100:00100000:0.0:1788572080.088907:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788572080.089128:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a37102d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584201088:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.089135:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 956 rpc_version 956 00000020:00100000:2.0:1788572080.089146:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.089151:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a37103800 x1875444584201344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.089163:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a37103800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584201344:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.089191:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.089214:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.089651:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a37103800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584201344:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.089659:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 957 rpc_version 957 00000020:00100000:2.0:1788572080.089671:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.089675:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27228000 x1875444584201600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.089693:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27228000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584201600:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.089731:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.089751:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.090649:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27228000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584201600:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.090659:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 958 rpc_version 958 00000020:00100000:2.0:1788572080.090674:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.090681:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590a84df80 x1875444584201856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.090696:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584201856:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.090737:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.090761:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.091005:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584201856 00000100:00100000:0.0:1788572080.091010:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584201856 00000100:00100000:0.0:1788572080.091046:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788572080.091054:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+54:188107:x1875444584201856:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.091144:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+55:188107:x1875444584201856:12345-0@lo:1000:osp_up1-0.0 Request processed in 90us (406us total) trans 21474837436 rc 0/0 00000100:00100000:0.0:1788572080.091150:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788572080.091183:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584201856:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572080.091189:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 959 rpc_version 959 00000020:00100000:0.0:1788572080.091201:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572080.091205:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36bd7100 x1875444584202112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572080.091216:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd7100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584202112:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.091240:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572080.091255:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572080.091265:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584202112 00000100:00100000:0.0:1788572080.091268:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584202112 00000100:00100000:0.0:1788572080.091284:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788572080.091290:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+55:188107:x1875444584202112:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.091357:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+56:188107:x1875444584202112:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (116us total) trans 21474837437 rc 0/0 00000100:00100000:0.0:1788572080.091362:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788572080.091819:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd7100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584202112:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572080.091826:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 960 rpc_version 960 00000020:00100000:0.0:1788572080.091838:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572080.091843:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36bd5c00 x1875444584202368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572080.091854:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584202368:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572080.091880:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572080.091911:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.093115:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584202368:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.093124:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 961 rpc_version 961 00000020:00100000:2.0:1788572080.093137:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.093143:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590a84fb80 x1875444584202624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.093158:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584202624:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.093185:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572080.093211:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572080.093509:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584202624:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572080.093516:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 962 rpc_version 962 00000020:00100000:2.0:1788572080.093527:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572080.093532:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590a84e300 x1875444584202880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572080.093550:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584202880:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.093574:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572080.105090:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584202880 00000100:00100000:3.0:1788572080.105104:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584202880 00000100:00100000:2.0:1788572080.106295:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788572080.106305:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+58:188107:x1875444584202880:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572080.106687:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+59:188107:x1875444584202880:12345-0@lo:1000:osp_up1-0.0 Request processed in 383us (13111us total) trans 21474837440 rc 0/0 00000100:00100000:2.0:1788572080.106696:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00010000:00010000:3.0:1788572080.572927:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572081.022347:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584203136:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.022414:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572081.022447:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584203648:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.022473:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572081.022717:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584204160:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.022742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572081.022767:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788572081.022774:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584203264:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.022797:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572081.022814:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584203776:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.022839:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572081.022871:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584204288:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.022893:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572081.022928:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584203136 00000100:00100000:2.0:1788572081.022935:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584203136 00000100:00100000:2.0:1788572081.022987:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584203264 00000100:00100000:2.0:1788572081.022990:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584203264 00000100:00100000:2.0:1788572081.023013:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788572081.023022:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584203136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023074:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584203136:12345-0@lo:400:kworker.0 Request processed in 53us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572081.023081:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788572081.023098:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572081.023105:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584203264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023131:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584203264:12345-0@lo:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572081.023137:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572081.023158:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584203776 00000100:00100000:2.0:1788572081.023162:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584203776 00000100:00100000:2.0:1788572081.023187:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584204288 00000100:00100000:2.0:1788572081.023190:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584204288 00000100:00100000:2.0:1788572081.023207:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7512 00000100:00100000:2.0:1788572081.023213:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584203776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023242:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584203776:12345-0@lo:400:kworker.0 Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572081.023249:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7512 00000100:00100000:2.0:1788572081.023259:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7513 00000100:00100000:2.0:1788572081.023265:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584204288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023291:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584204288:12345-0@lo:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572081.023297:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7513 00000100:00080000:2.0:1788572081.023314:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572081.023319:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572081.023321:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572081.023355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584203264:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023366:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584203776:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023375:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584204288:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023385:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584203136:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023430:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584203648 00000100:00100000:2.0:1788572081.023434:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584203648 00000100:00100000:2.0:1788572081.023457:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584204160 00000100:00100000:2.0:1788572081.023460:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584204160 00000100:00100000:2.0:1788572081.023472:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788572081.023502:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584203648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023539:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584203648:12345-0@lo:400:kworker.0 Request processed in 61us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572081.023546:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788572081.023558:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788572081.023564:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+59:3643:x1875444584204160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023595:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+59:3643:x1875444584204160:12345-0@lo:400:kworker.0 Request processed in 31us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572081.023601:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788572081.023627:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584203648:0@lo:400:kworker.0 00000100:00100000:2.0:1788572081.023636:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584204160:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.023783:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584203392:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.023814:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572081.023867:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584203904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.023888:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572081.023907:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584204416:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.023925:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572081.023944:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788572081.023950:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584203008:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.023975:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572081.023998:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584203520:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024019:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572081.024034:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584204032:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024052:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572081.024064:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584204544:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024083:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572081.024116:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584203904 00000100:00100000:3.0:1788572081.024120:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584203904 00000100:00100000:3.0:1788572081.024151:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584204416 00000100:00100000:3.0:1788572081.024153:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584204416 00000100:00100000:3.0:1788572081.024172:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7514 00000100:00100000:3.0:1788572081.024178:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584203904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024214:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584203904:12345-0@lo:400:kworker.0 Request processed in 36us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572081.024220:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7514 00000100:00100000:3.0:1788572081.024233:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7515 00000100:00100000:3.0:1788572081.024239:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584204416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024267:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584204416:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572081.024272:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7515 00000100:00100000:3.0:1788572081.024302:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584203904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024312:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584204416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572081.024637:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584204032:12345-0@lo:400:kworker.0 Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572081.024643:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788572081.024653:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788572081.024658:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584204544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572081.024680:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584204544:12345-0@lo:400:kworker.0 Request processed in 23us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572081.024686:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788572081.024708:0:188063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584203008 00000100:00100000:1.0:1788572081.024711:0:188063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584203008 00000100:00100000:1.0:1788572081.024735:0:188063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788572081.024740:0:188063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584203008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572081.024768:0:188063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584203008:12345-0@lo:400:kworker.0 Request processed in 28us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572081.024774:0:188063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788572081.024864:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584203008:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024876:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584203520:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024888:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584204032:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024896:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584204544:0@lo:400:kworker.0 00000100:00100000:3.0:1788572081.024904:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584203392:0@lo:400:kworker.0 00000100:00080000:2.0:1788572081.026205:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572081.026213:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572081.026217:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572081.597676:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572082.621393:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788572083.070222:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837440 is committed 00010000:00010000:0.0:1788572083.650426:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572084.077641:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572084.077702:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572084.077756:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572084.077788:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572084.077821:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572084.077859:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569451520 00000100:00100000:1.0:1788572084.077873:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569451520 00000100:00100000:1.0:1788572084.077945:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569451648 00000100:00100000:1.0:1788572084.077949:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569451648 00000100:00100000:1.0:1788572084.077978:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 47 00000100:00100000:1.0:1788572084.077992:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2399:x1875444569451520:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572084.078097:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2399:x1875444569451520:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 108us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572084.078111:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 47 00000100:00100000:1.0:1788572084.078133:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 48 00000100:00100000:1.0:1788572084.078139:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569451648:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572084.078167:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569451648:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572084.078174:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 48 00000100:00100000:1.0:1788572084.078194:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569451776 00000100:00100000:1.0:1788572084.078198:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569451776 00000100:00100000:1.0:1788572084.078225:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569451904 00000100:00100000:1.0:1788572084.078228:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569451904 00000100:00100000:0.0:1788572084.078471:0:188064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569451392 00000100:00100000:0.0:1788572084.078476:0:188064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569451392 00000100:00100000:0.0:1788572084.078547:0:188064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 100 00000100:00100000:0.0:1788572084.078555:0:188064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569451392:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572084.078586:0:188064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569451392:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572084.078594:0:188064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 100 00000100:00100000:0.0:1788572084.078629:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7516 00000100:00100000:0.0:1788572084.078636:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569451776:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572084.078661:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569451776:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 26us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572084.078668:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7516 00000100:00100000:1.0:1788572084.079107:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7517 00000100:00100000:1.0:1788572084.079117:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569451904:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572084.079167:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569451904:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 52us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572084.079174:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7517 00000100:00080000:2.0:1788572084.079253:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572084.079258:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572084.079262:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572084.079266:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572084.092804:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584204672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572084.092845:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584204800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572084.093851:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572084.094001:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584204672 00000100:00100000:1.0:1788572084.094011:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584204672 00000100:00100000:1.0:1788572084.094087:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788572084.094098:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584204672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572084.094140:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:1.0:1788572084.094199:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584204672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572084.094206:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788572084.094250:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837440 gen 2 00000004:00080000:1.0:1788572084.094257:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837388 committed transno 21474837440 00000020:00080000:1.0:1788572084.094264:0:3643:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e590a001240 refcount 2 committed 0 result 0 batchid 326417522199 00000020:00080000:1.0:1788572084.094268:0:3643:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a3fade600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e590a001300 00000020:00080000:1.0:1788572084.094271:0:3643:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240002728:0x1:0x0].490 00000020:00080000:1.0:1788572084.094274:0:3643:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a3fadef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5a40dad800 00000020:00080000:1.0:1788572084.094287:0:3643:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200025d90:0x1:0x0].457 00000004:00080000:1.0:1788572084.094314:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837389 committed transno 21474837440 00000004:00080000:1.0:1788572084.094325:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837390 committed transno 21474837440 00000004:00080000:1.0:1788572084.094348:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837391 committed transno 21474837440 00000004:00080000:1.0:1788572084.094358:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837392 committed transno 21474837440 00000004:00080000:1.0:1788572084.094368:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837393 committed transno 21474837440 00000004:00080000:1.0:1788572084.094376:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837394 committed transno 21474837440 00000004:00080000:1.0:1788572084.094387:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837395 committed transno 21474837440 00000004:00080000:1.0:1788572084.094394:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837396 committed transno 21474837440 00000004:00080000:1.0:1788572084.094403:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837397 committed transno 21474837440 00000004:00080000:1.0:1788572084.094412:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837398 committed transno 21474837440 00000004:00080000:1.0:1788572084.094420:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837399 committed transno 21474837440 00000004:00080000:1.0:1788572084.094436:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837400 committed transno 21474837440 00000004:00080000:1.0:1788572084.094446:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837401 committed transno 21474837440 00000004:00080000:1.0:1788572084.094452:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837402 committed transno 21474837440 00000004:00080000:1.0:1788572084.094460:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837403 committed transno 21474837440 00000004:00080000:1.0:1788572084.094468:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837404 committed transno 21474837440 00000004:00080000:1.0:1788572084.094497:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837405 committed transno 21474837440 00000004:00080000:1.0:1788572084.094507:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837406 committed transno 21474837440 00000004:00080000:1.0:1788572084.094523:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837407 committed transno 21474837440 00000004:00080000:1.0:1788572084.094530:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837408 committed transno 21474837440 00000004:00080000:1.0:1788572084.094537:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837409 committed transno 21474837440 00000004:00080000:1.0:1788572084.094546:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837410 committed transno 21474837440 00000004:00080000:1.0:1788572084.094555:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837411 committed transno 21474837440 00000004:00080000:1.0:1788572084.094563:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837412 committed transno 21474837440 00000004:00080000:1.0:1788572084.094572:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837413 committed transno 21474837440 00000004:00080000:1.0:1788572084.094583:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837414 committed transno 21474837440 00000004:00080000:1.0:1788572084.094590:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837415 committed transno 21474837440 00000004:00080000:1.0:1788572084.094598:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837416 committed transno 21474837440 00000004:00080000:1.0:1788572084.094605:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837417 committed transno 21474837440 00000004:00080000:1.0:1788572084.094612:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837418 committed transno 21474837440 00000004:00080000:1.0:1788572084.094618:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837419 committed transno 21474837440 00000004:00080000:1.0:1788572084.094624:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837420 committed transno 21474837440 00000004:00080000:1.0:1788572084.094631:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837421 committed transno 21474837440 00000004:00080000:1.0:1788572084.094645:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837422 committed transno 21474837440 00000004:00080000:1.0:1788572084.094663:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837423 committed transno 21474837440 00000004:00080000:1.0:1788572084.094670:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837424 committed transno 21474837440 00000004:00080000:1.0:1788572084.094679:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837425 committed transno 21474837440 00000004:00080000:1.0:1788572084.094686:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837426 committed transno 21474837440 00000004:00080000:1.0:1788572084.094693:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837427 committed transno 21474837440 00000004:00080000:1.0:1788572084.094699:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837428 committed transno 21474837440 00000004:00080000:1.0:1788572084.094706:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837429 committed transno 21474837440 00000004:00080000:1.0:1788572084.094713:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837430 committed transno 21474837440 00000004:00080000:1.0:1788572084.094721:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837431 committed transno 21474837440 00000004:00080000:1.0:1788572084.094737:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837432 committed transno 21474837440 00000004:00080000:1.0:1788572084.094747:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837433 committed transno 21474837440 00000004:00080000:1.0:1788572084.094756:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837434 committed transno 21474837440 00000004:00080000:1.0:1788572084.094763:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837435 committed transno 21474837440 00000004:00080000:1.0:1788572084.094770:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837436 committed transno 21474837440 00000004:00080000:1.0:1788572084.094778:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837437 committed transno 21474837440 00000004:00080000:1.0:1788572084.094787:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837438 committed transno 21474837440 00000004:00080000:1.0:1788572084.094794:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837439 committed transno 21474837440 00000004:00080000:1.0:1788572084.094802:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837440 committed transno 21474837440 00000100:00100000:1.0:1788572084.094817:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584204672:0@lo:41:osp-pre-1-0.0 00000020:00080000:0.0:1788572084.094912:0:188127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 326417522199 committed batchid 326417522172 00000020:00080000:0.0:1788572084.094974:0:188127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522172 00000100:00100000:0.0:1788572084.095977:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584204928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572084.096039:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572084.096129:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584204928 00000100:00100000:1.0:1788572084.096136:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584204928 00000100:00100000:1.0:1788572084.096197:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6165 00000100:00100000:1.0:1788572084.096206:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584204928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572084.096231:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00080000:3.0:1788572084.096313:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572084.096903:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584204928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 696us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572084.096915:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6165 00000100:00100000:2.0:1788572084.096960:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572084.097015:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584204800 00000100:00100000:1.0:1788572084.097022:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584204800 00000100:00100000:1.0:1788572084.097158:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6166 00000100:00100000:1.0:1788572084.097167:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584204800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572084.097186:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572084.097231:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584204800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572084.097238:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6166 00000100:00080000:1.0:1788572084.097268:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572084.097445:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584204800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572084.097639:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584204928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572084.604919:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584205056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572084.605039:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572084.605178:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584205056 00000100:00100000:0.0:1788572084.605190:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584205056 00000100:00100000:0.0:1788572084.605282:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6167 00000100:00100000:0.0:1788572084.605293:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584205056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572084.605338:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572084.605399:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584205056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572084.605407:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6167 00000100:00100000:0.0:1788572084.605470:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584205056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572084.605890:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572084.605914:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584205184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572084.605951:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572084.606164:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584205184 00000100:00100000:2.0:1788572084.606169:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584205184 00000100:00100000:2.0:1788572084.606202:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6168 00000100:00100000:2.0:1788572084.606210:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584205184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572084.606225:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572084.606263:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584205184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572084.606269:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6168 00000100:00100000:2.0:1788572084.606303:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584205184:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788572084.606833:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572084.606839:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572084.608368:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572084.608397:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590b639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584205312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572084.608509:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572084.609047:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584205312 00000100:00100000:0.0:1788572084.609061:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584205312 00000100:00100000:0.0:1788572084.609132:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788572084.609145:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584205312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572084.609195:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:0.0:1788572084.609284:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584205312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572084.609293:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788572084.609688:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584205312:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572084.668908:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572085.586390:0:189333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 73a: open(O_CREAT), unlink, replay, reconnect before open replay, close ========================================================== 21:34:44 (1788572084) 00010000:00010000:2.0:1788572085.693827:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572085.705193:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572085.705271:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569452160 00000100:00100000:2.0:1788572085.705285:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569452160 00000100:00100000:2.0:1788572085.705361:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 869 00000100:00100000:2.0:1788572085.705374:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:157593:x1875444569452160:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1788572085.705403:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572085.705406:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788572085.705439:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109b98df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25b8de9 expref: 9 pid: 188130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.705468:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a4120f300) 00010000:00010000:2.0:1788572085.705520:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572085.705542:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcee7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1d7 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.706886:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.706985:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.706999:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.707019:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.707026:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.707033:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572085.708784:0:188049:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x19a9:0x0], count =25 00000004:00080000:2.0:1788572085.708803:0:188049:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x19a9:0x0]+25 in llog 00000004:00080000:2.0:1788572085.708844:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x19c2:0x0], index 0: 0 00010000:00010000:2.0:1788572085.710236:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcefc lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710266:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcefc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710282:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcefc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710327:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710334:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710342:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710348:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572085.710354:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710362:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710376:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a54be00) 00010000:00010000:2.0:1788572085.710379:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572085.710384:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710391:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bceee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572085.710406:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c112571 reply state 000000007ca20779 transno 330712481931 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710417:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710424:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8e5a0a54b100) 00010000:00010000:2.0:1788572085.710427:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572085.710430:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572085.710469:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcee7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d7 expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710515:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcefc lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d7 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.710524:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203d:0x0].0x0 (ffff8e5a0a54b500) 00010000:00010000:2.0:1788572085.710526:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572085.710528:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0e00, rc 0) 00000100:00100000:2.0:1788572085.710634:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:157593:x1875444569452160:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5263us (5456us total) trans 330712481931 rc 0/0 00000100:00100000:2.0:1788572085.710644:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 869 00000001:00080000:1.0:1788572085.730829:0:188045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 330712481931 is committed 00000020:00080000:1.0:1788572085.730860:0:188045:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 326417522199 batchid updated 00000020:00080000:1.0:1788572085.730866:0:188045:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 326417522198 batchid updated 00000020:00080000:1.0:1788572085.730941:0:188127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522199 00000004:00080000:1.0:1788572085.731021:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590b186900 with version 963 00000020:00080000:1.0:1788572085.731034:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522173 cancel update log [0x240002728:0x1:0x0].462: rc = 0 00000020:00080000:1.0:1788572085.731141:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522173 cancel update log [0x200025d90:0x1:0x0].430: rc = 0 00000004:00080000:1.0:1788572085.731174:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590b186780 with version 964 00000020:00080000:1.0:1788572085.731177:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522174 cancel update log [0x240002728:0x1:0x0].463: rc = 0 00000020:00080000:1.0:1788572085.731197:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522174 cancel update log [0x200025d90:0x1:0x0].431: rc = 0 00000004:00080000:1.0:1788572085.731219:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a414a7240 with version 965 00000020:00080000:1.0:1788572085.731223:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522175 cancel update log [0x240002728:0x1:0x0].464: rc = 0 00000020:00080000:1.0:1788572085.731241:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522175 cancel update log [0x200025d90:0x1:0x0].432: rc = 0 00000004:00080000:1.0:1788572085.731261:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a414a7cc0 with version 966 00000020:00080000:1.0:1788572085.731264:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522176 cancel update log [0x240002728:0x1:0x0].465: rc = 0 00000020:00080000:1.0:1788572085.731283:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522176 cancel update log [0x200025d90:0x1:0x0].433: rc = 0 00000004:00080000:1.0:1788572085.731304:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a414a7600 with version 967 00000020:00080000:1.0:1788572085.731307:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522177 cancel update log [0x240002728:0x1:0x0].466: rc = 0 00000020:00080000:1.0:1788572085.731326:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522177 cancel update log [0x200025d90:0x1:0x0].434: rc = 0 00000004:00080000:1.0:1788572085.731361:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a3fb4a9c0 with version 968 00000020:00080000:1.0:1788572085.731365:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522178 cancel update log [0x240002728:0x1:0x0].468: rc = 0 00000020:00080000:1.0:1788572085.731387:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522178 cancel update log [0x200025d90:0x1:0x0].435: rc = 0 00000004:00080000:1.0:1788572085.731409:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590394ca80 with version 969 00000020:00080000:1.0:1788572085.731412:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522179 cancel update log [0x240002728:0x1:0x0].469: rc = 0 00000020:00080000:1.0:1788572085.731431:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522179 cancel update log [0x200025d90:0x1:0x0].436: rc = 0 00000004:00080000:1.0:1788572085.731466:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0cc0 with version 970 00000020:00080000:1.0:1788572085.731469:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522180 cancel update log [0x240002728:0x1:0x0].470: rc = 0 00000020:00080000:1.0:1788572085.731515:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522180 cancel update log [0x200025d90:0x1:0x0].438: rc = 0 00000004:00080000:1.0:1788572085.731538:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0180 with version 971 00000020:00080000:1.0:1788572085.731541:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522181 cancel update log [0x240002728:0x1:0x0].471: rc = 0 00000020:00080000:1.0:1788572085.731561:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522181 cancel update log [0x200025d90:0x1:0x0].439: rc = 0 00000004:00080000:1.0:1788572085.731580:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a00c0 with version 972 00000020:00080000:1.0:1788572085.731583:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522182 cancel update log [0x240002728:0x1:0x0].472: rc = 0 00000020:00080000:1.0:1788572085.731601:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522182 cancel update log [0x200025d90:0x1:0x0].440: rc = 0 00000004:00080000:1.0:1788572085.731622:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0f00 with version 973 00000020:00080000:1.0:1788572085.731625:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522183 cancel update log [0x240002728:0x1:0x0].473: rc = 0 00000020:00080000:1.0:1788572085.731645:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522183 cancel update log [0x200025d90:0x1:0x0].441: rc = 0 00000004:00080000:1.0:1788572085.731678:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0840 with version 974 00000020:00080000:1.0:1788572085.731681:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522184 cancel update log [0x240002728:0x1:0x0].474: rc = 0 00000020:00080000:1.0:1788572085.731701:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522184 cancel update log [0x200025d90:0x1:0x0].442: rc = 0 00000004:00080000:1.0:1788572085.731720:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0540 with version 975 00000020:00080000:1.0:1788572085.731722:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522185 cancel update log [0x240002728:0x1:0x0].475: rc = 0 00000020:00080000:1.0:1788572085.731739:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522185 cancel update log [0x200025d90:0x1:0x0].443: rc = 0 00000004:00080000:1.0:1788572085.731757:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0240 with version 976 00000020:00080000:1.0:1788572085.731760:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522186 cancel update log [0x240002728:0x1:0x0].476: rc = 0 00000020:00080000:1.0:1788572085.731777:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522186 cancel update log [0x200025d90:0x1:0x0].444: rc = 0 00000004:00080000:1.0:1788572085.731794:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0c00 with version 977 00000020:00080000:1.0:1788572085.731797:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522187 cancel update log [0x240002728:0x1:0x0].477: rc = 0 00000020:00080000:1.0:1788572085.731813:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522187 cancel update log [0x200025d90:0x1:0x0].445: rc = 0 00000004:00080000:1.0:1788572085.731832:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0600 with version 978 00000020:00080000:1.0:1788572085.731835:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522188 cancel update log [0x240002728:0x1:0x0].478: rc = 0 00000020:00080000:1.0:1788572085.731852:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522188 cancel update log [0x200025d90:0x1:0x0].446: rc = 0 00000004:00080000:1.0:1788572085.731873:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590a8a0900 with version 979 00000020:00080000:1.0:1788572085.731875:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522189 cancel update log [0x240002728:0x1:0x0].479: rc = 0 00000020:00080000:1.0:1788572085.731893:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522189 cancel update log [0x200025d90:0x1:0x0].447: rc = 0 00000004:00080000:1.0:1788572085.731911:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a0b5aca80 with version 980 00000020:00080000:1.0:1788572085.731913:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522190 cancel update log [0x240002728:0x1:0x0].480: rc = 0 00000020:00080000:1.0:1788572085.731932:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522190 cancel update log [0x200025d90:0x1:0x0].448: rc = 0 00000004:00080000:1.0:1788572085.731959:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a3fb4a900 with version 981 00000020:00080000:1.0:1788572085.731963:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522191 cancel update log [0x240002728:0x1:0x0].481: rc = 0 00000020:00080000:1.0:1788572085.731985:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522191 cancel update log [0x200025d90:0x1:0x0].449: rc = 0 00000004:00080000:1.0:1788572085.732004:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a04528cc0 with version 982 00000020:00080000:1.0:1788572085.732006:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522192 cancel update log [0x240002728:0x1:0x0].482: rc = 0 00000020:00080000:1.0:1788572085.732021:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522192 cancel update log [0x200025d90:0x1:0x0].450: rc = 0 00000004:00080000:1.0:1788572085.732041:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e590b186300 with version 983 00000020:00080000:1.0:1788572085.732043:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522193 cancel update log [0x240002728:0x1:0x0].483: rc = 0 00000020:00080000:1.0:1788572085.732059:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522193 cancel update log [0x200025d90:0x1:0x0].451: rc = 0 00000004:00080000:1.0:1788572085.732077:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244abd80 with version 984 00000020:00080000:1.0:1788572085.732080:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522194 cancel update log [0x240002728:0x1:0x0].484: rc = 0 00000020:00080000:1.0:1788572085.732100:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522194 cancel update log [0x200025d90:0x1:0x0].452: rc = 0 00000004:00080000:1.0:1788572085.732119:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244ab9c0 with version 985 00000020:00080000:1.0:1788572085.732122:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522195 cancel update log [0x240002728:0x1:0x0].485: rc = 0 00000020:00080000:1.0:1788572085.732141:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522195 cancel update log [0x200025d90:0x1:0x0].453: rc = 0 00000004:00080000:1.0:1788572085.732160:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244ab480 with version 986 00000020:00080000:1.0:1788572085.732163:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522196 cancel update log [0x240002728:0x1:0x0].486: rc = 0 00000020:00080000:1.0:1788572085.732182:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522196 cancel update log [0x200025d90:0x1:0x0].454: rc = 0 00000004:00080000:1.0:1788572085.732203:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244abc00 with version 987 00000020:00080000:1.0:1788572085.732206:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522197 cancel update log [0x240002728:0x1:0x0].487: rc = 0 00000020:00080000:1.0:1788572085.732224:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522197 cancel update log [0x200025d90:0x1:0x0].455: rc = 0 00000004:00080000:1.0:1788572085.732244:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244abb40 with version 988 00000020:00080000:1.0:1788572085.732248:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522198 cancel update log [0x240002728:0x1:0x0].489: rc = 0 00000020:00080000:1.0:1788572085.732267:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522198 cancel update log [0x200025d90:0x1:0x0].456: rc = 0 00000004:00080000:1.0:1788572085.732287:0:188127:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a244ab000 with version 989 00000020:00080000:1.0:1788572085.732290:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 326417522199 cancel update log [0x240002728:0x1:0x0].490: rc = 0 00000020:00080000:1.0:1788572085.732308:0:188127:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 326417522199 cancel update log [0x200025d90:0x1:0x0].457: rc = 0 00000020:00080000:1.0:1788572085.732316:0:188127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522199 00000004:00080000:1.0:1788572085.732337:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 963 rpc_version 963 00000020:00100000:1.0:1788572085.732383:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572085.732398:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590d87f100 x1875444584205568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572085.732426:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d87f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584205568:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.732536:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572085.732580:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a244ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572085.732607:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584205568 00000100:00100000:1.0:1788572085.732615:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584205568 00000100:00100000:1.0:1788572085.732687:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788572085.732698:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:188107:x1875444584205568:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.732859:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584205568:12345-0@lo:1000:osp_up1-0.0 Request processed in 161us (321us total) trans 21474837441 rc 0/0 00000100:00100000:1.0:1788572085.732867:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788572085.732927:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d87f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584205568:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1788572085.732939:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 964 rpc_version 964 00000020:00100000:1.0:1788572085.732953:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572085.732958:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590a84e300 x1875444584205824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572085.732976:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584205824:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.733002:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572085.733020:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a244ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572085.733033:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584205824 00000100:00100000:1.0:1788572085.733037:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584205824 00000100:00100000:1.0:1788572085.733060:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788572085.733066:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:188107:x1875444584205824:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.733142:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584205824:12345-0@lo:1000:osp_up1-0.0 Request processed in 75us (138us total) trans 21474837442 rc 0/0 00000100:00100000:1.0:1788572085.733148:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788572085.733280:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584205824:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1788572085.733287:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 965 rpc_version 965 00000020:00100000:1.0:1788572085.733300:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572085.733305:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590a84df80 x1875444584206080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572085.733315:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584206080:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.733340:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572085.733353:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a244ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572085.733363:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584206080 00000100:00100000:1.0:1788572085.733365:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584206080 00000100:00100000:1.0:1788572085.733383:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788572085.733388:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:188107:x1875444584206080:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.733452:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:188107:x1875444584206080:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (110us total) trans 21474837443 rc 0/0 00000100:00100000:1.0:1788572085.733458:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788572085.733510:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584206080:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1788572085.733518:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 966 rpc_version 966 00000020:00100000:1.0:1788572085.733529:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572085.733534:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a37103800 x1875444584206336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572085.733545:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a37103800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584206336:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.733569:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572085.733582:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a244ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572085.733593:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584206336 00000100:00100000:1.0:1788572085.733596:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584206336 00000100:00100000:1.0:1788572085.733615:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788572085.733621:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:188107:x1875444584206336:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1788572085.736022:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572085.736042:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572085.736052:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572085.736063:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572085.736069:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572085.736077:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572085.736097:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8e5a0a54b100) 00010000:00010000:3.0:1788572085.736101:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572085.736107:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572085.736113:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1200/0x265cfe11109bcef5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572085.743396:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572085.744088:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:188107:x1875444584206336:12345-0@lo:1000:osp_up1-0.0 Request processed in 10460us (10510us total) trans 21474837444 rc 0/0 00000100:00100000:0.0:1788572085.744105:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788572085.745146:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a37103800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584206336:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.745176:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 967 rpc_version 967 00000020:00100000:2.0:1788572085.745209:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.745219:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27260380 x1875444584206592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.745244:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584206592:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.745311:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.745347:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a038ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.745371:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584206592 00000100:00100000:2.0:1788572085.745378:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584206592 00000100:00100000:2.0:1788572085.745431:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788572085.745440:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:188107:x1875444584206592:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.745636:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:188107:x1875444584206592:12345-0@lo:1000:osp_up1-0.0 Request processed in 197us (324us total) trans 21474837445 rc 0/0 00000100:00100000:2.0:1788572085.745643:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788572085.745692:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584206592:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.745700:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 968 rpc_version 968 00000020:00100000:2.0:1788572085.745712:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.745717:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27263800 x1875444584206848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.745730:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27263800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584206848:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.745757:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.745770:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a063009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572085.748222:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584206848 00000100:00100000:0.0:1788572085.748242:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584206848 00000100:00100000:0.0:1788572085.748315:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788572085.748328:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:188107:x1875444584206848:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572085.748572:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:188107:x1875444584206848:12345-0@lo:1000:osp_up1-0.0 Request processed in 247us (2813us total) trans 21474837446 rc 0/0 00000100:00100000:0.0:1788572085.748584:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788572085.749150:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27263800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584206848:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.749175:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 969 rpc_version 969 00000020:00100000:2.0:1788572085.749204:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.749212:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a27262a00 x1875444584207104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.749235:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27262a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584207104:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.749286:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.749323:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a063009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572085.749428:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584207104 00000100:00100000:0.0:1788572085.749433:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584207104 00000100:00100000:0.0:1788572085.749540:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788572085.749549:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:188107:x1875444584207104:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572085.749659:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:188107:x1875444584207104:12345-0@lo:1000:osp_up1-0.0 Request processed in 111us (372us total) trans 21474837447 rc 0/0 00000100:00100000:0.0:1788572085.749679:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788572085.750065:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569452288 00000100:00100000:3.0:1788572085.750072:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569452288 00000100:00100000:2.0:1788572085.750660:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 870 00000100:00100000:2.0:1788572085.750681:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:157595:x1875444569452288:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:2.0:1788572085.750701:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572085.750728:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcf0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1de expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.750810:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bcf11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.750828:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bcf11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.750844:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bcf11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572085.752077:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572085.752088:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572085.752143:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bcf11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.752252:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcf0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1de expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.752276:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bcf11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1de expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.752287:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a54be00) 00010000:00010000:2.0:1788572085.752289:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572085.752294:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0200, rc 0) 00000100:00100000:2.0:1788572085.752393:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+10:157595:x1875444569452288:12345-192.168.202.57@tcp:101:rm.0 Request processed in 1712us (9006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572085.752402:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 870 00000100:00100000:2.0:1788572085.752514:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27262a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584207104:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.752530:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 970 rpc_version 970 00000020:00100000:2.0:1788572085.752561:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.752568:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1fafed80 x1875444584207360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.752590:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584207360:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.752645:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.752683:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a063009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.752702:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584207360 00000100:00100000:2.0:1788572085.752708:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584207360 00000100:00100000:2.0:1788572085.752750:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788572085.752759:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:188107:x1875444584207360:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.753029:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:188107:x1875444584207360:12345-0@lo:1000:osp_up1-0.0 Request processed in 270us (384us total) trans 21474837448 rc 0/0 00000100:00100000:3.0:1788572085.755841:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572085.756030:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569452416 00000100:00100000:0.0:1788572085.756046:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569452416 00000100:00100000:2.0:1788572085.756108:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788572085.756119:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22588 00000100:00100000:0.0:1788572085.756130:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2397:x1875444569452416:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:0.0:1788572085.756153:0:43923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572085.756179:0:43923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1e5 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572085.756211:0:43923:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572085.756236:0:43923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c2:0x0].0x0 since=8838s v=(0 0) 00010000:00010000:0.0:1788572085.756242:0:43923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572085.756254:0:43923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1e5 expref: 6 pid: 43923 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572085.756278:0:43923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1e5 expref: 6 pid: 43923 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572085.756301:0:43923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5600, rc 0) 00000100:00100000:0.0:1788572085.756389:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569452416:12345-192.168.202.57@tcp:101:rm.0 Request processed in 261us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572085.756396:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22588 00000100:00100000:2.0:1788572085.756449:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584207360:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.756467:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 971 rpc_version 971 00000020:00100000:2.0:1788572085.756522:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.756530:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1faff800 x1875444584207616/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.756554:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584207616:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.756614:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.756642:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a063009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572085.758307:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584207616 00000100:00100000:3.0:1788572085.758325:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584207616 00000100:00100000:3.0:1788572085.758390:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788572085.758402:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:188107:x1875444584207616:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.758707:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:188107:x1875444584207616:12345-0@lo:1000:osp_up1-0.0 Request processed in 307us (2091us total) trans 21474837449 rc 0/0 00000100:00100000:3.0:1788572085.758715:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788572085.758762:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584207616:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.758779:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 972 rpc_version 972 00000020:00100000:2.0:1788572085.758804:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.758812:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1fafd180 x1875444584207872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.758841:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584207872:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.758883:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.759035:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a063009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.759053:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584207872 00000100:00100000:2.0:1788572085.759058:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584207872 00000100:00100000:2.0:1788572085.759087:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788572085.759094:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:188107:x1875444584207872:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.760390:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:188107:x1875444584207872:12345-0@lo:1000:osp_up1-0.0 Request processed in 1287us (1498us total) trans 21474837450 rc 0/0 00000100:00100000:2.0:1788572085.760405:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788572085.760673:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584207872:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1788572085.760690:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 973 rpc_version 973 00000020:00100000:3.0:1788572085.760716:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572085.760725:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590b63bb80 x1875444584208128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572085.760748:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590b63bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584208128:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.760792:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572085.760832:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572085.760848:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584208128 00000100:00100000:3.0:1788572085.760852:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584208128 00000100:00100000:2.0:1788572085.761028:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572085.761055:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569452672 00000100:00100000:2.0:1788572085.761059:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569452672 00000100:00100000:2.0:1788572085.761091:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 871 00000100:00100000:2.0:1788572085.761099:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+10:157595:x1875444569452672:12345-192.168.202.57@tcp:36:rm.0 00000100:00100000:3.0:1788572085.761285:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788572085.761294:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:188107:x1875444584208128:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.761432:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:188107:x1875444584208128:12345-0@lo:1000:osp_up1-0.0 Request processed in 140us (639us total) trans 21474837451 rc 0/0 00000100:00100000:3.0:1788572085.761440:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00010000:00010000:2.0:1788572085.761560:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788572085.761596:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bcefc lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d7 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761618:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203d:0x0].0x0 (ffff8e5a0a54b500) 00010000:00010000:2.0:1788572085.761638:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bcf11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1de expref: 9 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761647:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a54be00) 00010000:00010000:2.0:1788572085.761653:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572085.761692:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761709:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761720:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761732:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761739:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761745:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761838:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761846:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.761852:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572085.762087:0:188050:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x20001a9e3:0x203d:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1788572085.763055:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.763070:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.763084:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.763091:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572085.763096:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.763104:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.763118:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203d:0x0].0x0 (ffff8e5a0a54b900) 00010000:00010000:2.0:1788572085.763131:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572085.763137:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.763143:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bcf2d lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.764102:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.764116:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.764131:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.764137:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572085.764141:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.764220:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.764236:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a54b800) 00010000:00010000:2.0:1788572085.764239:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572085.764244:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.764250:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bcf1f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572085.764267:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043108578 reply state 00000000eaf462f1 transno 330712481932 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.764283:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572085.764292:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8e5a0a54b000) 00010000:00010000:2.0:1788572085.764294:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572085.764298:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572085.764425:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+10:157595:x1875444569452672:12345-192.168.202.57@tcp:36:rm.0 Request processed in 3319us (3393us total) trans 330712481932 rc 0/0 00000100:00100000:2.0:1788572085.764434:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 871 00000100:00100000:3.0:1788572085.768682:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b63bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584208128:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1788572085.768743:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 974 rpc_version 974 00000020:00100000:3.0:1788572085.768790:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572085.768801:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36efa680 x1875444584208384/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572085.768831:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584208384:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.773410:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.773564:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572085.773791:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584208384 00000100:00100000:3.0:1788572085.773803:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584208384 00000100:00100000:3.0:1788572085.773869:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788572085.773881:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:188107:x1875444584208384:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.774145:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:188107:x1875444584208384:12345-0@lo:1000:osp_up1-0.0 Request processed in 266us (746us total) trans 21474837452 rc 0/0 00000100:00100000:3.0:1788572085.774359:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788572085.774591:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584208384:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1788572085.774610:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 975 rpc_version 975 00000020:00100000:1.0:1788572085.774642:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572085.774650:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590c443800 x1875444584208640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572085.774685:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c443800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584208640:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.774737:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572085.774768:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a244ab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.774967:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584208640 00000100:00100000:2.0:1788572085.774973:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584208640 00000100:00100000:2.0:1788572085.775015:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788572085.775024:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:188107:x1875444584208640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.775437:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:188107:x1875444584208640:12345-0@lo:1000:osp_up1-0.0 Request processed in 413us (698us total) trans 21474837453 rc 0/0 00000100:00100000:2.0:1788572085.775445:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788572085.775575:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c443800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584208640:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572085.775587:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 976 rpc_version 976 00000020:00100000:0.0:1788572085.775604:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572085.775610:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36bd4700 x1875444584208896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572085.775627:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584208896:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572085.775676:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572085.775704:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d32cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.775982:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584208896 00000100:00100000:2.0:1788572085.775988:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584208896 00000100:00100000:2.0:1788572085.776024:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788572085.776033:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:188107:x1875444584208896:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.776331:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:188107:x1875444584208896:12345-0@lo:1000:osp_up1-0.0 Request processed in 299us (654us total) trans 21474837454 rc 0/0 00000100:00100000:2.0:1788572085.776338:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788572085.776445:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584208896:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572085.776453:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 977 rpc_version 977 00000020:00100000:0.0:1788572085.776468:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572085.776474:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36bd6680 x1875444584209152/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572085.776546:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd6680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584209152:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572085.776580:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572085.776607:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d32cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.776816:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584209152 00000100:00100000:2.0:1788572085.776822:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584209152 00000100:00100000:2.0:1788572085.776898:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788572085.776905:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+20:188107:x1875444584209152:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.777017:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:188107:x1875444584209152:12345-0@lo:1000:osp_up1-0.0 Request processed in 111us (435us total) trans 21474837455 rc 0/0 00000100:00100000:2.0:1788572085.777023:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788572085.777188:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd6680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584209152:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1788572085.777197:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 978 rpc_version 978 00000020:00100000:1.0:1788572085.777212:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572085.777218:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590c441c00 x1875444584209408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572085.777239:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c441c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584209408:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.777273:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572085.788205:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a244ab6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572085.790297:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584209408 00000100:00100000:3.0:1788572085.790322:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584209408 00000100:00100000:3.0:1788572085.790406:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788572085.790419:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:188107:x1875444584209408:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.790723:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:188107:x1875444584209408:12345-0@lo:1000:osp_up1-0.0 Request processed in 306us (13448us total) trans 21474837456 rc 0/0 00000100:00100000:3.0:1788572085.790732:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788572085.794232:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c441c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584209408:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572085.794260:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 979 rpc_version 979 00000020:00100000:0.0:1788572085.794297:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572085.794306:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36bd5880 x1875444584209664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572085.794335:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584209664:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572085.794417:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572085.794465:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d32840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.794700:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584209664 00000100:00100000:2.0:1788572085.794709:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584209664 00000100:00100000:2.0:1788572085.794766:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788572085.794776:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:188107:x1875444584209664:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.794981:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+23:188107:x1875444584209664:12345-0@lo:1000:osp_up1-0.0 Request processed in 206us (564us total) trans 21474837457 rc 0/0 00000100:00100000:2.0:1788572085.794989:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788572085.795035:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584209664:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.795045:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 980 rpc_version 980 00000020:00100000:2.0:1788572085.795062:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.795068:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1fafd500 x1875444584209920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.795082:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584209920:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.795113:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.795296:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a06300d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572085.796097:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584209920 00000100:00100000:1.0:1788572085.796107:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584209920 00000100:00100000:1.0:1788572085.796165:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788572085.796174:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+23:188107:x1875444584209920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.796350:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+24:188107:x1875444584209920:12345-0@lo:1000:osp_up1-0.0 Request processed in 176us (1235us total) trans 21474837458 rc 0/0 00000100:00100000:1.0:1788572085.796357:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788572085.796611:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584209920:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.796626:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 981 rpc_version 981 00000020:00100000:2.0:1788572085.796649:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.796656:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1fafe300 x1875444584210176/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.796688:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafe300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584210176:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.796728:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.796795:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a06300d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572085.796881:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584210176 00000100:00100000:3.0:1788572085.796897:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584210176 00000100:00100000:3.0:1788572085.796932:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788572085.796941:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+24:188107:x1875444584210176:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.797068:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+25:188107:x1875444584210176:12345-0@lo:1000:osp_up1-0.0 Request processed in 128us (339us total) trans 21474837459 rc 0/0 00000100:00100000:3.0:1788572085.797075:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788572085.797339:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafe300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584210176:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.797348:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 982 rpc_version 982 00000020:00100000:2.0:1788572085.797365:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.797370:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1faff100 x1875444584210432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.797385:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584210432:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.797416:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.797444:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a06300d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572085.799304:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584210432 00000100:00100000:3.0:1788572085.799323:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584210432 00000100:00100000:3.0:1788572085.799388:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788572085.799399:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+25:188107:x1875444584210432:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.799648:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+26:188107:x1875444584210432:12345-0@lo:1000:osp_up1-0.0 Request processed in 251us (2230us total) trans 21474837460 rc 0/0 00000100:00100000:3.0:1788572085.799656:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788572085.799979:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584210432:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.799998:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 983 rpc_version 983 00000020:00100000:2.0:1788572085.800025:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.800034:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cdc000 x1875444584210688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.800058:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584210688:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.800102:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.800143:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a06300d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572085.800405:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584210688 00000100:00100000:3.0:1788572085.800411:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584210688 00000100:00100000:3.0:1788572085.800450:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788572085.800458:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+26:188107:x1875444584210688:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.800634:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+27:188107:x1875444584210688:12345-0@lo:1000:osp_up1-0.0 Request processed in 176us (531us total) trans 21474837461 rc 0/0 00000100:00100000:3.0:1788572085.800645:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788572085.800737:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584210688:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.800745:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 984 rpc_version 984 00000020:00100000:2.0:1788572085.800758:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.800764:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cddf80 x1875444584210944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.800777:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cddf80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584210944:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.800810:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.800833:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a06300d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.800847:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584210944 00000100:00100000:2.0:1788572085.800851:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584210944 00000100:00100000:2.0:1788572085.800872:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788572085.800878:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+27:188107:x1875444584210944:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.800965:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+28:188107:x1875444584210944:12345-0@lo:1000:osp_up1-0.0 Request processed in 87us (154us total) trans 21474837462 rc 0/0 00000100:00100000:2.0:1788572085.800972:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788572085.800996:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cddf80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584210944:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572085.801003:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 985 rpc_version 985 00000020:00100000:2.0:1788572085.801013:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572085.801017:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cdd180 x1875444584211200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572085.801029:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584211200:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.801051:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572085.801060:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a038ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.801070:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584211200 00000100:00100000:2.0:1788572085.801074:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584211200 00000100:00100000:2.0:1788572085.801088:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788572085.801093:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+28:188107:x1875444584211200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.801385:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+29:188107:x1875444584211200:12345-0@lo:1000:osp_up1-0.0 Request processed in 291us (332us total) trans 21474837463 rc 0/0 00000100:00100000:2.0:1788572085.801392:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788572085.801454:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584211200:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1788572085.801461:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 986 rpc_version 986 00000020:00100000:3.0:1788572085.801474:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572085.801504:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36ef8700 x1875444584211456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572085.801518:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584211456:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.801546:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572085.801574:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572085.804766:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584211456 00000100:00100000:1.0:1788572085.804787:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584211456 00000100:00100000:1.0:1788572085.804878:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788572085.804890:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+29:188107:x1875444584211456:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.805143:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+30:188107:x1875444584211456:12345-0@lo:1000:osp_up1-0.0 Request processed in 255us (3595us total) trans 21474837464 rc 0/0 00000100:00100000:1.0:1788572085.805152:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788572085.805451:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584211456:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1788572085.805469:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 987 rpc_version 987 00000020:00100000:3.0:1788572085.805525:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572085.805533:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36ef8a80 x1875444584211712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572085.805558:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584211712:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.805605:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572085.805654:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.805723:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584211712 00000100:00100000:2.0:1788572085.805728:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584211712 00000100:00100000:2.0:1788572085.805764:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788572085.805773:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+30:188107:x1875444584211712:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.805897:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+31:188107:x1875444584211712:12345-0@lo:1000:osp_up1-0.0 Request processed in 116us (283us total) trans 21474837465 rc 0/0 00000100:00100000:2.0:1788572085.805904:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788572085.805955:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584211712:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1788572085.805963:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 988 rpc_version 988 00000020:00100000:1.0:1788572085.805976:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572085.805981:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd3800 x1875444584211968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572085.805994:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584211968:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.806022:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572085.806048:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a244ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572085.806072:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584211968 00000100:00100000:2.0:1788572085.806077:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584211968 00000100:00100000:2.0:1788572085.806105:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788572085.806112:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+31:188107:x1875444584211968:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572085.806392:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+32:188107:x1875444584211968:12345-0@lo:1000:osp_up1-0.0 Request processed in 279us (367us total) trans 21474837466 rc 0/0 00000100:00100000:2.0:1788572085.806399:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788572085.806508:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584211968:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1788572085.806516:0:188107:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5906580840 version 989 rpc_version 989 00000020:00100000:1.0:1788572085.806529:0:188107:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572085.806534:0:188107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd2680 x1875444584212224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572085.806547:0:188107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584212224:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572085.806578:0:188107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572085.806601:0:188107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a244ab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572085.806696:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584212224 00000100:00100000:3.0:1788572085.806701:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584212224 00000100:00100000:3.0:1788572085.806734:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788572085.806742:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+32:188107:x1875444584212224:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788572085.806838:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:188107:x1875444584212224:12345-0@lo:1000:osp_up1-0.0 Request processed in 96us (259us total) trans 21474837467 rc 0/0 00000100:00100000:3.0:1788572085.806844:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788572085.806979:0:188107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:188107:1875444584212224:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788572086.148431:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584212736:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.148541:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572086.148579:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584213248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.148603:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572086.148619:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584213760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.148636:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572086.148673:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572086.148679:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584212608:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.148704:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572086.148719:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584212480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.148722:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584213120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.148742:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572086.148748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572086.148757:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584213632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572086.148786:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584212992:0@lo:400:kworker.0 00000100:00100000:0.0:1788572086.148826:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584212352:0@lo:400:kworker.0 00000100:00100000:2.0:1788572086.148978:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584212736 00000100:00100000:2.0:1788572086.148990:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584212736 00000100:00100000:2.0:1788572086.149052:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584212608 00000100:00100000:2.0:1788572086.149054:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584212608 00000100:00100000:2.0:1788572086.149069:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584212480 00000100:00100000:2.0:1788572086.149071:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584212480 00000100:00100000:2.0:1788572086.149089:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788572086.149100:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584212736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.149671:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572086.149719:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584213248 00000100:00100000:1.0:1788572086.149723:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584213248 00000100:00100000:1.0:1788572086.149757:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584213760 00000100:00100000:1.0:1788572086.149761:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584213760 00000100:00100000:1.0:1788572086.149781:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584213120 00000100:00100000:1.0:1788572086.149783:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584213120 00000100:00100000:1.0:1788572086.149799:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584213632 00000100:00100000:1.0:1788572086.149801:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584213632 00000100:00100000:1.0:1788572086.149818:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7518 00000100:00100000:1.0:1788572086.149825:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584213248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.149865:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584213248:12345-0@lo:400:kworker.0 Request processed in 40us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.149873:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7518 00000100:00100000:1.0:1788572086.149890:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7519 00000100:00100000:1.0:1788572086.149895:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584213760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.149924:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584213760:12345-0@lo:400:kworker.0 Request processed in 30us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.149931:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7519 00000100:00100000:1.0:1788572086.149941:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7520 00000100:00100000:1.0:1788572086.149947:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584213120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.149976:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584213120:12345-0@lo:400:kworker.0 Request processed in 30us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.149982:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7520 00000100:00100000:1.0:1788572086.149993:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7521 00000100:00100000:1.0:1788572086.149999:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584213632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.150039:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584213632:12345-0@lo:400:kworker.0 Request processed in 40us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.150045:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7521 00000100:00100000:1.0:1788572086.150072:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788572086.150080:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584212608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.150112:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584212608:12345-0@lo:400:kworker.0 Request processed in 34us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.150119:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788572086.150150:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788572086.150156:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584212480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.150183:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584212480:12345-0@lo:400:kworker.0 Request processed in 28us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.150188:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788572086.150246:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584212608:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.150259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584213120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.150268:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584213632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.150279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584213248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.150289:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584213760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572086.155663:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572086.157745:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584213504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572086.158005:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572086.158117:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584212480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572086.158363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572086.158403:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584212864:0@lo:400:kworker.0 00000100:00100000:0.0:1788572086.158436:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572086.158453:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584213376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572086.158462:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584212864 00000100:00100000:3.0:1788572086.158471:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584212864 00000100:00100000:0.0:1788572086.158473:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572086.158512:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584213888:0@lo:400:kworker.0 00000100:00100000:0.0:1788572086.158536:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572086.158539:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584213376 00000100:00100000:3.0:1788572086.158542:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584213376 00000100:00100000:3.0:1788572086.158554:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584213888 00000100:00100000:3.0:1788572086.158557:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584213888 00000100:00100000:0.0:1788572086.158562:0:188065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584212352 00000100:00100000:0.0:1788572086.158564:0:188065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584212352 00000100:00100000:3.0:1788572086.158571:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788572086.158580:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584212864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572086.158594:0:188065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788572086.158600:0:188065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584212352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572086.158644:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584212864:12345-0@lo:400:kworker.0 Request processed in 63us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572086.158661:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788572086.158693:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584212992 00000100:00100000:1.0:1788572086.158698:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584212992 00000100:00100000:1.0:1788572086.158733:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584213504 00000100:00100000:1.0:1788572086.158735:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584213504 00000100:00100000:1.0:1788572086.158749:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788572086.158755:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584212992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.158802:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584212992:12345-0@lo:400:kworker.0 Request processed in 47us (3162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.158809:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788572086.158821:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788572086.158827:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:3642:x1875444584213504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.158862:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:3642:x1875444584213504:12345-0@lo:400:kworker.0 Request processed in 35us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.158868:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788572086.159113:0:188065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584212352:12345-0@lo:400:kworker.0 Request processed in 512us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572086.159120:0:188065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788572086.159189:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584212352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572086.159203:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584212864:0@lo:400:kworker.0 00000100:00080000:0.0:1788572086.159297:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572086.159302:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572086.159307:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572086.159309:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572086.159393:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788572086.160033:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572086.160121:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584213376:12345-0@lo:400:kworker.0 Request processed in 720us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.161318:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788572086.161340:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584213888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.161426:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584213888:12345-0@lo:400:kworker.0 Request processed in 96us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.161433:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788572086.161742:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584213376:0@lo:400:kworker.0 00000100:00100000:0.0:1788572086.161759:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584213888:0@lo:400:kworker.0 00000100:00100000:2.0:1788572086.163752:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584212736:12345-0@lo:400:kworker.0 Request processed in 14367us (14924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572086.163771:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788572086.163862:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584212992:0@lo:400:kworker.0 00000100:00100000:2.0:1788572086.163880:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584213504:0@lo:400:kworker.0 00000100:00100000:1.0:1788572086.163989:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584212736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572086.164997:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1788572086.722827:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788572086.788275:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837467 is committed 00000001:00080000:2.0:1788572086.791086:0:188045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 330712481932 is committed 00010000:00010000:3.0:1788572086.795630:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572086.795653:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572086.795663:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572086.795670:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572086.795675:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572086.795684:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572086.795706:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8e5a0a54b000) 00010000:00010000:3.0:1788572086.795709:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572086.795715:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572086.795722:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0600/0x265cfe11109bcf26 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572086.900375:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572086.900417:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569452800 00000100:00100000:1.0:1788572086.900431:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569452800 00000100:00080000:2.0:1788572086.900513:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572086.900546:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 872 00000100:00100000:2.0:1788572086.900566:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+8:157604:x1875444569452800:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572086.900597:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572086.900799:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcf34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1ec expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572086.900888:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bcf3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572086.900928:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bcf3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572086.900950:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bcf3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572086.901011:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572086.901017:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572086.901044:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bcf3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572086.901076:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0c00/0x265cfe11109bcf34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1ec expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572086.901097:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bcf3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1ec expref: 9 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572086.901107:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a54b900) 00010000:00010000:2.0:1788572086.901110:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572086.901115:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1400, rc 0) 00000100:00100000:2.0:1788572086.903886:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:157604:x1875444569452800:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3306us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572086.903903:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 872 00000100:00100000:2.0:1788572086.911443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572086.911566:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569452928 00000100:00100000:3.0:1788572086.911581:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569452928 00000100:00100000:3.0:1788572086.911675:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 873 00000100:00100000:3.0:1788572086.911688:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:157604:x1875444569452928:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572086.911749:0:188833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:3.0:1788572086.911851:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:157604:x1875444569452928:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 164us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572086.911859:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 873 00000100:00100000:0.0:1788572086.919722:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572086.920112:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569453056 00000100:00100000:1.0:1788572086.920124:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569453056 00000100:00100000:1.0:1788572086.920293:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 874 00000100:00100000:1.0:1788572086.920307:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:157604:x1875444569453056:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:1.0:1788572086.920372:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:1.0:1788572086.920468:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:157604:x1875444569453056:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 163us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572086.920501:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 874 00000100:00080000:0.0:1788572086.920861:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572086.926827:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572086.926879:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569453184 00000100:00100000:0.0:1788572086.926891:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569453184 00000100:00100000:0.0:1788572086.926978:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6169 00000100:00100000:0.0:1788572086.926990:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:157604:x1875444569453184:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572086.927033:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572086.927114:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:157604:x1875444569453184:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 126us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572086.927122:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6169 00000100:00080000:0.0:1788572086.927148:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572086.930138:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572086.930231:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569453312 00000100:00100000:0.0:1788572086.930245:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569453312 00000100:00100000:0.0:1788572086.930339:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6170 00000100:00100000:0.0:1788572086.930365:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:157604:x1875444569453312:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572086.930412:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572086.930537:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:157604:x1875444569453312:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 187us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572086.930546:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6170 00000100:00080000:1.0:1788572086.930951:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572087.004574:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572087.004708:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569453568 00000100:00100000:3.0:1788572087.004721:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569453568 00000100:00100000:3.0:1788572087.004813:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 875 00000100:00100000:3.0:1788572087.004827:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:157611:x1875444569453568:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00010000:3.0:1788572087.004913:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572087.004950:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bcf3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1ec expref: 9 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.004972:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a54b900) 00010000:00010000:3.0:1788572087.004990:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572087.005090:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005106:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005119:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005134:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005142:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005149:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005692:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005702:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005714:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005721:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572087.005726:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005735:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005746:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590430c200) 00010000:00010000:3.0:1788572087.005750:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572087.005754:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005761:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf42 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572087.005778:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc3d9146 reply state 00000000d5e4b685 transno 330712481933 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005790:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.005797:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590430c700) 00010000:00010000:3.0:1788572087.005799:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572087.005802:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572087.007462:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+10:157611:x1875444569453568:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 2627us (2893us total) trans 330712481933 rc 0/0 00000100:00100000:3.0:1788572087.007474:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 875 00000100:00100000:3.0:1788572087.027151:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572087.031188:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569453696 00000100:00100000:1.0:1788572087.031210:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569453696 00000100:00100000:1.0:1788572087.031290:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 876 00000100:00100000:1.0:1788572087.031303:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+10:157614:x1875444569453696:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572087.031334:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572087.031379:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1f3 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.031465:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcf57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.031496:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcf57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.031516:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcf57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572087.031577:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572087.031581:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572087.031608:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcf57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.031648:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1f3 expref: 12 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.032032:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcf57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1f3 expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.032043:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a1fbf4900) 00010000:00010000:1.0:1788572087.032046:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572087.032051:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3c00, rc 0) 00000100:00100000:1.0:1788572087.032190:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:157614:x1875444569453696:12345-192.168.202.57@tcp:101:rm.0 Request processed in 889us (5052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572087.032199:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 876 00000100:00100000:3.0:1788572087.045345:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572087.045449:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569453824 00000100:00100000:0.0:1788572087.045462:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569453824 00000100:00100000:3.0:1788572087.045983:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 877 00000100:00100000:3.0:1788572087.045999:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:157614:x1875444569453824:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572087.046025:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572087.046052:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1fa expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046135:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046154:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046180:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046196:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046204:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046212:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046325:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030c00/0x265cfe11109bcf73 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046333:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030c00/0x265cfe11109bcf73 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046346:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030c00/0x265cfe11109bcf73 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572087.046400:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x203e:0x0]: returning size 0 00000004:00200000:3.0:1788572087.046405:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572087.046429:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030c00/0x265cfe11109bcf73 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046443:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030c00/0x265cfe11109bcf73 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046452:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046459:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046467:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046473:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572087.046651:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046672:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046687:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a1fbf4900) 00010000:00010000:3.0:1788572087.046690:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572087.046696:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046708:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bcf65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046722:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046728:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046735:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046740:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572087.046743:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046750:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046757:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590430c700) 00010000:00010000:3.0:1788572087.046760:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572087.046763:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046769:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bcf6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046968:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bcf5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1fa expref: 13 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.046991:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030c00/0x265cfe11109bcf73 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1fa expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.047000:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203e:0x0].0x0 (ffff8e590430c200) 00010000:00010000:3.0:1788572087.047002:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572087.047006:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00030c00, rc 0) 00000100:00100000:3.0:1788572087.047145:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:157614:x1875444569453824:12345-192.168.202.57@tcp:101:rm.0 Request processed in 1150us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572087.047154:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 877 00000100:00100000:0.0:1788572087.051151:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572087.051448:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569454080 00000100:00100000:1.0:1788572087.051461:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569454080 00000100:00100000:1.0:1788572087.051670:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 878 00000100:00100000:1.0:1788572087.051684:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:157614:x1875444569454080:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572087.051760:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788572087.051792:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030c00/0x265cfe11109bcf73 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1fa expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.051825:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203e:0x0].0x0 (ffff8e590430c200) 00010000:00010000:1.0:1788572087.052119:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3c00/0x265cfe11109bcf57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1f3 expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.053108:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a1fbf4900) 00010000:00010000:1.0:1788572087.053124:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572087.053155:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.053170:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.053182:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.053194:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.053201:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.053207:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.053329:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.053337:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.053345:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054230:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054250:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054259:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054268:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054275:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054282:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054355:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572087.054386:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054393:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054401:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054407:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572087.054413:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054421:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054433:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203e:0x0].0x0 (ffff8e5a1fbf4000) 00010000:00010000:1.0:1788572087.054436:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572087.054442:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054448:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bcf88 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054470:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054475:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.054573:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572087.054581:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.054587:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572087.054591:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.054597:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.054606:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203e:0x0].0x0 (ffff8e5a1fbf4000) 00010000:00010000:2.0:1788572087.054619:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572087.054624:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.054630:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2e00/0x265cfe11109bcf8f lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.054646:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572087.054648:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572087.054650:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572087.054698:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054703:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572087.054707:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054719:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054728:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a1fbf4300) 00010000:00010000:1.0:1788572087.054730:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572087.054734:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054739:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bcf7a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572087.054899:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cfd0ca0 reply state 00000000b1ec4060 transno 330712481934 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054914:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.054921:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590430c700) 00010000:00010000:1.0:1788572087.054923:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572087.054927:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572087.055094:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:157614:x1875444569454080:12345-192.168.202.57@tcp:36:rm.0 Request processed in 3406us (3950us total) trans 330712481934 rc 0/0 00000100:00100000:1.0:1788572087.055104:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 878 00010000:00010000:1.0:1788572087.749717:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572088.767556:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572089.199741:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572089.199852:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572089.199888:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572089.199911:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572089.199963:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569454592 00000100:00100000:1.0:1788572089.199976:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569454592 00000100:00100000:1.0:1788572089.200059:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7522 00000100:00100000:1.0:1788572089.200072:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569454592:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572089.200170:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569454592:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 101us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572089.200179:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7522 00000100:00080000:1.0:1788572089.200205:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572089.205708:0:188063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569454208 00000100:00100000:1.0:1788572089.205732:0:188063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569454208 00000100:00100000:1.0:1788572089.205827:0:188063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 102 00000100:00100000:1.0:1788572089.205839:0:188063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569454208:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572089.205947:0:188063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569454208:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 109us (6056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572089.205956:0:188063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 102 00000100:00100000:0.0:1788572089.208154:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572089.208187:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569454720 00000100:00100000:0.0:1788572089.208196:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569454720 00000100:00100000:0.0:1788572089.208252:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7523 00000100:00100000:0.0:1788572089.208262:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2397:x1875444569454720:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572089.208350:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2397:x1875444569454720:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 90us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572089.208358:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7523 00000100:00080000:0.0:1788572089.208385:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572089.217104:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569454336 00000100:00100000:3.0:1788572089.217124:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569454336 00000100:00080000:3.0:1788572089.217418:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572089.217507:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569454464 00000100:00100000:3.0:1788572089.217511:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569454464 00000100:00100000:3.0:1788572089.217562:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 55 00000100:00100000:3.0:1788572089.217576:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2397:x1875444569454336:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572089.217616:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fbb7800 x1875444569454336/t0(0) o400->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:505/0 lens 224/224 e 0 to 0 dl 1788572100 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572089.217708:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2397:x1875444569454336:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 136us (17982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572089.217717:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 55 00000100:00100000:3.0:1788572089.217740:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 56 00000100:00100000:3.0:1788572089.217747:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569454464:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572089.217773:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569454464:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 28us (17861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572089.217780:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 56 00000100:00080000:3.0:1788572089.217816:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572089.218927:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584214016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572089.219002:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572089.219948:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584214016 00000100:00100000:3.0:1788572089.219964:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584214016 00000100:00100000:3.0:1788572089.220161:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788572089.220175:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584214016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572089.220232:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:3.0:1788572089.221439:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584214016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1256us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572089.221453:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788572089.221556:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837467 gen 2 00000004:00080000:3.0:1788572089.221564:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837441 committed transno 21474837467 00000004:00080000:3.0:1788572089.221588:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837442 committed transno 21474837467 00000004:00080000:3.0:1788572089.221602:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837443 committed transno 21474837467 00000004:00080000:3.0:1788572089.221612:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837444 committed transno 21474837467 00000004:00080000:3.0:1788572089.221620:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837445 committed transno 21474837467 00000004:00080000:3.0:1788572089.221630:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837446 committed transno 21474837467 00000004:00080000:3.0:1788572089.221639:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837447 committed transno 21474837467 00000004:00080000:3.0:1788572089.221653:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837448 committed transno 21474837467 00000004:00080000:3.0:1788572089.221665:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837449 committed transno 21474837467 00000004:00080000:3.0:1788572089.221673:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837450 committed transno 21474837467 00000004:00080000:3.0:1788572089.221683:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837451 committed transno 21474837467 00000004:00080000:3.0:1788572089.221698:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837452 committed transno 21474837467 00000004:00080000:3.0:1788572089.221708:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837453 committed transno 21474837467 00000004:00080000:3.0:1788572089.221720:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837454 committed transno 21474837467 00000004:00080000:3.0:1788572089.221732:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837455 committed transno 21474837467 00000004:00080000:3.0:1788572089.221743:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837456 committed transno 21474837467 00000004:00080000:3.0:1788572089.222341:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837457 committed transno 21474837467 00000004:00080000:3.0:1788572089.222367:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837458 committed transno 21474837467 00000004:00080000:3.0:1788572089.222377:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837459 committed transno 21474837467 00000004:00080000:3.0:1788572089.222386:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837460 committed transno 21474837467 00000004:00080000:3.0:1788572089.222397:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837461 committed transno 21474837467 00000004:00080000:3.0:1788572089.222408:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837462 committed transno 21474837467 00000004:00080000:3.0:1788572089.222419:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837463 committed transno 21474837467 00000004:00080000:3.0:1788572089.222427:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837464 committed transno 21474837467 00000004:00080000:3.0:1788572089.222437:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837465 committed transno 21474837467 00000004:00080000:3.0:1788572089.222446:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837466 committed transno 21474837467 00000004:00080000:3.0:1788572089.222456:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837467 committed transno 21474837467 00000100:00100000:3.0:1788572089.222507:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584214016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572089.224454:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572089.224493:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584214144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572089.224587:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572089.224655:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584214144 00000100:00100000:3.0:1788572089.224664:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584214144 00000100:00100000:3.0:1788572089.225152:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6171 00000100:00100000:3.0:1788572089.225163:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584214144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572089.225203:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572089.225347:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584214144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 184us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572089.225355:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6171 00000100:00100000:3.0:1788572089.225422:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584214144:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572089.225451:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572089.237339:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584214272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572089.237453:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572089.237605:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584214272 00000100:00100000:3.0:1788572089.237615:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584214272 00000100:00100000:3.0:1788572089.237685:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6172 00000100:00100000:3.0:1788572089.237694:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584214272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572089.237734:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572089.237804:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584214272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572089.237813:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6172 00000100:00100000:3.0:1788572089.237878:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584214272:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572089.237910:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572089.724846:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572089.724877:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584214400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572089.724970:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572089.725042:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584214400 00000100:00100000:2.0:1788572089.725051:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584214400 00000100:00100000:0.0:1788572089.725279:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572089.725288:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584214528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572089.725318:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572089.725346:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584214528 00000100:00100000:0.0:1788572089.725349:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584214528 00000100:00100000:2.0:1788572089.725420:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6173 00000100:00100000:2.0:1788572089.725431:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584214400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572089.725461:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572089.725532:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584214400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572089.725539:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6173 00000100:00100000:2.0:1788572089.727592:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572089.727620:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584214656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572089.727705:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572089.734728:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572089.734743:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572089.735302:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6174 00000100:00100000:0.0:1788572089.735321:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584214528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572089.735361:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572089.735474:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584214528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (10154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572089.735514:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6174 00000100:00100000:0.0:1788572089.735553:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584214656 00000100:00100000:0.0:1788572089.735563:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584214656 00000100:00100000:0.0:1788572089.735601:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788572089.735609:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584214656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572089.735641:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00010000:00000080:0.0:1788572089.735656:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffaf100 x1875444584214656/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:505/0 lens 224/368 e 0 to 0 dl 1788572100 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572089.735711:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584214656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (8006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572089.735719:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788572089.735785:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584214528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572089.735855:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584214400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572089.735888:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584214656:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572089.788753:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572090.815519:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572091.269080:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584214784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269178:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269225:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584215296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269252:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269269:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584215808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269288:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269302:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584216320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269319:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269343:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572091.269348:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584215168:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269365:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269391:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584215680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269419:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269436:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584216192:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269471:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269534:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584214912:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269559:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269569:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584215424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269589:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269603:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584215936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269624:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269643:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572091.269648:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584215040:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269680:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584215552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269701:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269717:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584216064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269740:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572091.269789:0:188064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584214784 00000100:00100000:0.0:1788572091.269798:0:188064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584214784 00000100:00100000:0.0:1788572091.269855:0:188064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788572091.269865:0:188064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584214784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.269924:0:188064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584214784:12345-0@lo:400:kworker.0 Request processed in 61us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572091.269932:0:188064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788572091.269972:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584215296 00000100:00100000:0.0:1788572091.269975:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584215296 00000100:00100000:0.0:1788572091.270006:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584215808 00000100:00100000:0.0:1788572091.270008:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584215808 00000100:00100000:0.0:1788572091.270018:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584216320 00000100:00100000:0.0:1788572091.270020:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584216320 00000100:00100000:0.0:1788572091.270029:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584215168 00000100:00100000:0.0:1788572091.270032:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584215168 00000100:00100000:0.0:1788572091.270042:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584214912 00000100:00100000:0.0:1788572091.270044:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584214912 00000100:00100000:0.0:1788572091.270055:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584215040 00000100:00100000:0.0:1788572091.270057:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584215040 00000100:00100000:0.0:1788572091.270069:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788572091.270075:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584215296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270107:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584215296:12345-0@lo:400:kworker.0 Request processed in 33us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572091.270114:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788572091.270126:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788572091.270131:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584215808:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572091.270145:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a9d180 x1875444584215808/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:507/0 lens 224/224 e 0 to 0 dl 1788572102 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572091.270175:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584215808:12345-0@lo:400:kworker.0 Request processed in 43us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572091.270180:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788572091.270192:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788572091.270198:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584216320:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572091.270207:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ea8e00 x1875444584216320/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:507/0 lens 224/224 e 0 to 0 dl 1788572102 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572091.270229:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584216320:12345-0@lo:400:kworker.0 Request processed in 33us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572091.270239:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788572091.270247:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572091.270252:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584215168:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572091.270260:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ea9f80 x1875444584215168/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:507/0 lens 224/224 e 0 to 0 dl 1788572102 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572091.270279:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584215168:12345-0@lo:400:kworker.0 Request processed in 28us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572091.270285:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572091.270293:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788572091.270298:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584214912:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572091.270306:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ea9500 x1875444584214912/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:507/0 lens 224/224 e 0 to 0 dl 1788572102 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572091.270330:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584214912:12345-0@lo:400:kworker.0 Request processed in 32us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572091.270335:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788572091.270344:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572091.270349:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584215040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270368:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584215040:12345-0@lo:400:kworker.0 Request processed in 20us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572091.270373:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572091.270396:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584215424 00000100:00100000:0.0:1788572091.270400:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584215424 00000100:00100000:0.0:1788572091.270423:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584215936 00000100:00100000:0.0:1788572091.270426:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584215936 00000100:00100000:0.0:1788572091.270438:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788572091.270456:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584215424:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572091.270473:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31c82680 x1875444584215424/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:507/0 lens 224/224 e 0 to 0 dl 1788572102 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572091.270532:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584215424:12345-0@lo:400:kworker.0 Request processed in 77us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572091.270538:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788572091.270549:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788572091.270554:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584215936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270580:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584215936:12345-0@lo:400:kworker.0 Request processed in 26us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572091.270586:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788572091.270635:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584215040:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270650:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584214912:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270661:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584215424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270670:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584215936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270710:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584215168:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270721:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584214784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270731:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584215296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584215808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572091.270749:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584216320:0@lo:400:kworker.0 00000100:00080000:1.0:1788572091.272015:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572091.272024:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572091.275893:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584215680 00000100:00100000:2.0:1788572091.275916:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584215680 00000100:00080000:0.0:1788572091.276152:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572091.276249:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584216192 00000100:00100000:2.0:1788572091.276254:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584216192 00000100:00100000:2.0:1788572091.276654:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584215552 00000100:00100000:2.0:1788572091.276659:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584215552 00000100:00080000:0.0:1788572091.276753:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572091.276757:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572091.276816:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584216064 00000100:00100000:2.0:1788572091.276820:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584216064 00000100:00100000:2.0:1788572091.276849:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7524 00000100:00100000:2.0:1788572091.276861:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584215680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572091.276989:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584215680:12345-0@lo:400:kworker.0 Request processed in 130us (7567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572091.276998:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7524 00000100:00080000:0.0:1788572091.281196:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572091.284415:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7525 00000100:00100000:1.0:1788572091.285296:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584216192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572091.285406:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584216192:12345-0@lo:400:kworker.0 Request processed in 976us (15934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572091.285417:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7525 00000100:00100000:1.0:1788572091.285467:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7526 00000100:00100000:1.0:1788572091.285475:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584215552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572091.285543:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584215552:12345-0@lo:400:kworker.0 Request processed in 68us (15841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572091.285549:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7526 00000100:00100000:1.0:1788572091.285565:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7527 00000100:00100000:1.0:1788572091.285572:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584216064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572091.285604:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584216064:12345-0@lo:400:kworker.0 Request processed in 33us (15864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572091.285611:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7527 00000100:00100000:1.0:1788572091.287524:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584215552:0@lo:400:kworker.0 00000100:00100000:1.0:1788572091.287551:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584216064:0@lo:400:kworker.0 00000100:00100000:2.0:1788572091.287735:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584215680:0@lo:400:kworker.0 00000100:00100000:2.0:1788572091.287753:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584216192:0@lo:400:kworker.0 00010000:00010000:3.0:1788572091.837117:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572092.860737:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572093.896171:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788572094.266991:0:188045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 330712481934 is committed 00010000:00010000:3.0:1788572094.273710:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.273733:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.273743:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.273751:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572094.273758:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.273768:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.273808:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590430c700) 00010000:00010000:3.0:1788572094.274040:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572094.274048:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.274057:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bcf49 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.274264:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.274273:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.274280:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.274285:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572094.274289:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.274295:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.274306:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590430c700) 00010000:00010000:3.0:1788572094.274309:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572094.274312:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572094.274318:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109bcf81 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572094.318289:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572094.318346:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572094.318367:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572094.318397:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572094.318422:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572094.318451:0:188065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569454848 00000100:00100000:0.0:1788572094.318463:0:188065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569454848 00000100:00100000:0.0:1788572094.318543:0:188065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 104 00000100:00100000:1.0:1788572094.318548:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569454976 00000100:00100000:1.0:1788572094.318556:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569454976 00000100:00100000:1.0:1788572094.318609:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569455104 00000100:00100000:1.0:1788572094.318613:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569455104 00000100:00100000:1.0:1788572094.318644:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 63 00000100:00100000:1.0:1788572094.318652:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+8:2400:x1875444569454976:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572094.318689:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729d500 x1875444569454976/t0(0) o400->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:510/0 lens 224/224 e 0 to 0 dl 1788572105 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572094.318754:0:188065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569454848:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572094.318767:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+8:2400:x1875444569454976:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 114us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572094.318776:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 63 00000100:00100000:0.0:1788572094.318797:0:188065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569454848:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 39us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572094.318802:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 64 00000100:00100000:1.0:1788572094.318815:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569455104:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572094.318816:0:188065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 104 00000100:00100000:1.0:1788572094.318857:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569455104:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 44us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572094.318865:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 64 00000100:00100000:0.0:1788572094.318867:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569455232 00000100:00100000:0.0:1788572094.318872:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569455232 00000100:00100000:0.0:1788572094.318911:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569455360 00000100:00100000:0.0:1788572094.318915:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569455360 00000100:00100000:0.0:1788572094.318942:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7528 00000100:00100000:0.0:1788572094.318951:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2400:x1875444569455232:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572094.318981:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2400:x1875444569455232:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572094.318988:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7528 00000100:00100000:0.0:1788572094.319000:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7529 00000100:00100000:0.0:1788572094.319006:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569455360:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572094.319031:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569455360:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572094.319037:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7529 00000100:00080000:0.0:1788572094.319209:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572094.319215:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572094.319218:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572094.319220:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572094.333186:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584216448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572094.333944:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572094.334050:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572094.334059:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584216576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572094.334108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572094.334218:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572094.334234:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584216704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572094.334272:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572094.336827:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584216704 00000100:00100000:0.0:1788572094.336848:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584216704 00000100:00100000:0.0:1788572094.336922:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788572094.336934:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584216704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572094.336990:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:0.0:1788572094.337208:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584216704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 275us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572094.337216:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788572094.337431:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584216704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572094.337749:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584216448 00000100:00100000:2.0:1788572094.337756:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584216448 00000100:00080000:0.0:1788572094.337856:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572094.338250:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584216576 00000100:00100000:3.0:1788572094.342536:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584216576 00000100:00100000:3.0:1788572094.343171:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6175 00000100:00100000:3.0:1788572094.343184:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584216448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572094.343230:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572094.343766:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584216448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 582us (9823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572094.343776:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6175 00000100:00100000:3.0:1788572094.344146:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6176 00000100:00100000:3.0:1788572094.344158:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584216576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572094.344184:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572094.344226:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584216576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (10117us total) trans 0 rc 0/0 00000100:00080000:0.0:1788572094.344425:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572094.344902:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6176 00000100:00100000:3.0:1788572094.344991:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584216576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572094.345012:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584216448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572094.845427:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584216832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572094.845431:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584216960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572094.845440:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584217088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572094.848297:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572094.848612:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584216960 00000100:00100000:3.0:1788572094.848624:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584216960 00000100:00100000:3.0:1788572094.848717:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6177 00000100:00100000:3.0:1788572094.848730:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584216960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572094.848764:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572094.849090:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584216960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 362us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572094.849099:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6177 00000100:00080000:3.0:1788572094.849129:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572094.849176:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584216960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572094.850351:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572094.850466:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584217088 00000100:00100000:3.0:1788572094.850476:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584217088 00000100:00100000:3.0:1788572094.850617:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6178 00000100:00100000:3.0:1788572094.850629:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584217088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572094.850657:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572094.855893:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584217088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5250us (5534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572094.855914:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6178 00000100:00080000:3.0:1788572094.855970:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572094.859629:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584217088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572094.865501:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572094.867046:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584216832 00000100:00100000:0.0:1788572094.867070:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584216832 00000100:00100000:0.0:1788572094.867157:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788572094.867170:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584216832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572094.867226:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00010000:00000080:0.0:1788572094.867248:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028ed880 x1875444584216832/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:510/0 lens 224/368 e 0 to 0 dl 1788572105 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572094.867355:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584216832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 188us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572094.867364:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788572094.867541:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584216832:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572094.908785:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572095.700079:0:189728:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:3.0:1788572095.933928:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572096.381158:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584217472:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.381262:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572096.381305:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584217984:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.381333:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572096.381352:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584218496:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.381374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572096.381404:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572096.381410:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584217600:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.381431:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572096.381447:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584218112:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.381468:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572096.381513:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584218624:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.381537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572096.381571:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584217472 00000100:00100000:0.0:1788572096.381580:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584217472 00000100:00100000:0.0:1788572096.381647:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584217600 00000100:00100000:0.0:1788572096.381651:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584217600 00000100:00100000:0.0:1788572096.381675:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788572096.381686:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584217472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.381744:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584217472:12345-0@lo:400:kworker.0 Request processed in 60us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572096.381751:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788572096.381771:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788572096.381777:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584217600:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572096.381791:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1f8ff800 x1875444584217600/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:512/0 lens 224/224 e 0 to 0 dl 1788572107 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572096.381816:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584217600:12345-0@lo:400:kworker.0 Request processed in 40us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572096.381822:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788572096.381848:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584217984 00000100:00100000:0.0:1788572096.381851:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584217984 00000100:00100000:0.0:1788572096.381873:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584218496 00000100:00100000:0.0:1788572096.381875:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584218496 00000100:00100000:0.0:1788572096.381888:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584218112 00000100:00100000:0.0:1788572096.381891:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584218112 00000100:00100000:0.0:1788572096.381906:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584218624 00000100:00100000:0.0:1788572096.381908:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584218624 00000100:00100000:0.0:1788572096.381925:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7530 00000100:00100000:0.0:1788572096.381930:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584217984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.381959:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584217984:12345-0@lo:400:kworker.0 Request processed in 29us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572096.381965:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7530 00000100:00100000:0.0:1788572096.381978:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7531 00000100:00100000:0.0:1788572096.381984:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584218496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.382009:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584218496:12345-0@lo:400:kworker.0 Request processed in 25us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572096.382015:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7531 00000100:00100000:0.0:1788572096.382027:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7532 00000100:00100000:0.0:1788572096.382033:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584218112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.382059:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584218112:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572096.382065:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7532 00000100:00100000:0.0:1788572096.382077:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7533 00000100:00100000:0.0:1788572096.382083:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584218624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.382106:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584218624:12345-0@lo:400:kworker.0 Request processed in 24us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572096.382112:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7533 00000100:00080000:0.0:1788572096.382132:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572096.382136:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572096.382139:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572096.382142:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572096.382178:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584217600:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.382188:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584218112:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.382196:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584218624:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.382204:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584217472:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.382212:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584217984:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.382219:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584218496:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.382363:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584217216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.382405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572096.382446:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584217728:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.382473:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572096.382517:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584218240:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.382540:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572096.382558:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584218752:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.382580:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572096.382596:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572096.382602:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584217344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.382625:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572096.382637:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584217856:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.382662:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572096.382682:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584218368:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.382709:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572096.382739:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584217728 00000100:00100000:1.0:1788572096.382744:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584217728 00000100:00100000:1.0:1788572096.382777:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584218240 00000100:00100000:1.0:1788572096.382780:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584218240 00000100:00100000:1.0:1788572096.382791:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584218752 00000100:00100000:1.0:1788572096.382793:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584218752 00000100:00100000:1.0:1788572096.382802:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584217344 00000100:00100000:1.0:1788572096.382804:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584217344 00000100:00100000:1.0:1788572096.382819:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788572096.382825:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584217728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.382862:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584217728:12345-0@lo:400:kworker.0 Request processed in 37us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572096.382869:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788572096.382882:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788572096.382887:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584218240:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572096.382898:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028edf80 x1875444584218240/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:512/0 lens 224/224 e 0 to 0 dl 1788572107 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572096.382923:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584218240:12345-0@lo:400:kworker.0 Request processed in 36us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572096.382929:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788572096.382940:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788572096.382946:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584218752:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572096.382956:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028ee680 x1875444584218752/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:512/0 lens 224/224 e 0 to 0 dl 1788572107 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572096.382980:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584218752:12345-0@lo:400:kworker.0 Request processed in 35us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572096.382986:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788572096.382997:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788572096.383002:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584217344:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572096.383012:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028ec700 x1875444584217344/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:512/0 lens 224/224 e 0 to 0 dl 1788572107 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572096.383036:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584217344:12345-0@lo:400:kworker.0 Request processed in 35us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572096.383047:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788572096.383098:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584217856 00000100:00100000:1.0:1788572096.383103:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584217856 00000100:00100000:1.0:1788572096.383125:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584218368 00000100:00100000:1.0:1788572096.383127:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584218368 00000100:00100000:1.0:1788572096.383137:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788572096.383142:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584217856:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572096.383156:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028ec380 x1875444584217856/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:512/0 lens 224/224 e 0 to 0 dl 1788572107 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572096.383182:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584217856:12345-0@lo:400:kworker.0 Request processed in 41us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572096.383188:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788572096.383199:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788572096.383204:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a70050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584218368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.383230:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a70050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584218368:12345-0@lo:400:kworker.0 Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572096.383236:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1788572096.383554:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572096.383560:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572096.383596:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584217344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.383609:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584217856:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.383618:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584218368:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.383627:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584217728:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.383637:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584218240:0@lo:400:kworker.0 00000100:00100000:1.0:1788572096.383647:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584218752:0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.383927:0:188063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584217216 00000100:00100000:0.0:1788572096.383934:0:188063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584217216 00000100:00100000:0.0:1788572096.383979:0:188063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788572096.383988:0:188063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584217216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572096.384046:0:188063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584217216:12345-0@lo:400:kworker.0 Request processed in 60us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572096.384053:0:188063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788572096.384103:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584217216:0@lo:400:kworker.0 00010000:00010000:3.0:1788572096.962309:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572097.986404:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572099.004795:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572099.440880:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572099.440916:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572099.440942:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572099.440960:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572099.440999:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572099.441028:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569455616 00000100:00100000:0.0:1788572099.441037:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569455616 00000100:00100000:0.0:1788572099.441091:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569455744 00000100:00100000:0.0:1788572099.441094:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569455744 00000100:00100000:0.0:1788572099.441127:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 71 00000100:00100000:0.0:1788572099.441138:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+8:2399:x1875444569455616:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:0.0:1788572099.441168:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1f8fd500 x1875444569455616/t0(0) o400->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:515/0 lens 224/224 e 0 to 0 dl 1788572110 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572099.441228:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+8:2399:x1875444569455616:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 92us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572099.441246:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 71 00000100:00100000:0.0:1788572099.441265:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 72 00000100:00100000:0.0:1788572099.441272:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569455744:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572099.441297:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569455744:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572099.441304:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 72 00000100:00100000:0.0:1788572099.441319:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569455872 00000100:00100000:0.0:1788572099.441323:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569455872 00000100:00100000:0.0:1788572099.441347:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569456000 00000100:00100000:0.0:1788572099.441349:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569456000 00000100:00100000:0.0:1788572099.441370:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7534 00000100:00100000:0.0:1788572099.441377:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569455872:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572099.441402:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569455872:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572099.441408:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7534 00000100:00100000:0.0:1788572099.441418:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7535 00000100:00100000:0.0:1788572099.441424:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569456000:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572099.441445:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569456000:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 21us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572099.441452:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7535 00000100:00100000:0.0:1788572099.441470:0:188064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569455488 00000100:00100000:0.0:1788572099.441473:0:188064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569455488 00000100:00100000:0.0:1788572099.441520:0:188064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 106 00000100:00100000:0.0:1788572099.441526:0:188064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569455488:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572099.441548:0:188064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569455488:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 23us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572099.441555:0:188064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 106 00000100:00080000:0.0:1788572099.441599:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572099.441604:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572099.441606:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572099.441608:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572099.454708:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584218880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572099.454786:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572099.455716:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584218880 00000100:00100000:2.0:1788572099.455727:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584218880 00000100:00100000:2.0:1788572099.455791:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6179 00000100:00100000:2.0:1788572099.455800:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584218880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572099.455834:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572099.455896:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584218880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572099.455904:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6179 00000100:00080000:1.0:1788572099.455973:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572099.456017:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584218880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572099.457060:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572099.457075:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584219008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572099.457153:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572099.457348:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584219008 00000100:00100000:3.0:1788572099.457354:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584219008 00000100:00100000:3.0:1788572099.457406:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6180 00000100:00100000:3.0:1788572099.457415:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584219008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572099.457438:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572099.457520:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584219008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572099.457526:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6180 00000100:00100000:3.0:1788572099.457565:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584219008:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572099.457708:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572099.457912:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584219136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572099.457945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572099.458049:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584219136 00000100:00100000:2.0:1788572099.458054:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584219136 00000100:00100000:2.0:1788572099.458089:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788572099.458096:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584219136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572099.458130:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:2.0:1788572099.458172:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584219136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572099.458178:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788572099.458231:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584219136:0@lo:41:osp-pre-1-0.0 00000020:01000004:0.0:1788572099.563750:0:189875:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788572099.563808:0:189875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.563821:0:189875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.563886:0:189875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.563893:0:189875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.563947:0:189875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788572099.563952:0:189875:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788572099.563994:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788572099.563998:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788572099.564003:0:189875:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788572099.564027:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a3717f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788572099.564097:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584219264:0@lo:39:umount.0 00000100:00100000:1.0:1788572099.564181:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572099.564334:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572099.564341:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.564348:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a31ed8c00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572099.564351:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.564359:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572099.564366:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572099.564371:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572099.564373:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788572099.564375:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788572099.564399:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.564404:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788572099.564439:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584219392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572099.564467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572099.564554:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.564561:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8c00/0x265cfe11109b64c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b64cf expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.564577:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572099.564578:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572099.564588:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572099.564649:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584219392 00000100:00100000:3.0:1788572099.564657:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584219392 00000100:00100000:3.0:1788572099.564716:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4634 00000100:00100000:3.0:1788572099.564725:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584219392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572099.564737:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572099.564751:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a31ed8000/0x265cfe11109b64cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b64c8 expref: 24 pid: 188064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.564762:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572099.564956:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584219264 00000100:00100000:0.0:1788572099.564961:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584219264 00000100:00100000:0.0:1788572099.564997:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1788572099.565002:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584219264:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788572099.565024:0:188049:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6585 00000100:00080000:0.0:1788572099.565038:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788572099.565063:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028ed880 x1875444584219264/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:515/0 lens 224/224 e 0 to 0 dl 1788572110 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572099.565100:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875444584219264:12345-0@lo:39:umount.0 Request processed in 97us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572099.565106:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000020:00000080:0.0:1788572099.565146:0:188049:0:(genops.c:885:class_export_put()) final put ffff8e5a08d20000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788572099.565284:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3643:x1875444584219392:12345-0@lo:103:ldlm_bl.0 Request processed in 560us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572099.565290:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4634 00010000:00010000:3.0:1788572099.565310:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572099.565353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584219392:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788572099.565374:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a08d20000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1788572099.565649:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3717f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572099.565696:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584219264:0@lo:39:umount.0 00000020:00000080:1.0:1788572099.565746:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a10ff8800 for lustre-MDT0000 00000100:00080000:3.0:1788572099.565773:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572099.565776:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788572099.565781:0:189875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788572099.567042:0:189875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567057:0:189875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567065:0:189875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567073:0:189875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567097:0:189875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572099.567103:0:189875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567120:0:189875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567128:0:189875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567135:0:189875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567153:0:189875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572099.567159:0:189875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567166:0:189875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567173:0:189875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567180:0:189875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567191:0:189875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788572099.567196:0:189875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567202:0:189875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567213:0:189875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567219:0:189875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572099.567227:0:189875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788572099.567230:0:189875:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788572099.567256:0:189875:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788572099.567260:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788572099.567264:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788572099.567270:0:189875:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1788572099.567989:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572099.567998:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568006:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5a00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572099.568010:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568017:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572099.568024:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572099.568028:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572099.568030:0:10395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788572099.568032:0:10395:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788572099.568065:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568070:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572099.568092:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568098:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5a00/0x265cfe11109b63fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b6404 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568125:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572099.568128:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568134:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5000 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572099.568137:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568143:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572099.568150:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572099.568154:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572099.568156:0:10395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788572099.568158:0:10395:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788572099.568170:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568175:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572099.568191:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568197:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5000/0x265cfe11109b64eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b64f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568205:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572099.568209:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568215:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a31ed9400 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572099.568217:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568224:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572099.568230:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572099.568235:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788572099.568237:0:10395:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788572099.568239:0:10395:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788572099.568250:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568255:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572099.568260:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568266:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9400/0x265cfe11109b64ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b64c1 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568276:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572099.568279:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568284:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5400 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572099.568287:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568294:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572099.568300:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572099.568305:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572099.568307:0:10395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788572099.568308:0:10395:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788572099.568319:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568325:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572099.568330:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568336:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a245f5400/0x265cfe11109b63ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109b63f6 expref: -99 pid: 188032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568344:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572099.568345:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572099.568347:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572099.568354:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572099.568368:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584219520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572099.568429:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572099.568470:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572099.568475:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584219904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572099.568510:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572099.568531:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584219648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572099.568548:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572099.568562:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572099.568565:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584219776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572099.568592:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572099.568621:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584219520 00000100:00100000:2.0:1788572099.568626:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584219520 00000100:00100000:2.0:1788572099.568665:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584219904 00000100:00100000:2.0:1788572099.568669:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584219904 00000100:00100000:2.0:1788572099.568685:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584219648 00000100:00100000:2.0:1788572099.568688:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584219648 00000100:00100000:2.0:1788572099.568698:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584219776 00000100:00100000:2.0:1788572099.568700:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584219776 00000100:00100000:2.0:1788572099.568712:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4635 00000100:00100000:2.0:1788572099.568719:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+26:3644:x1875444584219520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572099.568730:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572099.568742:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a245f4800/0x265cfe11109b6404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b63fd expref: 26 pid: 188065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568754:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572099.568781:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+25:3644:x1875444584219520:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572099.568787:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4635 00000100:00100000:2.0:1788572099.568826:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4636 00000100:00100000:2.0:1788572099.568842:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584219904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572099.568848:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572099.568856:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a245f4400/0x265cfe11109b63f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b63ef expref: 24 pid: 188065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568867:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572099.568884:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3644:x1875444584219904:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572099.568889:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4636 00000100:00100000:2.0:1788572099.568900:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4637 00000100:00100000:2.0:1788572099.568904:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3641:x1875444584219648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572099.568910:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572099.568917:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590d14ac00/0x265cfe11109b64f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b64eb expref: 22 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568924:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572099.568943:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3641:x1875444584219648:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572099.568947:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4637 00000100:00100000:2.0:1788572099.568956:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4638 00000100:00100000:2.0:1788572099.568961:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:3641:x1875444584219776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572099.568967:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572099.568973:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a31ed8600/0x265cfe11109b64c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b64ba expref: 20 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.568980:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572099.568996:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3641:x1875444584219776:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572099.569000:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4638 00000100:00100000:2.0:1788572099.569041:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584219904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572099.569050:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584219520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572099.569070:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584219776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572099.569076:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584219648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572099.569272:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572099.569280:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1788572099.575896:0:189875:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1788572099.576188:0:189875:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788572099.576200:0:189875:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a0efd0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572099.576207:0:189875:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a0efd0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572099.576212:0:189875:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a37179800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572099.576217:0:189875:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a372d9000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 326417519069 stale:0 00000020:00080000:3.0:1788572099.576234:0:189875:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a372df800 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 192.168.202.57@tcp 7 (0 0 2) 0 0 0 0: 0000000000000000 330712481934 stale:0 00000020:00080000:3.0:1788572099.576239:0:189875:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8e590218cd40) has exports, disconnecting them 00000020:00080000:3.0:1788572099.576245:0:189875:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a0efd0000), last request at 1788572096 00000020:00000080:3.0:1788572099.576252:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6593 00000100:00080000:3.0:1788572099.576262:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd1800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572099.576295:0:189875:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a0efd0000): rc 0 00000020:00000080:3.0:1788572099.576297:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a0efd0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788572099.576311:0:189875:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a0efd0800), last request at 1788572096 00000020:00000080:3.0:1788572099.576315:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b658c 00000100:00080000:3.0:1788572099.576320:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd4800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572099.576337:0:189875:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a0efd0800): rc 0 00000020:00000080:3.0:1788572099.576339:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a0efd0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788572099.576343:0:189875:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a37179800), last request at 1788572046 00000020:00000080:3.0:1788572099.576346:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b657e 00000100:00080000:3.0:1788572099.576349:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a3717b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572099.576358:0:189875:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a37179800): rc 0 00000020:00000080:3.0:1788572099.576360:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a37179800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788572099.576364:0:189875:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a372d9000), last request at 1788572040 00000020:00000080:3.0:1788572099.576373:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6443 00010000:00010000:2.0:1788572099.576374:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572099.576382:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572099.576384:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a36c39800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788572099.576419:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788572099.576442:0:189875:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a372d9000): rc 0 00000020:00000080:3.0:1788572099.576445:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a372d9000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1788572099.576450:0:189875:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.57@tcp (ffff8e5a372df800), last request at 1788572099 00000020:00000080:3.0:1788572099.576453:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b643c 00000020:00010000:3.0:1788572099.576459:0:189875:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a372df800: total 4 00000100:00080000:3.0:1788572099.576461:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f02b000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788572099.576511:0:10396:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a372df800: total 4 00010000:00010000:2.0:1788572099.576553:0:10396:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a372df800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788572099.576598:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dc4c00/0x265cfe11109b98d1 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 6 pid: 188130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.576617:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109b98d8 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aecaa expref: 5 pid: 188130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572099.576639:0:10396:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a372df800, canceled 2 locks, left on hash table 0. 00000020:00000080:1.0:1788572099.576893:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efd0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572099.576933:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efd0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572099.576951:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a37179800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572099.576970:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a372d9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572099.576996:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0efd1800 for lustre-MDT0000 00000020:00000080:1.0:1788572099.577004:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0efd4800 for lustre-MDT0000 00000020:00000080:1.0:1788572099.577007:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a3717b000 for lustre-MDT0000 00000020:00000080:1.0:1788572099.577012:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a36c39800 for lustre-MDT0000 00010000:00010000:0.0:1788572099.577400:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572099.577793:0:189875:0:(mdd_object.c:3895:mdd_close()) Object [0x20001a9e3:0x203d:0x0] is retained in orphan list 00000020:00080000:3.0:1788572099.577808:0:189875:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e5a372df800): rc 0 00000004:00000080:3.0:1788572099.577816:0:189875:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaac78146bae0 00000100:00080000:3.0:1788572099.577836:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788572099.577841:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837467 gen 3 00000100:00080000:3.0:1788572099.579007:0:189875:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788572099.579039:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788572099.579120:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584220032:0@lo:39:umount.0 00000100:00100000:0.0:1788572099.579197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572099.579383:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584220032 00000100:00100000:1.0:1788572099.579392:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584220032 00000100:00100000:1.0:1788572099.579451:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788572099.579461:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584220032:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572099.579605:0:188053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6340 00000100:00080000:1.0:1788572099.579627:0:188053:0:(import.c:65:import_set_state_nolock()) ffff8e5906754800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572099.579648:0:188053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474837467 00010000:00010000:3.0:1788572099.579879:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572099.580037:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3640:x1875444584220032:12345-0@lo:39:umount.0 Request processed in 576us (837us total) trans 21474837468 rc 0/0 00000100:00100000:1.0:1788572099.580045:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:3.0:1788572099.580280:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788572099.580285:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738467 gen 3 00000004:00080000:3.0:1788572099.580306:0:189875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788572099.580607:0:189875:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788572099.580624:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788572099.580634:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788572099.580636:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975673 gen 3 00000004:00080000:3.0:1788572099.580647:0:189875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788572099.580766:0:189875:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788572099.580778:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffe800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788572099.580821:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e590218cd40) has no exports 00000040:00080000:3.0:1788572099.581355:0:189875:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 7, last_idx 9 00000040:00080000:3.0:1788572099.581395:0:189875:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 8, last_idx 9 00000020:00080000:3.0:1788572099.581841:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e590218cd40) has no exports 00000100:00080000:0.0:1788572099.586870:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572099.586889:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584220032:0@lo:39:umount.0 00000100:00100000:0.0:1788572099.586919:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584220160:0@lo:9:umount.0 00000100:00100000:0.0:1788572099.586991:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572099.587037:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584220288:0@lo:9:umount.0 00000100:00100000:0.0:1788572099.587060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572099.587128:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584220160 00000100:00100000:0.0:1788572099.587134:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584220160 00000100:00100000:0.0:1788572099.587186:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584220288 00000100:00100000:0.0:1788572099.587190:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584220288 00000100:00100000:0.0:1788572099.587216:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22589 00000100:00100000:0.0:1788572099.587224:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584220160:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788572099.587258:0:177558:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6497 00000100:00080000:0.0:1788572099.587266:0:177558:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572099.587308:0:177558:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738467 00000100:00100000:0.0:1788572099.587468:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+2:3640:x1875444584220160:12345-0@lo:9:umount.0 Request processed in 243us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572099.587475:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22589 00000100:00100000:1.0:1788572099.590771:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22590 00000100:00100000:1.0:1788572099.590798:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584220288:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788572099.590834:0:43917:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b64a5 00000100:00080000:1.0:1788572099.590844:0:43917:0:(import.c:65:import_set_state_nolock()) ffff8e5a109d3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572099.590910:0:43917:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975673 00000100:00100000:1.0:1788572099.591107:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3640:x1875444584220288:12345-0@lo:9:umount.0 Request processed in 323us (4044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572099.591128:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22590 00010000:00010000:1.0:1788572099.591170:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572099.596808:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572099.596819:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572099.596875:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788572099.596899:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788572099.596902:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572099.596909:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584220160:0@lo:9:umount.0 00000100:00080000:0.0:1788572099.596926:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffe800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788572099.596938:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788572099.596940:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572099.596943:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584220288:0@lo:9:umount.0 00010000:00010000:0.0:1788572099.600910:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572099.625423:0:10396:0:(genops.c:885:class_export_put()) final put ffff8e5a372df800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:0.0:1788572099.625566:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a372df800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d for lustre-MDT0000 00000020:00000080:1.0:1788572099.626402:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f02b000 for lustre-MDT0000 00010000:00010000:2.0:1788572099.626558:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572099.626562:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572099.626565:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788572099.694003:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6458 00000020:00000080:3.0:1788572099.694022:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5903a23000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788572099.694043:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788572099.694173:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572099.694186:0:189875:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788572099.694191:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8e5a413fcd40) has no exports 00000020:00000080:0.0:1788572099.695262:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6451 00000020:00000080:0.0:1788572099.695270:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a08d26800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572099.695312:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572099.695323:0:189875:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788572099.695607:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a23000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788572099.695614:0:177620:0:(genops.c:885:class_export_put()) final put ffff8e5a08d22800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788572099.695616:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a08d22800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788572099.695621:0:177620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788572099.695792:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a08d26800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788572099.695890:0:189875:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5904c21060 - data ffff8e5a0885b870/ffff8e590cc22800 00000020:01000000:2.0:1788572099.696024:0:189875:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a07d15300 - data ffff8e5a0f5b8bd0/ffff8e5a40da8000 00000100:00080000:2.0:1788572099.778364:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788572099.778376:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837467 gen 4 00000100:00100000:2.0:1788572099.778396:0:189875:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e5a36ef9f80 x1875444584220032/t21474837468(21474837468) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572109 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572099.778427:0:189875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788572099.781874:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788572099.781883:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738467 gen 4 00000004:00080000:2.0:1788572099.781903:0:189875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572099.781906:0:189875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788572099.782124:0:188111:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788572099.782129:0:188111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x134:0x0] index 1 count 1 00000040:00080000:1.0:1788572099.782138:0:188111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 77 count 2 00000100:00080000:2.0:1788572099.782825:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788572099.782829:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975673 gen 4 00000004:00080000:2.0:1788572099.782837:0:189875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572099.782838:0:189875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788572099.783199:0:188113:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788572099.783203:0:188113:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x136:0x0] index 1 count 1 00000040:00080000:0.0:1788572099.783215:0:188113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 77 count 2 00000020:00000080:1.0:1788572099.787912:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6412 00000020:00000080:1.0:1788572099.787926:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a41341000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572099.788692:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6427 00000020:00000080:1.0:1788572099.788700:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5903a27000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572099.788705:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788572099.788710:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572099.788720:0:189875:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572099.788724:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8e590218b380) has no exports 00000004:01000000:1.0:1788572099.788888:0:189875:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788572099.788898:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b649e 00000020:00000080:1.0:1788572099.788904:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a08d27000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572099.788908:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788572099.788912:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572099.788920:0:189875:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572099.788922:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8e5a40148000) has no exports 00000020:00000080:1.0:1788572099.788927:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6490 00000020:00000080:1.0:1788572099.788931:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5906757800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788572099.789278:0:189875:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788572099.789283:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572099.789288:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975673 gen 5 00000004:00080000:1.0:1788572099.789294:0:189875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572099.789297:0:189875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572099.789322:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572099.789330:0:189875:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572099.789337:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6482 00000020:00000080:1.0:1788572099.789341:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5903a25800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572099.789344:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788572099.789348:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572099.789352:0:189875:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572099.789355:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8e5a109f8000) has no exports 00000020:00000080:1.0:1788572099.789358:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b647b 00000020:00000080:1.0:1788572099.789361:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5906853800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788572099.789713:0:189875:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788572099.789716:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572099.789718:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738467 gen 5 00000004:00080000:1.0:1788572099.789722:0:189875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572099.789723:0:189875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572099.789751:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572099.789757:0:189875:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788572099.789769:0:189875:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788572099.789773:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b646d 00000020:00000080:1.0:1788572099.789777:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a41345000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572099.789781:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788572099.789785:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572099.789789:0:189875:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572099.789792:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8e5905f5b380) has no exports 00000020:00000080:1.0:1788572099.789796:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6466 00000020:00000080:1.0:1788572099.789798:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a40ddd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572099.790577:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a41341000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572099.790587:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a27000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788572099.790592:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a08d27000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788572099.790597:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906757800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572099.790602:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a10ffe800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788572099.790608:0:177620:0:(genops.c:885:class_export_put()) final put ffff8e5906857000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572099.790610:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906857000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788572099.790614:0:177620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572099.790700:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a25800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572099.790705:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906853800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572099.790709:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0efd7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572099.790713:0:177620:0:(genops.c:885:class_export_put()) final put ffff8e5a41346800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572099.790715:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a41346800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788572099.790719:0:177620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572099.790746:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a41345000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788572099.790751:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a40ddd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788572099.791537:0:189875:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788572099.791543:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788572099.791547:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837467 gen 5 00000100:00100000:0.0:1788572099.791553:0:189875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788572099.791606:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572099.791617:0:189875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572099.791641:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572099.791645:0:189875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572099.791649:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a10fff000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572099.791651:0:189875:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a10fff000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788572099.791657:0:189875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572099.791728:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b642e 00000020:00000080:0.0:1788572099.791734:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5903a25000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788572099.791738:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788572099.791742:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572099.791747:0:189875:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788572099.791750:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8e5a401499c0) has no exports 00000020:00000080:0.0:1788572099.791766:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572099.791769:0:189875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788572099.791772:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6435 00000020:00000080:0.0:1788572099.791775:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5903a26800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788572099.791781:0:189875:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e590cac3000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788572099.791784:0:189875:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e590cac3000 3 00000020:01000004:0.0:1788572099.791787:0:189875:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e590cac3000 from lustre-MDT0000 00000020:00000080:0.0:1788572099.791806:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572099.791810:0:189875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788572099.791813:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a41340000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788572099.791815:0:189875:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a41340000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788572099.791822:0:189875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788572099.791853:0:189875:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788572099.791858:0:189875:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788572099.791861:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788572099.791864:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572099.791866:0:189875:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788572099.791873:0:189875:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e5a36d49800 e87131b0-4a60-4def-a26d-6e23dcfe5daa 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572099.791882:0:189875:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e5a36d4a800 712ceec8-7c82-4602-bd77-3db1811a6b63 192.168.202.57@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572099.791887:0:189875:0:(genops.c:1553:class_disconnect_exports()) OBD device 4 (ffff8e5a0efbcd40) has exports, disconnecting them 00000020:00080000:0.0:1788572099.791891:0:189875:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e5a36d49800), last request at 1788572040 00000020:00000080:0.0:1788572099.791915:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b62d7 00000020:00010000:0.0:1788572099.791921:0:189875:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a36d49800: total 2 00000100:00080000:0.0:1788572099.791925:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572099.791935:0:189875:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a36d49800): rc 0 00000020:00080000:0.0:1788572099.791939:0:189875:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.57@tcp (ffff8e5a36d4a800), last request at 1788572038 00000020:00010000:0.0:1788572099.791980:0:82817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a36d49800: total 2 00010000:00010000:0.0:1788572099.791985:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572099.792011:0:82817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a36d49800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788572099.792040:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a245f4600/0x265cfe11109b62fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b62f3 expref: 14 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792055:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5904a7a400/0x265cfe11109b6538 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b6531 expref: 13 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792065:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590d14ba00/0x265cfe11109b6546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b653f expref: 12 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792076:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a31ed8a00/0x265cfe11109b63d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b63cc expref: 11 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792086:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590d14b200/0x265cfe11109b6554 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b654d expref: 10 pid: 188065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792096:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a245f5600/0x265cfe11109b62e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b62de expref: 9 pid: 188065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792121:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a245f5e00/0x265cfe11109b6562 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b655b expref: 8 pid: 188064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792136:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a31ed8400/0x265cfe11109b6500 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b64f9 expref: 7 pid: 188065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792146:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a31ed9c00/0x265cfe11109b650e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b6507 expref: 6 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792156:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a245f5200/0x265cfe11109b6570 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b6569 expref: 5 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792166:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5904a7ac00/0x265cfe11109b63be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b63b7 expref: 4 pid: 188064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792175:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5904a7b200/0x265cfe11109b652a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b6523 expref: 3 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792186:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a31ed9a00/0x265cfe11109b651c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109b6515 expref: 2 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.792195:0:82817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a36d49800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788572099.792215:0:82817:0:(genops.c:885:class_export_put()) final put ffff8e5a36d49800/e87131b0-4a60-4def-a26d-6e23dcfe5daa 00010000:00010000:0.0:1788572099.792220:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572099.792222:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572099.792223:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572099.792235:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b62d0 00000020:00010000:0.0:1788572099.792239:0:189875:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a36d4a800: total 3 00000100:00080000:0.0:1788572099.792242:0:189875:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d48800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572099.792254:0:189875:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e5a36d4a800): rc 0 00000020:00080000:0.0:1788572099.792257:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8e5a0efbcd40) has no exports 00000100:00100000:0.0:1788572099.792306:0:188064:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e59058f8800:188064] 1 exiting: rc = 0 00000100:00100000:0.0:1788572099.792408:0:188063:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e590aeb0e00:188063] 0 exiting: rc = 1 00000020:00000080:2.0:1788572099.792541:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a40ddb000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788572099.792549:0:177620:0:(genops.c:885:class_export_put()) final put ffff8e5a41344800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572099.792551:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a41344800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788572099.792560:0:177620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572099.792617:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a25000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788572099.792622:0:177620:0:(genops.c:885:class_export_put()) final put ffff8e59022d4000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788572099.792623:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59022d4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788572099.792626:0:177620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788572099.792652:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a26800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788572099.792656:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36d49800/e87131b0-4a60-4def-a26d-6e23dcfe5daa for MGS 00000020:00000080:2.0:1788572099.792684:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a36d4f800 for MGS 00000100:00100000:0.0:1788572099.793574:0:188065:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e590aeb0600:188065] 2 exiting: rc = 0 00000100:00100000:2.0:1788572099.793715:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793722:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793729:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793735:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793741:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793749:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793756:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793762:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793768:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793774:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793781:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793787:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793795:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793800:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793805:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793811:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793817:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793822:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793827:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793832:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793837:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793843:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793848:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793853:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793859:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793865:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793870:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793876:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793882:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793887:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793893:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793899:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793903:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793909:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793915:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793921:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793927:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793932:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793937:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793942:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793947:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793952:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793957:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793963:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793969:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793974:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793979:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793984:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793990:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.793996:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794002:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794007:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794014:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794019:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794025:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794031:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794036:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794042:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794048:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794054:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794060:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794065:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794072:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572099.794078:0:189875:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1788572099.795560:0:10395:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a36d4a800: total 0 00010000:00010000:0.0:1788572099.795636:0:10395:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a36d4a800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788572099.795673:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a245f5800/0x265cfe11109b6371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25ba67e expref: 5 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.795692:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5904a7b000/0x265cfe11109b63c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25ba68c expref: 4 pid: 188064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.795709:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5904a7a600/0x265cfe11109b6394 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25ba685 expref: 3 pid: 188063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.795723:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590d14be00/0x265cfe11109b6577 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25ba693 expref: 2 pid: 188064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572099.795735:0:10395:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a36d4a800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788572099.795749:0:10395:0:(genops.c:885:class_export_put()) final put ffff8e5a36d4a800/712ceec8-7c82-4602-bd77-3db1811a6b63 00010000:00010000:0.0:1788572099.795768:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572099.795770:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572099.795772:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572099.795836:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36d4a800/712ceec8-7c82-4602-bd77-3db1811a6b63 for MGS 00000020:00000080:2.0:1788572099.795876:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a36d48800 for MGS 00000020:01000000:0.0:1788572099.799999:0:189875:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a115b7480 - data ffff8e5a08b9b5e8/ffff8e5a1f200400 00000020:01000000:0.0:1788572099.800161:0:189875:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a0457d120 - data ffff8e5a08a53438/ffff8e5a31eea800 00000020:00000080:0.0:1788572099.800639:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b62c2 00000020:00000080:0.0:1788572099.800648:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a09ee2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572099.800665:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a09ee2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788572099.800675:0:189875:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e590cac3000 from MGS, refs=2 00000020:01000004:0.0:1788572099.800679:0:189875:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e590cac3000 2 00000020:01000004:0.0:1788572099.800683:0:189875:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e590cac3000 from MGS 00000020:00000080:0.0:1788572099.800702:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572099.800710:0:189875:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788572099.800712:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a414b5000/MGS 00000020:00000080:0.0:1788572099.800714:0:189875:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a414b5000/MGS for MGS 00000020:01000000:0.0:1788572099.800720:0:189875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788572099.800813:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788572099.800817:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572099.800828:0:189875:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788572099.800836:0:189875:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e5a3717b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572099.800842:0:189875:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8e5905f5cd40) has exports, disconnecting them 00000020:00080000:0.0:1788572099.800847:0:189875:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e5a3717b800), last request at 1788572040 00000020:00000080:0.0:1788572099.800851:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b64dd 00000020:00080000:0.0:1788572099.800861:0:189875:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a3717b800): rc 0 00000020:00000080:0.0:1788572099.800865:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a3717b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788572099.800888:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3717b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788572099.819586:0:189875:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788572099.819596:0:189875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572099.819600:0:189875:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788572099.819608:0:189875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572099.819913:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572099.819927:0:189875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788572099.819933:0:189875:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e590cac3000 1 00000020:00000080:2.0:1788572099.819939:0:189875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b62b4 00000020:00000080:2.0:1788572099.819948:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e5a414b1000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788572099.819953:0:189875:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788572099.819961:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572099.819964:0:189875:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788572099.819968:0:189875:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8e5a0efb99c0) has no exports 00000020:00000080:0.0:1788572099.822463:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a3717f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788572099.822507:0:177620:0:(genops.c:885:class_export_put()) final put ffff8e5a08d24000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788572099.822510:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a08d24000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788572099.822518:0:177620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788572099.822622:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a414b1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788572099.971905:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584220416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572099.971976:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572099.972031:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584220416 00000100:00100000:2.0:1788572099.972038:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584220416 00000100:00100000:2.0:1788572099.972079:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788572099.972086:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875444584220416:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788572099.972106:0:188054:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788572099.972144:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875444584220416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (168us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572099.972152:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:02020000:2.0:1788572099.972193:0:3644:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788572099.972199:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572099.972204:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572099.972207:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572099.972213:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572099.972217:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8799 00000100:00080000:2.0:1788572099.972225:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572099.972247:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffac380 x1875444584220544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572099.972275:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584220544:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788572099.972299:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572099.972326:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584220544 00000100:00100000:2.0:1788572099.972330:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584220544 00000100:00100000:2.0:1788572099.972347:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788572099.972351:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584220544:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788572099.972371:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572099.972399:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584220544:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 46us (99us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572099.972406:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:2.0:1788572099.972428:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572099.972432:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572099.972435:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584220544:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788572100.029569:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572100.295975:0:189875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572100.295989:0:189875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788572100.295994:0:189875:0:(genops.c:885:class_export_put()) final put ffff8e590cac4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788572100.295999:0:189875:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cac4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788572100.296010:0:189875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788572100.296146:0:189875:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e590cac0800 00000020:02000400:2.0:1788572100.296343:0:189875:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788572101.054447:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572101.502886:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572101.502893:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572101.502897:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572101.502906:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8852 00000100:00080000:1.0:1788572101.502912:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572101.502919:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572101.502939:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e59028ee300 x1875444584221312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572101.502989:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584220672:0@lo:400:kworker.0 00000400:00000100:1.0:1788572101.503037:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584220672 offset 0 length 224: 4 00000100:00100000:1.0:1788572101.503086:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584221184:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.503121:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.503148:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572101.503154:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584220800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.503177:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.503194:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584221440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.503216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.503245:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584220928:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.503266:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.503285:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584221568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.503304:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.503322:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788572101.503326:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584221056:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.503348:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.503362:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584221696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.503383:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.503408:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584221312:0@lo:38:kworker.0 00000100:00100000:1.0:1788572101.503432:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.503468:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584221184 00000100:00100000:1.0:1788572101.503503:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584221184 00000100:00100000:2.0:1788572101.504133:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584220800 00000100:00100000:2.0:1788572101.504138:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584220800 00000100:00100000:2.0:1788572101.504172:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584220928 00000100:00100000:2.0:1788572101.504175:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584220928 00000100:00100000:1.0:1788572101.504398:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584221056 00000100:00100000:1.0:1788572101.504402:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584221056 00000100:00100000:1.0:1788572101.504411:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584221696 00000100:00100000:1.0:1788572101.504413:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584221696 00000100:00100000:1.0:1788572101.504426:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788572101.504436:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584221184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.504535:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584221184:12345-0@lo:400:kworker.0 Request processed in 100us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572101.504542:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788572101.504559:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1788572101.504563:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875444584220800:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788572101.504568:0:188050:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572101.504594:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875444584220800:12345-0@lo:400:kworker.0 Request processed in 30us (1415us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572101.504600:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1788572101.504622:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1788572101.504626:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875444584221056:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788572101.504630:0:188050:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572101.504657:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875444584221056:12345-0@lo:400:kworker.0 Request processed in 29us (1308us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572101.504662:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1788572101.504674:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1788572101.504678:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875444584221696:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788572101.504682:0:188050:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572101.504701:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875444584221696:12345-0@lo:400:kworker.0 Request processed in 22us (1318us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572101.504706:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1788572101.504729:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584221440 00000100:00100000:1.0:1788572101.504732:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584221440 00000100:00100000:2.0:1788572101.508195:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788572101.508210:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584220928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572101.508295:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584220928:12345-0@lo:400:kworker.0 Request processed in 89us (5027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572101.508302:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788572101.508680:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584221568 00000100:00100000:1.0:1788572101.508689:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584221568 00000100:00100000:1.0:1788572101.508719:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7536 00000100:00100000:1.0:1788572101.508727:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584221440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.508778:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584221440:12345-0@lo:400:kworker.0 Request processed in 53us (5560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572101.508784:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7536 00000100:00100000:1.0:1788572101.508797:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7537 00000100:00100000:1.0:1788572101.508803:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584221568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.508834:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584221568:12345-0@lo:400:kworker.0 Request processed in 32us (5529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572101.508839:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7537 00000100:00100000:1.0:1788572101.508869:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584221312 00000100:00100000:1.0:1788572101.508873:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584221312 00000100:00100000:1.0:1788572101.508892:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788572101.508897:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584221312:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572101.508916:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572101.508950:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584221312:12345-0@lo:38:kworker.0 Request processed in 52us (5516us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572101.508957:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:1.0:1788572101.508972:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572101.508975:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572101.508978:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572101.509010:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572101.509016:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572101.509020:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584221312:0@lo:38:kworker.0 00000100:00080000:1.0:1788572101.509066:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572101.509070:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572101.509074:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572101.509078:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572101.509082:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8802 00000100:00080000:1.0:1788572101.509088:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572101.509113:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590d8aed80 x1875444584221824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572101.509132:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584221056:0@lo:400:kworker.0 00000100:00080000:1.0:1788572101.509145:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572101.509148:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572101.509151:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572101.509154:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572101.509157:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8799 00000100:00080000:1.0:1788572101.509161:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572101.509172:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590d8aea00 x1875444584221952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572101.509181:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584221696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.509197:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584220928:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.509208:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584221568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.509234:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584221824:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788572101.509268:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.509291:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584221952:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788572101.509311:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.509335:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584221824 00000100:00100000:1.0:1788572101.509338:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584221824 00000100:00100000:1.0:1788572101.509360:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584221952 00000100:00100000:1.0:1788572101.509363:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584221952 00000100:00100000:1.0:1788572101.509378:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1788572101.509382:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584221824:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788572101.509393:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572101.509424:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584221824:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 40us (156us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572101.509431:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1788572101.509441:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1788572101.509445:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584221952:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788572101.509456:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572101.509475:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584221952:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 28us (164us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572101.509505:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00080000:1.0:1788572101.509528:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572101.509532:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572101.509535:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584221824:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788572101.509543:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572101.509546:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572101.509549:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584221952:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788572101.509575:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572101.509578:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572101.509581:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572101.509585:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572101.509589:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8802 00000100:00080000:1.0:1788572101.509594:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572101.509608:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590d8aea00 x1875444584222080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572101.509623:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584220800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.509638:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584221440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.509650:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584221184:0@lo:400:kworker.0 00000100:00100000:1.0:1788572101.509667:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584222080:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788572101.509690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572101.509710:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584222080 00000100:00100000:1.0:1788572101.509714:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584222080 00000100:00100000:1.0:1788572101.509728:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1788572101.509733:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584222080:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788572101.509743:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572101.509767:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584222080:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33us (77us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572101.509773:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00080000:1.0:1788572101.509792:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572101.509796:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572101.509799:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584222080:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1788572102.078548:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572103.100935:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572104.125423:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572104.557399:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572104.557520:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:3.0:1788572104.557544:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569456128 offset 0 length 224: 4 00000100:00100000:3.0:1788572104.557563:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572104.557588:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572104.557621:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569456512 00000100:00100000:3.0:1788572104.557631:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569456512 00000100:00100000:3.0:1788572104.557689:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569456640 00000100:00100000:3.0:1788572104.557692:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569456640 00000100:00100000:3.0:1788572104.557714:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7538 00000100:00100000:3.0:1788572104.557725:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569456512:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572104.557794:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569456512:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 72us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572104.557801:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7538 00000100:00100000:3.0:1788572104.557820:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7539 00000100:00100000:3.0:1788572104.557827:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569456640:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572104.557852:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569456640:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572104.557858:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7539 00000100:00100000:1.0:1788572104.558353:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569456256 00000100:00100000:1.0:1788572104.558370:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569456256 00000100:00100000:1.0:1788572104.558400:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569456384 00000100:00100000:1.0:1788572104.558403:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569456384 00000100:00100000:1.0:1788572104.558434:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 75 00000100:00100000:1.0:1788572104.558452:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569456384:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572104.558524:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569456384:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 82us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572104.558531:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 75 00000100:00100000:1.0:1788572104.558546:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 886 00000100:00100000:1.0:1788572104.558550:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1875444569456256:12345-192.168.202.57@tcp:400:kworker.0 00000020:00080000:1.0:1788572104.558557:0:188049:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.57@tcp 00000100:00100000:1.0:1788572104.558582:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1875444569456256:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (1195us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572104.558589:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 886 00000100:00080000:1.0:1788572104.558604:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572104.558609:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572104.558612:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572104.561927:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572104.579193:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569456768 00000100:00100000:1.0:1788572104.579212:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569456768 00000100:00100000:1.0:1788572104.579276:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 887 00000100:00100000:1.0:1788572104.579286:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569456768:12345-192.168.202.57@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788572104.579313:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572104.579414:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569456768:12345-192.168.202.57@tcp:38:ptlrpcd_00_01.0 Request processed in 127us (17498us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572104.579422:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 887 00000100:00100000:3.0:1788572104.579882:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572104.579899:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584222208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572104.579955:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572104.580120:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584222208 00000100:00100000:0.0:1788572104.580125:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584222208 00000100:00100000:0.0:1788572104.580180:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6181 00000100:00100000:0.0:1788572104.580188:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584222208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572104.580216:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572104.580265:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584222208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572104.580275:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6181 00000100:00100000:0.0:1788572104.580328:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584222208:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572104.580462:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572104.583890:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572104.583922:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584222336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572104.584027:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572104.584156:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584222336 00000100:00100000:3.0:1788572104.584166:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584222336 00000100:00100000:3.0:1788572104.584256:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6182 00000100:00100000:3.0:1788572104.584265:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584222336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572104.584297:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572104.584363:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584222336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572104.584383:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6182 00000100:00080000:1.0:1788572104.585767:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572104.585831:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584222336:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788572105.088664:0:184840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572105.088677:0:184840:0:(genops.c:885:class_export_put()) final put ffff8e5a0efd3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572105.088750:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efd3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788572105.088830:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0efd3000 for lustre-OST0000 00000001:00100000:0.0:1788572105.089341:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572105.089358:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5a109d5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572105.089557:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109d5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788572105.089607:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a109d3800 for lustre-OST0001 00000001:00100000:1.0:1788572105.094233:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788572105.094260:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837468 is committed 00000020:00000080:1.0:1788572105.094267:0:188042:0:(genops.c:885:class_export_put()) final put ffff8e5a1f80a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572105.095854:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1f80a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788572105.096167:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5906754800 for lustre-MDT0001 00010000:00010000:1.0:1788572105.148703:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572106.172779:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572106.621720:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584222464:0@lo:400:kworker.0 00000400:00000100:2.0:1788572106.621798:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584222464 offset 0 length 224: 4 00000100:00080000:3.0:1788572106.621978:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572106.621984:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572106.621988:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572106.621994:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8854 00000100:00080000:3.0:1788572106.622001:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572106.622009:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572106.622039:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36efad80 x1875444584222592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572106.622128:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584222720:0@lo:400:kworker.0 00000100:00100000:0.0:1788572106.622179:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572106.622244:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584222720 00000100:00100000:0.0:1788572106.622253:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584222720 00000100:00100000:0.0:1788572106.622333:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788572106.622345:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584222720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572106.622407:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584222720:12345-0@lo:400:kworker.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572106.622415:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788572106.622471:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584222720:0@lo:400:kworker.0 00000100:00100000:1.0:1788572106.624178:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584222592:0@lo:38:kworker.0 00000100:00100000:1.0:1788572106.624262:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572106.624335:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572106.624353:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584222592 00000100:00100000:1.0:1788572106.624361:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584222592 00000100:00100000:1.0:1788572106.624405:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1788572106.624413:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584222592:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572106.624438:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572106.624932:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584222592:12345-0@lo:38:kworker.0 Request processed in 515us (666us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572106.624941:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00080000:1.0:1788572106.624991:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572106.624997:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572106.625001:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584222592:0@lo:38:kworker.0 00000100:00080000:3.0:1788572106.637161:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572106.637178:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572106.637183:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572106.637196:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8854 00000100:00080000:3.0:1788572106.637204:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572106.637213:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572106.637267:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cdce00 x1875444584222848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572106.637344:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572106.637348:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572106.637349:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572106.637354:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8854 00000100:00080000:3.0:1788572106.637357:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572106.637361:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572106.637380:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572106.637404:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584222976:0@lo:400:kworker.0 00000100:00100000:3.0:1788572106.637525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572106.637610:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584222976 00000100:00100000:3.0:1788572106.637620:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584222976 00000100:00100000:3.0:1788572106.637691:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788572106.637702:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584222976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572106.637773:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584222976:12345-0@lo:400:kworker.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572106.637781:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788572106.637836:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584222976:0@lo:400:kworker.0 00000100:00100000:3.0:1788572106.637883:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cdf480 x1875444584223104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572106.637919:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584223232:0@lo:400:kworker.0 00000100:00100000:3.0:1788572106.637947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572106.637980:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584223232 00000100:00100000:3.0:1788572106.637983:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584223232 00000100:00100000:3.0:1788572106.638014:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7540 00000100:00100000:3.0:1788572106.638021:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584223232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572106.638062:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584223232:12345-0@lo:400:kworker.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572106.638068:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7540 00000100:00100000:3.0:1788572106.638094:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584223232:0@lo:400:kworker.0 00000100:00080000:3.0:1788572106.638119:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572106.638123:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572106.638126:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572106.638130:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8854 00000100:00080000:3.0:1788572106.638134:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572106.638137:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572106.638148:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572106.638155:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584223360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572106.638181:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572106.638234:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cded80 x1875444584223488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572106.638296:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584223360 00000100:00100000:3.0:1788572106.638299:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584223360 00000100:00100000:3.0:1788572106.638326:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7541 00000100:00100000:3.0:1788572106.638332:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584223360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572106.638373:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584223360:12345-0@lo:400:kworker.0 Request processed in 41us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572106.638379:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7541 00000100:00100000:3.0:1788572106.638407:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584223360:0@lo:400:kworker.0 00000100:00080000:1.0:1788572106.642755:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572106.642773:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572106.642778:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572106.642818:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584222848:0@lo:38:kworker.0 00000100:00100000:1.0:1788572106.642965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572106.643035:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584223104:0@lo:38:kworker.0 00000100:00100000:1.0:1788572106.643071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572106.643104:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584223488:0@lo:38:kworker.0 00000100:00100000:1.0:1788572106.643133:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572106.643191:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584222848 00000100:00100000:1.0:1788572106.643202:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584222848 00000100:00100000:1.0:1788572106.643250:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584223488 00000100:00100000:1.0:1788572106.643259:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584223488 00000100:00100000:1.0:1788572106.643284:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1788572106.643293:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584222848:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788572106.643426:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1788572106.643433:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584223488:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572106.643460:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572106.643559:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584223488:12345-0@lo:38:kworker.0 Request processed in 125us (424us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572106.643567:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00010000:00020000:1.0:1788572106.643971:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572106.644011:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584222848:12345-0@lo:38:kworker.0 Request processed in 717us (1047us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572106.644019:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00080000:1.0:1788572106.644065:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572106.644071:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572106.644075:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584222848:0@lo:38:kworker.0 00000100:00080000:1.0:1788572106.644085:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572106.644089:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572106.644092:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584223488:0@lo:38:kworker.0 00000100:00100000:3.0:1788572106.644692:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584223104 00000100:00100000:3.0:1788572106.644701:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584223104 00000100:00100000:3.0:1788572106.644750:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788572106.644759:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584223104:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572106.644774:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572106.644873:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584223104:12345-0@lo:38:kworker.0 Request processed in 112us (1798us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572106.644879:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:1.0:1788572106.645238:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572106.645244:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572106.645248:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584223104:0@lo:38:kworker.0 00010000:00010000:2.0:1788572107.196944:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572108.220905:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572109.248569:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572109.675253:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:3.0:1788572109.675290:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569456896 offset 0 length 224: 4 00000100:00100000:3.0:1788572109.675326:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572109.675964:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569457152 00000100:00100000:2.0:1788572109.675983:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569457152 00000100:00100000:2.0:1788572109.676127:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 78 00000100:00100000:2.0:1788572109.676141:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569457152:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572109.676249:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569457152:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 112us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572109.676258:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 78 00000100:00080000:0.0:1788572109.676404:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572109.680842:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572109.680910:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572109.681012:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569457024 00000100:00100000:2.0:1788572109.681027:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569457024 00000100:00100000:1.0:1788572109.681127:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569457280 00000100:00100000:1.0:1788572109.681143:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569457280 00000100:00100000:1.0:1788572109.681227:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569457408 00000100:00100000:1.0:1788572109.681231:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569457408 00000100:00100000:1.0:1788572109.681259:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7542 00000100:00100000:1.0:1788572109.681271:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569457280:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572109.681553:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 891 00000100:00100000:2.0:1788572109.681563:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569457024:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572109.681601:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788572109.681628:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572109.681634:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572109.681675:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22591 00000100:00100000:2.0:1788572109.681698:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569457024:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 125us (874us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572109.681699:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2396:x1875444569457408:12345-192.168.202.57@tcp:9:kworker.0 00000100:00100000:2.0:1788572109.681725:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 891 00000020:00000080:0.0:1788572109.681736:0:41719:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b98fb 00000100:00080000:0.0:1788572109.681750:0:41719:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f907800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572109.681803:0:41719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975673 00000100:00100000:0.0:1788572109.681985:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+2:2396:x1875444569457408:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 300us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572109.681992:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22591 00010000:00010000:0.0:1788572109.682026:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572109.683030:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569457280:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 1757us (7698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572109.683040:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7542 00000100:00100000:1.0:1788572109.693001:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572109.693145:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584223744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572109.693248:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572109.693324:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584223744 00000100:00100000:2.0:1788572109.693333:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584223744 00000100:00100000:2.0:1788572109.693408:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6183 00000100:00100000:2.0:1788572109.693419:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584223744:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572109.693730:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788572109.695024:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572109.695319:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584223744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1896us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572109.695331:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6183 00000100:00100000:1.0:1788572109.699714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584223616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572109.699844:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572109.700306:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584223616 00000100:00100000:2.0:1788572109.700318:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584223616 00000100:00100000:2.0:1788572109.700411:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6184 00000100:00100000:2.0:1788572109.700423:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584223616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572109.700509:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572109.700577:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584223616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572109.700584:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6184 00000100:00080000:0.0:1788572109.700701:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572109.700789:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584223616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572109.701080:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584223744:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572110.268709:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572111.293100:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572111.742162:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572111.742172:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572111.742177:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572111.742189:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8859 00000100:00080000:0.0:1788572111.742200:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788572111.742213:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572111.742244:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729e680 x1875444584224000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572111.742293:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572111.742297:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572111.742299:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572111.742302:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8859 00000100:00080000:0.0:1788572111.742305:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788572111.742310:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572111.742333:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729fb80 x1875444584224256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572111.742355:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572111.742358:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572111.742361:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572111.742364:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8859 00000100:00080000:0.0:1788572111.742367:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572111.742371:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572111.742384:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f30a80 x1875444584224512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572111.742407:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572111.742410:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572111.742412:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572111.742415:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8859 00000100:00080000:0.0:1788572111.742418:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788572111.742422:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572111.742437:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f31c00 x1875444584224896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572111.742472:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584224128:0@lo:400:kworker.0 00000100:00100000:0.0:1788572111.742609:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572111.742668:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584224000:0@lo:38:kworker.0 00000100:00100000:0.0:1788572111.742689:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572111.742705:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572111.742706:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584224384:0@lo:400:kworker.0 00000100:00100000:1.0:1788572111.742731:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584224256:0@lo:38:kworker.0 00000100:00100000:0.0:1788572111.742732:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572111.742752:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572111.742785:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584224512:0@lo:38:kworker.0 00000100:00100000:1.0:1788572111.742812:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572111.742819:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584224640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572111.742834:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584224896:0@lo:38:kworker.0 00000100:00100000:1.0:1788572111.742854:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572111.742854:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572111.742878:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788572111.742884:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584223872:0@lo:400:kworker.0 00000400:00000100:2.0:1788572111.742905:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584223872 offset 0 length 224: 4 00000100:00100000:2.0:1788572111.742921:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584224768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572111.742943:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572111.751693:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584224640 00000100:00100000:1.0:1788572111.751715:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584224640 00000100:00100000:1.0:1788572111.753072:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584224768 00000100:00100000:1.0:1788572111.753090:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584224768 00000100:00100000:1.0:1788572111.753274:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7543 00000100:00100000:1.0:1788572111.753289:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584224640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572111.753455:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584224640:12345-0@lo:400:kworker.0 Request processed in 170us (10600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572111.753463:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7543 00000100:00100000:1.0:1788572111.753498:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7544 00000100:00100000:1.0:1788572111.753505:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584224768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572111.753536:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584224768:12345-0@lo:400:kworker.0 Request processed in 33us (10593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572111.753542:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7544 00000100:00100000:1.0:1788572111.753606:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584224512 00000100:00100000:1.0:1788572111.753611:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584224512 00000100:00100000:1.0:1788572111.753635:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788572111.753640:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584224512:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572111.753665:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572111.753707:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584224512:12345-0@lo:38:kworker.0 Request processed in 65us (10893us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572111.753713:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788572111.759209:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584224128 00000100:00100000:0.0:1788572111.759233:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584224128 00000100:00100000:3.0:1788572111.760386:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584224000 00000100:00100000:3.0:1788572111.760402:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584224000 00000100:00100000:3.0:1788572111.760449:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584224384 00000100:00100000:3.0:1788572111.760452:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584224384 00000100:00100000:3.0:1788572111.760498:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584224256 00000100:00100000:3.0:1788572111.760501:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584224256 00000100:00100000:3.0:1788572111.760509:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584224896 00000100:00100000:3.0:1788572111.760513:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584224896 00000100:00100000:3.0:1788572111.760529:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788572111.760541:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584224128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572111.760703:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584224128:12345-0@lo:400:kworker.0 Request processed in 164us (18094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572111.760712:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788572111.760735:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788572111.760742:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584224384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572111.760796:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584224384:12345-0@lo:400:kworker.0 Request processed in 54us (18062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572111.760802:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788572111.760818:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1788572111.760822:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584224000:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572111.760857:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572111.760897:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584224000:12345-0@lo:38:kworker.0 Request processed in 73us (18191us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572111.760903:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1788572111.760914:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1788572111.760917:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584224256:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572111.760925:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572111.760952:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584224256:12345-0@lo:38:kworker.0 Request processed in 34us (18199us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572111.760959:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1788572111.760971:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1788572111.760975:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584224896:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572111.760984:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572111.761014:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584224896:12345-0@lo:38:kworker.0 Request processed in 37us (18158us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572111.761019:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1788572111.761106:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584224384:0@lo:400:kworker.0 00000100:00080000:0.0:1788572111.761496:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572111.761504:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572111.761507:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572111.761567:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572111.761574:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572111.761579:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584224000:0@lo:38:kworker.0 00000100:00080000:0.0:1788572111.761591:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572111.761595:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572111.761597:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584224128:0@lo:400:kworker.0 00000100:00100000:0.0:1788572111.761598:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584224256:0@lo:38:kworker.0 00000100:00080000:0.0:1788572111.761610:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572111.761613:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572111.761616:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584224512:0@lo:38:kworker.0 00000100:00080000:0.0:1788572111.761625:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572111.761629:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572111.761632:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584224896:0@lo:38:kworker.0 00000100:00100000:3.0:1788572111.761658:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584224768:0@lo:400:kworker.0 00000100:00100000:3.0:1788572111.761674:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584224640:0@lo:400:kworker.0 00010000:00010000:0.0:1788572112.318566:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572113.343229:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572114.365438:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572114.798419:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:3.0:1788572114.798506:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569457536 offset 0 length 224: 4 00000100:00100000:0.0:1788572114.798642:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569457792 00000100:00100000:0.0:1788572114.798657:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569457792 00000100:00100000:0.0:1788572114.798771:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 81 00000100:00100000:0.0:1788572114.798786:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569457792:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572114.798929:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569457792:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 145us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.798937:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 81 00000100:00080000:0.0:1788572114.798973:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572114.799776:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572114.799820:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572114.800087:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569457664 00000100:00100000:3.0:1788572114.800206:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569457664 00000100:00100000:3.0:1788572114.800263:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 895 00000100:00100000:3.0:1788572114.800274:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569457664:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:3.0:1788572114.800303:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572114.800372:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569457664:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 99us (551us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572114.800380:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 895 00000100:00100000:0.0:1788572114.800578:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569457920 00000100:00100000:0.0:1788572114.800584:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569457920 00000100:00100000:0.0:1788572114.800637:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7545 00000100:00100000:0.0:1788572114.800646:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569457920:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572114.800705:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569457920:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 60us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.800712:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7545 00000100:00080000:0.0:1788572114.800749:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572114.813420:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584225024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572114.813573:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572114.813650:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584225024 00000100:00100000:0.0:1788572114.813660:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584225024 00000100:00100000:0.0:1788572114.813750:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6185 00000100:00100000:0.0:1788572114.813762:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584225024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572114.813805:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572114.814222:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584225024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 459us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.814231:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6185 00000100:00080000:0.0:1788572114.814263:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572114.814308:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584225024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572114.816330:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572114.816355:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584225152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572114.816459:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572114.816569:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584225152 00000100:00100000:0.0:1788572114.816580:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584225152 00000100:00100000:0.0:1788572114.816665:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6186 00000100:00100000:0.0:1788572114.816692:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584225152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572114.816733:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572114.816798:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584225152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.816808:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6186 00000100:00080000:0.0:1788572114.816857:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572114.819618:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584225152:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788572114.828536:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:2.0:1788572114.828550:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5a3f900800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:0.0:1788572114.828710:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f900800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d for lustre-OST0001 00000020:00000080:0.0:1788572114.828802:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a3f907800 for lustre-OST0001 00010000:00010000:2.0:1788572115.392381:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572116.414058:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572116.860726:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572116.860734:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572116.860738:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572116.860746:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8864 00000100:00080000:0.0:1788572116.860752:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572116.860758:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572116.860781:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f33480 x1875444584225408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572116.860806:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572116.860809:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572116.860811:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572116.860815:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8864 00000100:00080000:0.0:1788572116.860818:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572116.860822:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572116.860838:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f32680 x1875444584225664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572116.860858:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572116.860862:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572116.860863:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572116.860866:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8864 00000100:00080000:0.0:1788572116.860879:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572116.860886:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572116.860898:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f32a00 x1875444584225920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572116.860918:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572116.860921:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572116.860923:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572116.860927:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8864 00000100:00080000:0.0:1788572116.860929:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572116.860932:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572116.860943:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f31500 x1875444584226304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572116.860987:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584225280:0@lo:400:kworker.0 00000400:00000100:0.0:1788572116.861037:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584225280 offset 0 length 224: 4 00000100:00100000:0.0:1788572116.861085:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584226176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.861117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572116.861143:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572116.861148:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584225536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.861185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572116.861217:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584225408:0@lo:38:kworker.0 00000100:00100000:0.0:1788572116.861243:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572116.861261:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584225664:0@lo:38:kworker.0 00000100:00100000:0.0:1788572116.861282:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572116.861301:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584225920:0@lo:38:kworker.0 00000100:00100000:0.0:1788572116.861324:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572116.861339:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584226304:0@lo:38:kworker.0 00000100:00100000:0.0:1788572116.861360:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572116.861391:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584225792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.861414:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572116.861427:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572116.861432:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584226048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.861453:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572116.861509:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584226176 00000100:00100000:0.0:1788572116.861516:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584226176 00000100:00100000:0.0:1788572116.861568:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584226048 00000100:00100000:0.0:1788572116.861572:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584226048 00000100:00100000:0.0:1788572116.861596:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7546 00000100:00100000:0.0:1788572116.861604:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584226176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.861669:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584226176:12345-0@lo:400:kworker.0 Request processed in 65us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572116.861677:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7546 00000100:00100000:0.0:1788572116.861696:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7547 00000100:00100000:0.0:1788572116.861702:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584226048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.861733:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584226048:12345-0@lo:400:kworker.0 Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572116.861738:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7547 00000100:00100000:0.0:1788572116.861756:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584225536 00000100:00100000:0.0:1788572116.861760:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584225536 00000100:00100000:0.0:1788572116.861780:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584225408 00000100:00100000:0.0:1788572116.861783:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584225408 00000100:00100000:0.0:1788572116.861790:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584225664 00000100:00100000:0.0:1788572116.861792:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584225664 00000100:00100000:0.0:1788572116.861799:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584226304 00000100:00100000:0.0:1788572116.861802:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584226304 00000100:00100000:0.0:1788572116.861808:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584225792 00000100:00100000:0.0:1788572116.861810:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584225792 00000100:00100000:0.0:1788572116.861823:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788572116.861829:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584225536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.861860:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584225536:12345-0@lo:400:kworker.0 Request processed in 31us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572116.861866:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788572116.861878:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788572116.861884:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584225792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.861908:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584225792:12345-0@lo:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572116.861914:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788572116.861926:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1788572116.861929:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584225408:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572116.861947:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572116.861976:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584225408:12345-0@lo:38:kworker.0 Request processed in 45us (732us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572116.861983:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1788572116.861993:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:0.0:1788572116.861996:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584225664:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572116.862005:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572116.862025:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584225664:12345-0@lo:38:kworker.0 Request processed in 27us (742us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572116.862031:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:0.0:1788572116.862042:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1788572116.862045:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584226304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572116.862053:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572116.862074:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584226304:12345-0@lo:38:kworker.0 Request processed in 27us (713us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572116.862079:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00080000:0.0:1788572116.862109:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572116.862113:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572116.862115:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572116.862153:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584226048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.862163:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584225792:0@lo:400:kworker.0 00000100:00080000:0.0:1788572116.862194:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572116.862199:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572116.862202:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584225408:0@lo:38:kworker.0 00000100:00080000:0.0:1788572116.862210:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572116.862213:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572116.862216:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584225664:0@lo:38:kworker.0 00000100:00080000:0.0:1788572116.862225:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572116.862228:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572116.862230:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584226304:0@lo:38:kworker.0 00000100:00100000:0.0:1788572116.862257:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584225536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572116.862266:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584226176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572116.862525:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584225920 00000100:00100000:2.0:1788572116.862531:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584225920 00000100:00100000:2.0:1788572116.862554:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788572116.862560:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584225920:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572116.862571:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572116.862610:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584225920:12345-0@lo:38:kworker.0 Request processed in 49us (1284us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572116.862628:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1788572116.862653:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572116.862657:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572116.862660:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584225920:0@lo:38:kworker.0 00010000:00010000:2.0:1788572117.436725:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788572117.885857:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572101/real 1788572101] req@ffff8e59028efb80 x1875444584220672/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572117 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572117.885889:0:3641:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8e59028efb80 x1875444584220672/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572117 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572117.885898:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788572117.885902:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788572117.885905:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.157@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788572117.885907:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788572117.885911:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e59028efb80 x1875444584220672/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572117 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572117.885922:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a36efb480 x1875444584222464/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572122 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572117.885938:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a2462d180 x1875444584223872/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572127 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572117.885946:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a40f31c00 x1875444584225280/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572132 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788572117.885955:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788572117.885958:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788572117.885959:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788572117.885961:0:3641:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1788572117.889533:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584222464:0@lo:400:kworker.0 00000100:00100000:3.0:1788572117.897383:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584225280:0@lo:400:kworker.0 00000100:00100000:3.0:1788572117.897398:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584223872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572117.897403:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584220672:0@lo:400:kworker.0 00000100:00080000:1.0:1788572117.897568:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572117.897575:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788572117.897578:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572117.897594:0:177620:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 8793 00000100:00080000:1.0:1788572117.897602:0:177620:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572117.897637:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e59028efb80 x1875444584226432/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572117.897660:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572117.897664:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572117.897665:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572117.897669:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8869 00000100:00080000:1.0:1788572117.897672:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572117.897675:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572117.897691:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cd1180 x1875444584226560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572117.897722:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572117.897726:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572117.897727:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572117.897731:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8869 00000100:00080000:1.0:1788572117.897733:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1788572117.897734:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584226688:0@lo:400:kworker.0 00000100:00080000:1.0:1788572117.897737:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572117.897748:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cd3b80 x1875444584226816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572117.897782:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572117.897786:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572117.897787:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572117.897790:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8869 00000100:00080000:1.0:1788572117.897793:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572117.897797:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572117.897802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572117.897809:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cd1880 x1875444584227072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572117.897829:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572117.897832:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572117.897834:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788572117.897837:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1788572117.897837:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8869 00000100:00080000:1.0:1788572117.897840:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1788572117.897842:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584227328:0@lo:400:kworker.0 00000100:00080000:1.0:1788572117.897843:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572117.897854:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cd2680 x1875444584227456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572117.897867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572117.897894:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584226944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572117.897919:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572117.897949:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572117.897955:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584227200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572117.897976:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572117.898015:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584226688 00000100:00100000:0.0:1788572117.898022:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584226688 00000100:00100000:3.0:1788572117.898048:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584226432:0@lo:250:kworker.0 00000100:00100000:0.0:1788572117.898066:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584226944 00000100:00100000:0.0:1788572117.898068:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584226944 00000400:00000100:3.0:1788572117.898071:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584226432 offset 0 length 520: 4 00000100:00100000:0.0:1788572117.898087:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788572117.898095:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584226688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572117.898105:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584226560:0@lo:38:kworker.0 00000100:00100000:3.0:1788572117.898127:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572117.898140:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584226688:12345-0@lo:400:kworker.0 Request processed in 46us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572117.898140:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584226816:0@lo:38:kworker.0 00000100:00100000:3.0:1788572117.898175:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572117.898189:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584227072:0@lo:38:kworker.0 00000100:00100000:3.0:1788572117.898213:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572117.898235:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584227456:0@lo:38:kworker.0 00000100:00100000:3.0:1788572117.898255:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572117.898280:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584227072 00000100:00100000:3.0:1788572117.898283:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584227072 00000100:00100000:3.0:1788572117.898321:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788572117.898327:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584227072:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572117.898345:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572117.898380:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584227072:12345-0@lo:38:kworker.0 Request processed in 52us (166us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572117.898387:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1788572117.898421:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572117.898426:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572117.898430:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584227072:0@lo:38:kworker.0 00000100:00100000:1.0:1788572117.898619:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584226560 00000100:00100000:1.0:1788572117.898624:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584226560 00000100:00100000:1.0:1788572117.898639:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584226816 00000100:00100000:1.0:1788572117.898641:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584226816 00000100:00100000:1.0:1788572117.898649:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584227456 00000100:00100000:1.0:1788572117.898651:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584227456 00000100:00100000:1.0:1788572117.898660:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788572117.898669:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584226944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572117.898715:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584226944:12345-0@lo:400:kworker.0 Request processed in 48us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572117.898722:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788572117.898739:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1788572117.898744:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584226560:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572117.898755:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572117.898794:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584226560:12345-0@lo:38:kworker.0 Request processed in 48us (665us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572117.898801:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1788572117.898814:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1788572117.898818:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584226816:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572117.898827:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572117.898850:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584226816:12345-0@lo:38:kworker.0 Request processed in 30us (673us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572117.898856:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1788572117.898867:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1788572117.898871:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584227456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572117.898879:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572117.898900:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584227456:12345-0@lo:38:kworker.0 Request processed in 27us (644us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572117.898905:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:3.0:1788572117.899040:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584226944:0@lo:400:kworker.0 00000100:00080000:3.0:1788572117.899069:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572117.899073:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572117.899077:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584226560:0@lo:38:kworker.0 00000100:00080000:3.0:1788572117.899085:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572117.899089:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572117.899091:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584226816:0@lo:38:kworker.0 00000100:00080000:3.0:1788572117.899099:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572117.899102:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572117.899105:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584227456:0@lo:38:kworker.0 00000100:00100000:2.0:1788572117.899567:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584227328 00000100:00100000:2.0:1788572117.899573:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584227328 00000100:00100000:2.0:1788572117.899612:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584227200 00000100:00100000:2.0:1788572117.899616:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584227200 00000100:00100000:2.0:1788572117.899645:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7548 00000100:00100000:2.0:1788572117.899653:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584227328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572117.899698:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584227328:12345-0@lo:400:kworker.0 Request processed in 47us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572117.899705:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7548 00000100:00100000:2.0:1788572117.899717:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7549 00000100:00100000:2.0:1788572117.899723:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584227200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572117.899754:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584227200:12345-0@lo:400:kworker.0 Request processed in 30us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572117.899760:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7549 00000100:00100000:0.0:1788572117.899776:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788572117.899830:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584227328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572117.899843:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584226688:0@lo:400:kworker.0 00000100:00100000:3.0:1788572117.900246:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584227200:0@lo:400:kworker.0 00010000:00010000:1.0:1788572118.461914:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572119.491741:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788572119.916631:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569458048 offset 0 length 224: 4 00000100:00100000:0.0:1788572119.916676:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572119.916701:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572119.916727:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572119.916766:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569458304 00000100:00100000:0.0:1788572119.916775:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569458304 00000100:00100000:0.0:1788572119.916836:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569458176 00000100:00100000:0.0:1788572119.916840:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569458176 00000100:00100000:0.0:1788572119.916859:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 86 00000100:00100000:0.0:1788572119.916870:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569458304:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572119.916947:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569458304:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572119.916955:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 86 00000100:00100000:0.0:1788572119.916974:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 902 00000100:00100000:0.0:1788572119.916978:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569458176:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:0.0:1788572119.916998:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572119.917019:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569458176:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 40us (292us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572119.917025:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 902 00000100:00080000:0.0:1788572119.917041:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572119.917218:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569458432 00000100:00100000:3.0:1788572119.917222:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569458432 00000100:00100000:3.0:1788572119.917271:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7550 00000100:00100000:3.0:1788572119.917281:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569458432:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572119.917309:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569458432:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572119.917314:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7550 00000100:00080000:0.0:1788572119.918140:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572119.936695:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584227584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572119.936769:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572119.936829:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584227584 00000100:00100000:2.0:1788572119.936839:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584227584 00000100:00100000:2.0:1788572119.936904:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6187 00000100:00100000:2.0:1788572119.936914:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584227584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572119.936947:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572119.936992:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584227584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.936999:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6187 00000100:00080000:2.0:1788572119.937019:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572119.937055:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584227584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572119.937066:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584227712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572119.937448:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572119.939203:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584227712 00000100:00100000:2.0:1788572119.939214:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584227712 00000100:00100000:2.0:1788572119.939458:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6188 00000100:00100000:2.0:1788572119.939469:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584227712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572119.939514:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572119.939594:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584227712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.939602:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6188 00000100:00080000:1.0:1788572119.939708:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572119.939753:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584227712:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572120.510867:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788572120.997072:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569458560 offset 0 length 520: 4 00000100:00100000:3.0:1788572120.997118:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572120.997153:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572120.997306:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572120.997338:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569458944 00000100:00100000:3.0:1788572120.997348:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569458944 00000100:00100000:3.0:1788572120.997406:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7551 00000100:00100000:3.0:1788572120.997417:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569458944:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572120.997529:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569458944:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 114us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572120.997536:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7551 00000100:00100000:2.0:1788572120.999605:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569458688 00000100:00100000:2.0:1788572120.999621:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569458688 00000100:00100000:2.0:1788572120.999658:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569458816 00000100:00100000:2.0:1788572120.999661:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569458816 00000100:00100000:2.0:1788572120.999698:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 87 00000100:00100000:2.0:1788572120.999708:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569458816:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572120.999776:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569458816:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 70us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572120.999784:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 87 00000100:00100000:2.0:1788572120.999801:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 903 00000100:00100000:2.0:1788572120.999805:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569458688:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572120.999824:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572120.999847:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569458688:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 40us (2730us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572120.999853:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 903 00010000:00010000:0.0:1788572121.533541:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572122.565120:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572123.015205:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572123.015216:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788572123.015219:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572123.015223:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572123.015227:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572123.015235:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8870 00000100:00080000:3.0:1788572123.015240:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572123.015247:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572123.015283:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36bd4e00 x1875444584227840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572123.015326:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572123.015331:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572123.015332:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572123.015336:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8870 00000100:00080000:3.0:1788572123.015338:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572123.015341:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572123.015353:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36bd4000 x1875444584228096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572123.015376:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572123.015379:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572123.015381:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572123.015385:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8870 00000100:00080000:3.0:1788572123.015387:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572123.015391:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572123.015404:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36bd6680 x1875444584228352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572123.015427:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572123.015431:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572123.015432:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572123.015435:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8870 00000100:00080000:3.0:1788572123.015438:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572123.015451:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572123.015463:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590c440e00 x1875444584228736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572123.015517:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584228608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.015584:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572123.015658:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572123.015665:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584227968:0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.015691:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572123.015728:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584228224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.015753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572123.015774:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572123.015779:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584228480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.015800:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572123.015830:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584228608 00000100:00100000:3.0:1788572123.015837:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584228608 00000100:00100000:3.0:1788572123.015884:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584228480 00000100:00100000:3.0:1788572123.015886:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584228480 00000100:00100000:3.0:1788572123.015906:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7552 00000100:00100000:3.0:1788572123.015916:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584228608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.015965:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584228608:12345-0@lo:400:kworker.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572123.015971:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7552 00000100:00100000:3.0:1788572123.015993:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7553 00000100:00100000:3.0:1788572123.016000:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584228480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.016033:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584228480:12345-0@lo:400:kworker.0 Request processed in 33us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572123.016038:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7553 00000100:00100000:3.0:1788572123.016058:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584227968 00000100:00100000:3.0:1788572123.016061:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584227968 00000100:00100000:3.0:1788572123.016087:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584228224 00000100:00100000:3.0:1788572123.016090:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584228224 00000100:00100000:3.0:1788572123.016108:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788572123.016113:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584227968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.016144:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584227968:12345-0@lo:400:kworker.0 Request processed in 31us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572123.016150:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788572123.016162:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788572123.016167:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584228224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.016192:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584228224:12345-0@lo:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572123.016198:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788572123.016220:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572123.016224:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572123.016227:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572123.016260:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584227968:0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.016272:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584228608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.016301:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584228480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572123.016309:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584228224:0@lo:400:kworker.0 00000100:00100000:2.0:1788572123.019758:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584227840:0@lo:38:kworker.0 00000100:00100000:2.0:1788572123.019836:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572123.021053:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584228096:0@lo:38:kworker.0 00000100:00100000:2.0:1788572123.021097:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572123.021262:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584228352:0@lo:38:kworker.0 00000100:00100000:2.0:1788572123.021292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572123.021318:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584228352 00000100:00100000:2.0:1788572123.021325:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584228352 00000100:00100000:2.0:1788572123.021363:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788572123.021371:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584228352:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572123.021392:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572123.021428:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584228352:12345-0@lo:38:kworker.0 Request processed in 56us (134us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572123.021435:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1788572123.021509:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572123.021515:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572123.021518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584228352:0@lo:38:kworker.0 00000100:00100000:2.0:1788572123.021526:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584228736:0@lo:38:kworker.0 00000100:00100000:2.0:1788572123.021556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572123.021722:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584227840 00000100:00100000:3.0:1788572123.021728:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584227840 00000100:00100000:3.0:1788572123.021757:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584228096 00000100:00100000:3.0:1788572123.021760:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584228096 00000100:00100000:3.0:1788572123.021776:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1788572123.021782:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584227840:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572123.021795:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572123.021853:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584227840:12345-0@lo:38:kworker.0 Request processed in 70us (2017us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572123.021859:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1788572123.021882:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:3.0:1788572123.021886:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584228096:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572123.021895:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572123.021923:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584228096:12345-0@lo:38:kworker.0 Request processed in 35us (825us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572123.021929:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00080000:2.0:1788572123.022085:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572123.022090:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572123.022094:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584227840:0@lo:38:kworker.0 00000100:00080000:2.0:1788572123.022103:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572123.022106:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572123.022109:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584228096:0@lo:38:kworker.0 00000100:00100000:3.0:1788572123.022161:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584228736 00000100:00100000:3.0:1788572123.022165:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584228736 00000100:00100000:3.0:1788572123.022194:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1788572123.022199:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584228736:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572123.022208:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572123.022249:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584228736:12345-0@lo:38:kworker.0 Request processed in 48us (692us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572123.022255:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00080000:3.0:1788572123.022280:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572123.022284:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572123.022288:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584228736:0@lo:38:kworker.0 00010000:00010000:1.0:1788572123.586173:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572124.607605:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788572124.709785:0:190493:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788572124.709793:0:190493:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788572124.709794:0:190493:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788572124.710046:0:190493:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e59059d0000 00000020:01000004:1.0:1788572124.710067:0:190493:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788572124.710083:0:190493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788572124.710098:0:190493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e5905f5cd40) 00000020:00000080:1.0:1788572124.710118:0:190493:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788572124.815075:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.816291:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788572124.821441:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.821670:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.821830:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.822015:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.822183:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.822422:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.822743:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.823201:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.823406:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.823671:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.824105:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.824294:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.824543:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.824776:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.825008:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.825577:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.825818:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.826025:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.826210:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.826415:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.826861:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.827149:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.827335:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.827541:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.827771:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.828004:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.828186:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.828372:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.828661:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788572124.828896:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.829127:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.829304:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788572124.829708:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.830011:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788572124.830439:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788572124.830762:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.831072:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788572124.831301:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788572124.831577:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.831792:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.832104:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788572124.832274:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788572124.832450:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.832770:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.833693:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.834341:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.834727:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.834917:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.835402:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.835661:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788572124.835862:0:190493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1788572124.836667:0:190493:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788572124.836908:0:190493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788572124.836917:0:190493:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788572124.836929:0:190493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bcf9d 00000020:01000004:3.0:1788572124.836935:0:190493:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788572124.836960:0:190493:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788572124.836966:0:190493:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e59059d0000 from MGS 00000020:01000004:3.0:1788572124.836970:0:190493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788572124.836979:0:190493:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e5a109f99c0) 00000020:00000080:3.0:1788572124.836991:0:190493:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1788572124.837053:0:190493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e59059d0000 from MGS, refs=2 00080000:01000000:3.0:1788572124.837058:0:190493:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788572124.837063:0:190493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bcfab 00010000:00010000:3.0:1788572124.837193:0:190493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1788572124.840932:0:190493:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788572124.846285:0:190497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788572124.846359:0:190493:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788572124.846430:0:190493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788572124.849811:0:190493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788572124.850124:0:190493:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572124.850346:0:190493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788572124.850355:0:190493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788572124.851135:0:190493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788572124.851143:0:190493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788572124.851403:0:190493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788572124.851409:0:190493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788572124.856666:0:190493:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788572124.856698:0:190493:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788572124.856700:0:190493:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.157@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788572124.856704:0:190493:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.157@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788572124.856710:0:190493:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 254, was 0): CONNECTING 00000100:00100000:1.0:1788572124.856716:0:190493:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:3.0:1788572125.052734:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572125.052755:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584228864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572125.052833:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572125.053147:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584228864 00000100:00100000:2.0:1788572125.053156:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584228864 00000100:00100000:2.0:1788572125.053294:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6189 00000100:00100000:2.0:1788572125.053304:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584228864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572125.053335:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572125.053401:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584228864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572125.053408:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6189 00000100:00100000:2.0:1788572125.053454:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584228864:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572125.053581:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572125.054341:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584228992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572125.054396:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572125.054573:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584228992 00000100:00100000:0.0:1788572125.054579:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584228992 00000100:00100000:0.0:1788572125.054628:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6190 00000100:00100000:0.0:1788572125.054636:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584228992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572125.054657:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572125.054695:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584228992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572125.054702:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6190 00000100:00100000:0.0:1788572125.054737:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584228992:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572125.054837:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572125.629431:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572126.059743:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572126.059812:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572126.060166:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569459328 00000100:00100000:1.0:1788572126.060183:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569459200 00000100:00100000:2.0:1788572126.060183:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569459328 00000100:00100000:1.0:1788572126.060188:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569459200 00000100:00100000:1.0:1788572126.060273:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 90 00000100:00100000:1.0:1788572126.060290:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569459200:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572126.060403:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569459200:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 119us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572126.060411:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 90 00000100:00100000:0.0:1788572126.060942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572126.065046:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7554 00000100:00100000:2.0:1788572126.065066:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569459328:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572126.065757:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569459328:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 694us (5940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572126.065767:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7554 00000100:00100000:2.0:1788572126.065951:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569459072 00000100:00100000:2.0:1788572126.065962:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569459072 00000100:00100000:2.0:1788572126.066001:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 907 00000100:00100000:2.0:1788572126.066006:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569459072:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572126.066028:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572126.066060:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569459072:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 53us (5123us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572126.066067:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 907 00000100:00080000:1.0:1788572126.066632:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572126.066640:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788572126.656197:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572127.101631:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572117/real 1788572117] req@ffff8e59028efb80 x1875444584226432/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572127 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572127.101667:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e59028efb80 x1875444584226432/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572127 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572127.101689:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572127.101877:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788572127.101892:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584226432:0@lo:250:kworker.0 10000000:01000000:1.0:1788572127.102235:0:190493:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1788572127.102264:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590d14b400/0x265cfe11109b655b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b6562 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102279:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590d14b400/0x265cfe11109b655b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b6562 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102288:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788572127.102309:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102323:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590d14b400/0x265cfe11109b655b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b6562 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102362:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9e00/0x265cfe11109b62f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b62fa expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102369:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9e00/0x265cfe11109b62f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b62fa expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102375:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572127.102379:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102384:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9e00/0x265cfe11109b62f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b62fa expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102396:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5904a7b400/0x265cfe11109b63cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b63d3 expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102402:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5904a7b400/0x265cfe11109b63cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b63d3 expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102408:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572127.102411:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102415:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5904a7b400/0x265cfe11109b63cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b63d3 expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102425:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8800/0x265cfe11109b6507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b650e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102432:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8800/0x265cfe11109b6507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b650e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102437:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572127.102441:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102444:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8800/0x265cfe11109b6507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b650e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102454:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5904a7a200/0x265cfe11109b6515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b651c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102462:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5904a7a200/0x265cfe11109b6515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b651c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102467:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572127.102471:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102474:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5904a7a200/0x265cfe11109b6515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b651c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102548:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8e00/0x265cfe11109b6531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b6538 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102560:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8e00/0x265cfe11109b6531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b6538 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102565:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572127.102569:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102572:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed8e00/0x265cfe11109b6531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b6538 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102582:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109b653f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b6546 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102588:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109b653f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b6546 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102593:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572127.102597:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102600:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109b653f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b6546 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102610:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590d14a800/0x265cfe11109b6569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b6570 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102617:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590d14a800/0x265cfe11109b6569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b6570 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102623:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572127.102627:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102630:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590d14a800/0x265cfe11109b6569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b6570 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102648:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a245f4e00/0x265cfe11109b64f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b6500 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102656:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a245f4e00/0x265cfe11109b64f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b6500 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102662:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572127.102665:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102669:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a245f4e00/0x265cfe11109b64f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b6500 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102684:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9600/0x265cfe11109b62de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b62e5 expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102691:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9600/0x265cfe11109b62de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b62e5 expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102697:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572127.102701:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102704:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9600/0x265cfe11109b62de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b62e5 expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102716:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5904a7be00/0x265cfe11109b63b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b63be expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102723:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5904a7be00/0x265cfe11109b63b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b63be expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102729:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788572127.102733:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102737:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5904a7be00/0x265cfe11109b63b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b63be expref: -99 pid: 188041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102746:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9000/0x265cfe11109b6523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b652a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102754:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9000/0x265cfe11109b6523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b652a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102759:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788572127.102762:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102766:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a31ed9000/0x265cfe11109b6523 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b652a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.102775:0:190493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5904a7a800/0x265cfe11109b654d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109b6554 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572127.102782:0:190493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5904a7a800/0x265cfe11109b654d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109b6554 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.102789:0:190493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788572127.102792:0:190493:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788572127.102795:0:190493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5904a7a800/0x265cfe11109b654d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109b6554 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572127.103400:0:190493:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 254, was 0): DISCONN 00000100:00080000:1.0:1788572127.103410:0:190493:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572127.103419:0:190493:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 8870 00000100:00080000:1.0:1788572127.103426:0:190493:0:(import.c:630:import_select_connection()) MGC192.168.202.157@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572127.103435:0:190493:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572127.103520:0:190493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cd3800 x1875444584229120/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572127.103588:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584229120:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788572127.103691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572127.103775:0:190493:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788572127.103825:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584229120 00000100:00100000:1.0:1788572127.103835:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584229120 00000100:00100000:1.0:1788572127.103953:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572127.103965:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875444584229120:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788572127.104134:0:190499:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e87131b0-4a60-4def-a26d-6e23dcfe5daa@0@lo t0 exp 0000000000000000 cur 8880 last 0 00000020:00000080:1.0:1788572127.104183:0:190499:0:(genops.c:1385:class_connect()) connect: client e87131b0-4a60-4def-a26d-6e23dcfe5daa, cookie 0x265cfe11109bcfb2 00000100:00080000:1.0:1788572127.104423:0:190499:0:(import.c:65:import_set_state_nolock()) ffff8e5904e06800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788572127.104522:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572127.104535:0:105698:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788572127.104539:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572127.104545:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572127.104551:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572127.104565:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8876 00000100:00080000:0.0:1788572127.104617:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572127.104628:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572127.104687:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f31c00 x1875444584229248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572127.113033:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584229248:0@lo:38:kworker.0 00000100:00100000:2.0:1788572127.113148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.113345:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584229248 00000100:00100000:3.0:1788572127.113362:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584229248 00000100:00100000:3.0:1788572127.113424:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:3.0:1788572127.113433:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584229248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572127.113457:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572127.113588:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584229248:12345-0@lo:38:kworker.0 Request processed in 155us (440us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572127.113595:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1788572127.117434:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+5:3640:x1875444584229120:12345-0@lo:250:mount.lustre.0 Request processed in 13452us (13726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572127.117455:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788572127.118974:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572127.118983:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572127.118987:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572127.118995:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8876 00000100:00080000:0.0:1788572127.119002:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572127.119009:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572127.119034:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f30e00 x1875444584229504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572127.119077:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572127.119083:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572127.119087:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572127.119091:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8876 00000100:00080000:0.0:1788572127.119096:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788572127.119201:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584229376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572127.119301:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.119420:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584229376 00000100:00100000:3.0:1788572127.119431:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584229376 00000100:00100000:3.0:1788572127.119533:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788572127.119548:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584229376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572127.119615:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584229376:12345-0@lo:400:kworker.0 Request processed in 72us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.119623:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788572127.119682:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584229376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572127.119732:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584229632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572127.119762:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.119796:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584229632 00000100:00100000:3.0:1788572127.119800:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584229632 00000100:00080000:1.0:1788572127.120166:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572127.120273:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.157@tcp: committing for last_committed 0 gen 78 00000100:00080000:2.0:1788572127.120286:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.157@tcp: connect to target with instance 0 00000100:00080000:2.0:1788572127.120298:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.157@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788572127.120304:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788572127.120310:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788572127.120313:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788572127.120369:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788572127.120382:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584229120:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788572127.120405:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584229504:0@lo:38:kworker.0 00000100:00100000:2.0:1788572127.120448:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572127.120497:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572127.120503:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572127.120507:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584229248:0@lo:38:kworker.0 00000020:01000000:2.0:1788572127.120573:0:177620:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.202.157@tcp 10000000:01000000:2.0:1788572127.120600:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788572127.120604:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788572127.120606:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788572127.120608:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572127.120609:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572127.120611:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572127.120612:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572127.120614:0:177620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572127.120616:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572127.120618:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788572127.120652:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788572127.120657:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788572127.120659:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788572127.120661:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788572127.120662:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572127.120664:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572127.120665:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572127.120666:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572127.120667:0:177620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572127.120669:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572127.120670:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788572127.120689:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788572127.120694:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788572127.120696:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788572127.120697:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788572127.120699:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572127.120700:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572127.120701:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572127.120702:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572127.120704:0:177620:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572127.120705:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572127.120706:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788572127.120716:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788572127.120765:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584229504 00000100:00100000:2.0:1788572127.120771:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584229504 00000100:00100000:2.0:1788572127.120820:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1788572127.120829:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584229504:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572127.120849:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572127.122384:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788572127.122400:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584229632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572127.125391:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584229632:12345-0@lo:400:kworker.0 Request processed in 2978us (5612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.125411:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788572127.125496:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572127.125507:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572127.125536:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584230016:0@lo:253:kworker.0 00000100:00100000:2.0:1788572127.125631:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584229504:12345-0@lo:38:kworker.0 Request processed in 4800us (5180us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572127.125642:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1788572127.125708:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584229632:0@lo:400:kworker.0 00000100:00100000:2.0:1788572127.125735:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572127.125742:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584229760:0@lo:253:kworker.0 00000100:00100000:2.0:1788572127.125803:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572127.125906:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572127.125912:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572127.125916:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584229504:0@lo:38:kworker.0 00000100:00100000:2.0:1788572127.125974:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584229760 00000100:00100000:2.0:1788572127.125982:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584229760 00000100:00100000:2.0:1788572127.126039:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788572127.126048:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+5:3643:x1875444584229760:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788572127.126087:0:190501:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1788572127.126240:0:190502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788572127.126401:0:190501:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 323 00000100:00080000:2.0:1788572127.126806:0:190493:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1788572127.126822:0:190493:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788572127.126867:0:190493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788572127.126874:0:190493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788572127.126950:0:190493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.157@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788572127.126997:0:190493:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.157@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788572127.127003:0:190493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788572127.127006:0:190493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572127.127007:0:190493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572127.127009:0:190493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572127.127010:0:190493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572127.127011:0:190493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572127.127013:0:190493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572127.127015:0:190493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572127.127017:0:190493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572127.127018:0:190493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572127.127021:0:190493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788572127.127023:0:190493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788572127.127024:0:190493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572127.127026:0:190493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572127.127027:0:190493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572127.127028:0:190493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572127.127029:0:190493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572127.127031:0:190493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572127.127032:0:190493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572127.127033:0:190493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572127.127035:0:190493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572127.127059:0:190493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788572127.127079:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584230144:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788572127.127144:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.127175:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a060e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.127207:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584230144 00000100:00100000:2.0:1788572127.127213:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584230144 00000100:00100000:2.0:1788572127.127246:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788572127.127255:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+6:190493:x1875444584230144:12345-0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788572127.127662:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.127713:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572127.127722:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584229888:0@lo:253:kworker.0 00000100:00100000:3.0:1788572127.127756:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.128131:0:190500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788572127.128142:0:190500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1788572127.128312:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584230016 00000100:00100000:2.0:1788572127.128319:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584230016 00000100:00100000:2.0:1788572127.128361:0:190500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788572127.128368:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584229888 00000100:00100000:2.0:1788572127.128372:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584229888 00000100:00100000:2.0:1788572127.128456:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788572127.128466:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3642:x1875444584230016:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788572127.128520:0:190503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788572127.134151:0:190504:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788572127.134160:0:190504:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788572127.134163:0:190504:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788572127.134166:0:190504:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788572127.134397:0:190504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788572127.134872:0:190501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788572127.134912:0:190501:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788572127.135010:0:190499:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788572127.135016:0:190499:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788572127.135023:0:190499:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1788572127.135033:0:190499:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788572127.136662:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:190493:x1875444584230144:12345-0@lo:253:mount.lustre.0 Request processed in 9396us (9505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.136693:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788572127.136795:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584230144:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788572127.136818:0:190493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788572127.136821:0:190493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788572127.136823:0:190493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788572127.136824:0:190493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572127.136825:0:190493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572127.136827:0:190493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572127.136828:0:190493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572127.136829:0:190493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788572127.136831:0:190493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788572127.136833:0:190493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572127.136834:0:190493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788572127.136861:0:190493:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e59059d0000 from lustre-MDT0000 10000000:01000000:3.0:1788572127.136902:0:190493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788572127.136905:0:190493:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788572127.136914:0:190493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e59059d0000 10000000:01000000:3.0:1788572127.136918:0:190493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788572127.136924:0:190493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e59059d0000 10000000:01000000:3.0:1788572127.136927:0:190493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788572127.136931:0:190493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e59059d0000 from 1 10000000:01000000:3.0:1788572127.136935:0:190493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788572127.136974:0:190493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.136986:0:190493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.136997:0:190493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572127.137020:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584230272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572127.137063:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.137100:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572127.137121:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584230272 00000100:00100000:3.0:1788572127.137128:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584230272 00000100:00100000:3.0:1788572127.137160:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572127.137168:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3642:x1875444584229888:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788572127.137195:0:190500:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788572127.139200:0:190501:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572127.139218:0:190501:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788572127.140398:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3643:x1875444584229760:12345-0@lo:253:kworker.0 Request processed in 14338us (14583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.140419:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788572127.140522:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788572127.140543:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:190493:x1875444584230272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572127.140563:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572127.140595:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1e00/0x265cfe11109bcfc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bcfb9 expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.140637:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1e00/0x265cfe11109bcfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bcfb9 expref: 8 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.140654:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1e00/0x265cfe11109bcfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcfb9 expref: 8 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.140666:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1e00, rc 0) 00000100:00100000:2.0:1788572127.140728:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:190493:x1875444584230272:12345-0@lo:101:mount.lustre.0 Request processed in 195us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.140739:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788572127.141307:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f31500 x1875444584230400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000004:2.0:1788572127.141315:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788572127.141322:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788572127.141337:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572127.141342:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572127.141344:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572127.141347:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572127.141348:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572127.141350:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572127.141353:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788572127.141358:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584229760:0@lo:253:kworker.0 00000100:00100000:0.0:1788572127.141387:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584230400:0@lo:38:kworker.0 20000000:01000000:2.0:1788572127.141415:0:190502:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572127.141422:0:190502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572127.141442:0:190502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.141456:0:190502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788572127.141468:0:190502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000046873s 00010000:00010000:2.0:1788572127.141475:0:190502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.141505:0:190502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.141513:0:190502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.141520:0:190502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.141526:0:190502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572127.141531:0:190502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.141541:0:190502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.141555:0:190502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.141564:0:190502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.141571:0:190502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bcfc7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572127.141672:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584230272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572127.141694:0:190493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.141705:0:190493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.141721:0:190493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788572127.141781:0:190493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.141795:0:190493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572127.141818:0:190493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788572127.141824:0:190493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788572127.141831:0:190493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e59059d0000 10000000:01000000:1.0:1788572127.141835:0:190493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788572127.141840:0:190493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788572127.141843:0:190493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788572127.141871:0:190493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.141888:0:190493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.141899:0:190493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572127.141920:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584230528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572127.141978:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572127.142101:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a37366cc0 going to sleep for 11 seconds 20000000:01000000:1.0:1788572127.142134:0:190500:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788572127.142288:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584230528 00000100:00100000:1.0:1788572127.142296:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584230528 00000100:00100000:1.0:1788572127.142361:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572127.142372:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:190493:x1875444584230528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572127.142386:0:190499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572127.142403:0:190499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd3e00/0x265cfe11109bcfd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bcfce expref: -99 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.142425:0:190499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd3e00/0x265cfe11109bcfd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bcfce expref: 9 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.142435:0:190499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd3e00/0x265cfe11109bcfd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bcfce expref: 9 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.142443:0:190499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3e00, rc 0) 00000100:00100000:1.0:1788572127.142514:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:190493:x1875444584230528:12345-0@lo:101:mount.lustre.0 Request processed in 143us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572127.142521:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572127.142603:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584230656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572127.142637:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572127.142675:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584230656 00000100:00100000:1.0:1788572127.142678:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584230656 00000100:00100000:1.0:1788572127.142725:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7555 00000100:00100000:1.0:1788572127.142734:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584230656:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788572127.142750:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572127.142778:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584230656:12345-0@lo:400:kworker.0 Request processed in 44us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572127.142788:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7555 00000100:00100000:3.0:1788572127.142829:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584230528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572127.142836:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584230656:0@lo:400:kworker.0 00010000:00010000:3.0:1788572127.142864:0:190493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572127.142884:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572127.142891:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00010000:00010000:3.0:1788572127.142894:0:190493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572127.142896:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572127.142907:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8876 00000100:00080000:1.0:1788572127.142915:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572127.142922:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572127.142931:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584230784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572127.142966:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572127.143006:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584230784 00000100:00100000:3.0:1788572127.143011:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584230912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572127.143013:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584230784 00000100:00100000:3.0:1788572127.143074:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.143130:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572127.143151:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584230912 00000100:00100000:3.0:1788572127.143157:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584230912 00000100:00100000:3.0:1788572127.143199:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788572127.143208:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:190493:x1875444584230912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572127.143371:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:190493:x1875444584230912:12345-0@lo:501:mount.lustre.0 Request processed in 161us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.143382:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788572127.143418:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7556 00000100:00100000:1.0:1788572127.143428:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584230784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572127.143452:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584230912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572127.143517:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584230784:12345-0@lo:400:kworker.0 Request processed in 90us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.143524:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584231040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572127.143535:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7556 00000100:00080000:1.0:1788572127.143561:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572127.143609:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584230784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572127.143799:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cd1500 x1875444584231168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572127.145039:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.145105:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572127.145135:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584231040 00000100:00100000:3.0:1788572127.145142:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584231040 00000100:00100000:3.0:1788572127.145178:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788572127.145186:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:190493:x1875444584231040:12345-0@lo:503:mount.lustre.0 20000000:01000000:3.0:1788572127.147554:0:190500:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788572127.147566:0:190500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788572127.147697:0:190503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788572127.148060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.148112:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584231168:0@lo:38:kworker.0 00000100:00100000:0.0:1788572127.148146:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.148182:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584230400 00000100:00100000:0.0:1788572127.148188:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584230400 00000100:00100000:0.0:1788572127.148228:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788572127.148236:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584230400:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572127.148259:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572127.148312:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584230400:12345-0@lo:38:kworker.0 Request processed in 75us (254us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572127.148320:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788572127.148359:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584231168 00000100:00100000:0.0:1788572127.148363:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584231168 00000100:00100000:0.0:1788572127.148394:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1788572127.148400:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584231168:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572127.148412:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788572127.148468:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572127.148512:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 20000000:01000000:2.0:1788572127.148515:0:190502:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000100:00100000:1.0:1788572127.148520:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584230400:0@lo:38:kworker.0 10000000:01000000:2.0:1788572127.148525:0:190502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572127.148559:0:190502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.148577:0:190502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788572127.148587:0:190502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063756s 00010000:00010000:2.0:1788572127.148591:0:190502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.148597:0:190502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.148604:0:190502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.148612:0:190502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.148618:0:190502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572127.148625:0:190502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.148633:0:190502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.148646:0:190502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.148654:0:190502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.148660:0:190502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bcfdc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572127.149265:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584231168:12345-0@lo:38:kworker.0 Request processed in 861us (1115us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572127.149274:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00080000:3.0:1788572127.150655:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572127.150666:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572127.150672:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584231168:0@lo:38:kworker.0 00000100:00100000:3.0:1788572127.153520:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:190493:x1875444584231040:12345-0@lo:503:mount.lustre.0 Request processed in 8272us (8424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.153545:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788572127.153778:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584231040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572127.154304:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:3642:x1875444584229888:12345-0@lo:253:kworker.0 Request processed in 17132us (26542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.154316:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:3.0:1788572127.154777:0:190503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788572127.154789:0:190503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788572127.155177:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3642:x1875444584230016:12345-0@lo:253:kworker.0 Request processed in 26708us (27511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.155188:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788572127.155431:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788572127.155435:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788572127.155437:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572127.155439:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572127.155441:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572127.155443:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572127.155445:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572127.155448:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572127.155449:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788572127.155465:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584229888:0@lo:253:kworker.0 00000020:01000004:2.0:1788572127.155504:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788572127.155506:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788572127.155509:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572127.155510:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572127.155512:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572127.155515:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572127.155517:0:3642:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572127.155518:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572127.155520:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788572127.155522:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584230016:0@lo:253:kworker.0 20000000:01000000:2.0:1788572127.155574:0:190502:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572127.155580:0:190502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572127.155765:0:190502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.155788:0:190502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788572127.155799:0:190502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000220890s 00010000:00010000:2.0:1788572127.155806:0:190502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.155814:0:190502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.155823:0:190502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.155833:0:190502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.155839:0:190502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572127.155845:0:190502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.155854:0:190502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.155872:0:190502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.155892:0:190502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.155901:0:190502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe0000/0x265cfe11109bcfe3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572127.162000:0:190505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190505:1875444584231296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572127.162130:0:190505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.162190:0:190505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.162264:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584231296 00000100:00100000:2.0:1788572127.162274:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584231296 00000100:00100000:2.0:1788572127.162343:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572127.162356:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:190505:x1875444584231296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572127.163616:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:190505:x1875444584231296:12345-0@lo:502:llog_process_th.0 Request processed in 1253us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.163632:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788572127.163816:0:190505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190505:1875444584231296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788572127.163859:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572127.163874:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572127.163877:0:190505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788572127.163893:0:190505:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788572127.163897:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788572127.163914:0:190505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e5a413fcd40) 00000020:00000080:0.0:1788572127.163943:0:190505:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1788572127.163948:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788572127.164139:0:190505:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788572127.164162:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bcff1 00000020:00000080:1.0:1788572127.164426:0:190505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788572127.164437:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572127.164444:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572127.164445:0:190505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788572127.164449:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572127.164455:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572127.164457:0:190505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788572127.164462:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788572127.164474:0:190505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e5905f5b380) 00000020:00000080:1.0:1788572127.164522:0:190505:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1788572127.164530:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788572127.164532:0:190505:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788572127.164535:0:190505:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788572127.164541:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788572127.164615:0:190505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e59059d0000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788572127.164635:0:190505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e5a37203380) 00000020:00000080:1.0:1788572127.164646:0:190505:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1788572127.164707:0:190505:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788572127.164712:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd006 00000020:00000080:1.0:1788572127.165781:0:190505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788572127.165807:0:190505:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788572127.165817:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x265cfe11109bd00d 00080000:01000000:1.0:1788572127.165824:0:190505:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788572127.165829:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd014 00010000:00010000:2.0:1788572127.301292:0:190505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788572127.301609:0:190505:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d idx: 0 lr: 326417522063 srv lr: 330712481792 lx: 0 gen 18 00000001:00080000:2.0:1788572127.301662:0:190505:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 326417519069 srv lr: 330712481792 lx: 0 gen 22 00000001:00000004:2.0:1788572127.301689:0:190505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 78, last_transno is 330712481792 00000001:00080000:2.0:1788572127.301808:0:190505:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788572127.301863:0:190505:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5a2467b6c0: xid 1875444569452160, transno 330712481931, client gen 18, slot idx 0 00000001:00080000:2.0:1788572127.301874:0:190505:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5a2467b540: xid 1875444569452672, transno 330712481932, client gen 18, slot idx 1 00000001:00080000:2.0:1788572127.301879:0:190505:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5a2467bf00: xid 1875444581057152, transno 326417519069, client gen 22, slot idx 2 00000001:00080000:2.0:1788572127.301884:0:190505:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5a2467be40: xid 1875444569105664, transno 326417521765, client gen 18, slot idx 3 00000001:00080000:2.0:1788572127.301890:0:190505:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5a10d4f3c0: xid 1875444567597824, transno 326417519807, client gen 18, slot idx 4 00000001:00080000:2.0:1788572127.301894:0:190505:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5a10d4f780: xid 1875444562639360, transno 322122556265, client gen 18, slot idx 5 00000020:00000080:2.0:1788572127.302561:0:190505:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e5a401499c0) 00000020:00000080:2.0:1788572127.302582:0:190505:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788572127.302658:0:190505:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788572127.302665:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd030 00000020:00000080:3.0:1788572127.310265:0:190505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788572127.321429:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x265cfe11109bd037 00000020:00000080:3.0:1788572127.321952:0:190505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788572127.321964:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572127.321970:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572127.321972:0:190505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788572127.321975:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572127.321978:0:190505:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788572127.321980:0:190505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572127.321981:0:190505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572127.321983:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572127.321985:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572127.321986:0:190505:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572127.321988:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572127.321993:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572127.321994:0:190505:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788572127.321998:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788572127.322034:0:190505:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788572127.322049:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572127.322051:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572127.322052:0:190505:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788572127.322055:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572127.322057:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572127.322059:0:190505:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788572127.322061:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572127.322067:0:190505:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:00000080:3.0:1788572127.322089:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572127.322103:0:190505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e5a109f8000) 00000020:00000080:3.0:1788572127.322118:0:190505:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788572127.322122:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572127.322171:0:190505:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788572127.322175:0:190505:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788572127.322180:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd045 00010000:00080000:3.0:1788572127.322210:0:190505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5902898800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572127.324608:0:190505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788572127.331162:0:190505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572127.331178:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788572127.331225:0:190505:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788572127.331257:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd04c 00000100:00080000:3.0:1788572127.331269:0:190505:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572127.331276:0:190505:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e5902898800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572127.331312:0:190505:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36bd5500 x1875444584231424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572127.331351:0:190505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788572127.331424:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572127.331521:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572127.331524:0:190505:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788572127.331527:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572127.331530:0:190505:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788572127.331532:0:190505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572127.331533:0:190505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572127.331535:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572127.331537:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572127.331539:0:190505:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572127.331541:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788572127.331547:0:190505:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788572127.331550:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572127.331552:0:190505:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788572127.331555:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572127.331558:0:190505:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:3.0:1788572127.331582:0:190505:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788572127.331584:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572127.331615:0:190505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e5901bfb380) 00000020:00000080:3.0:1788572127.331631:0:190505:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788572127.331637:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572127.331695:0:190505:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788572127.331701:0:190505:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788572127.331707:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd05a 00010000:00080000:3.0:1788572127.331738:0:190505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a41267000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572127.331923:0:190505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1788572127.332518:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584231424:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572127.332603:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.334299:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584231424 00000100:00100000:3.0:1788572127.334312:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584231424 00000100:00100000:3.0:1788572127.334376:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788572127.334385:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584231424:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788572127.334442:0:189111:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8880 last 0 00000020:00000080:3.0:1788572127.334518:0:189111:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd061 00000004:00100000:3.0:1788572127.334534:0:189111:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572127.334635:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e5a41266000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572127.334725:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584231424:12345-0@lo:38:llog_process_th.0 Request processed in 339us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.334733:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788572127.334861:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788572127.334871:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 5 00000100:00080000:2.0:1788572127.334888:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788572127.334894:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788572127.334897:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5902898800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788572127.334908:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584231424:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572127.335087:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572127.335099:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584231552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572127.335136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572127.335169:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584231552 00000100:00100000:1.0:1788572127.335173:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584231552 00000100:00100000:1.0:1788572127.335199:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788572127.335206:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584231552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572127.335228:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:1.0:1788572127.335261:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584231552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572127.335267:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788572127.335294:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584231552:0@lo:41:osp-pre-1-0.0 00000040:01000000:0.0:1788572127.336062:0:190505:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788572127.336095:0:190505:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788572127.336603:0:190505:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 76, last_idx 77 00000040:00080000:0.0:1788572127.337329:0:190505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572127.337425:0:190505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].78, 64 off13184 00000040:00080000:0.0:1788572127.337824:0:190505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x138:0x0].1, 64 off8256 00000040:00080000:2.0:1788572127.340191:0:190511:0:(llog.c:805:llog_process_thread()) index: 77, lh_last_idx: 78 synced_idx: 0 lgh_last_idx: 78 00000040:00080000:2.0:1788572127.340199:0:190511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x134:0x0] at index 77 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788572127.340552:0:190511:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 77, last_idx 78 00000040:00080000:2.0:1788572127.340575:0:190511:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x134:0x0] at index 77 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788572127.340715:0:190511:0:(llog.c:805:llog_process_thread()) index: 78, lh_last_idx: 78 synced_idx: 78 lgh_last_idx: 78 00000040:00080000:2.0:1788572127.340719:0:190511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x138:0x0] at index 78 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788572127.342176:0:190505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572127.342190:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788572127.342233:0:190505:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788572127.342255:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd068 00000100:00080000:2.0:1788572127.342267:0:190505:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788572127.342273:0:190505:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5a41267000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572127.342312:0:190505:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fbb6300 x1875444584231680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572127.342392:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584231680:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788572127.342470:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572127.342574:0:190505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788572127.342664:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572127.342668:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.342670:0:190505:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788572127.342674:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788572127.342676:0:190505:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788572127.342679:0:190505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572127.342680:0:190505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572127.342681:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788572127.342684:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.342685:0:190505:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788572127.342687:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788572127.342692:0:190505:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788572127.342695:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.342696:0:190505:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788572127.342699:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788572127.342703:0:190505:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:2.0:1788572127.342723:0:190505:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788572127.342726:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788572127.342738:0:190505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e5a4014b380) 00000020:00000080:2.0:1788572127.342756:0:190505:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788572127.342761:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788572127.342848:0:190505:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788572127.342854:0:190505:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788572127.342861:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd076 00010000:00080000:2.0:1788572127.342891:0:190505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a071d4000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:2.0:1788572127.343089:0:190505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788572127.343172:0:190505:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788572127.343195:0:190505:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788572127.343438:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584231680 00000100:00100000:0.0:1788572127.343447:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584231680 00000100:00100000:0.0:1788572127.343509:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22592 00000100:00100000:0.0:1788572127.343517:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875444584231680:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788572127.343545:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8880 last 0 00000020:00000080:0.0:1788572127.343569:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd07d 00002000:00100000:0.0:1788572127.343583:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e590bb67000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788572127.343588:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788572127.343591:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788572127.343663:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788572127.343690:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8e590bb64800 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788572127.344668:0:190505:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 76, last_idx 77 00000040:00080000:2.0:1788572127.347015:0:190505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572127.347048:0:190505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].78, 64 off13184 00000040:00080000:2.0:1788572127.347205:0:190505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13a:0x0].1, 64 off8256 00000040:00080000:3.0:1788572127.351168:0:190513:0:(llog.c:805:llog_process_thread()) index: 77, lh_last_idx: 78 synced_idx: 0 lgh_last_idx: 78 00000040:00080000:3.0:1788572127.351177:0:190513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x136:0x0] at index 77 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788572127.351420:0:190513:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 77, last_idx 78 00000040:00080000:3.0:1788572127.351445:0:190513:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x136:0x0] at index 77 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788572127.351623:0:190513:0:(llog.c:805:llog_process_thread()) index: 78, lh_last_idx: 78 synced_idx: 78 lgh_last_idx: 78 00000040:00080000:3.0:1788572127.351627:0:190513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13a:0x0] at index 78 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788572127.353005:0:190505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572127.353019:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788572127.353070:0:190505:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788572127.353097:0:190505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd084 00000100:00080000:2.0:1788572127.353109:0:190505:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788572127.353116:0:190505:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5a071d4000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572127.353157:0:190505:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fbb7100 x1875444584231808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572127.353175:0:190505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788572127.353234:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572127.353238:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.353240:0:190505:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788572127.353243:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572127.353259:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.353261:0:190505:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788572127.353265:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788572127.353266:0:190505:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788572127.353268:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572127.353271:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.353272:0:190505:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788572127.353275:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572127.353277:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.353278:0:190505:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788572127.353281:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788572127.353313:0:190505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190505:1875444584231936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572127.353427:0:190505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.353465:0:190505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906963b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572127.355108:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584231936 00000100:00100000:3.0:1788572127.355122:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584231936 00000100:00100000:3.0:1788572127.355180:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788572127.355190:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:190505:x1875444584231936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572127.355398:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:190505:x1875444584231936:12345-0@lo:502:llog_process_th.0 Request processed in 207us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.355409:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788572127.355501:0:190505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190505:1875444584231936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572127.355536:0:190505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572127.355543:0:190505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572127.355545:0:190505:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788572127.355549:0:190505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788572127.355625:0:190493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788572127.355651:0:190493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788572127.355669:0:190493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.355681:0:190493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572127.355689:0:190493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e59059d0000 from 1 10000000:01000000:3.0:1788572127.355692:0:190493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572127.355721:0:190493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.355729:0:190493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.355740:0:190493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572127.355758:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572127.355792:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.355825:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572127.355851:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584232064 00000100:00100000:3.0:1788572127.355854:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584232064 00000100:00100000:3.0:1788572127.357136:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788572127.357154:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:190493:x1875444584232064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572127.357168:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572127.357190:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd08b expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.357217:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd08b expref: 9 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.357228:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd08b expref: 9 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.357239:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00031800, rc 0) 00000100:00100000:3.0:1788572127.357337:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:190493:x1875444584232064:12345-0@lo:101:mount.lustre.0 Request processed in 189us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.357344:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572127.357699:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572127.357719:0:190493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.357730:0:190493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572127.358299:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232192:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788572127.358374:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.358415:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59069630c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572127.358991:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584232192 00000100:00100000:3.0:1788572127.358999:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584232192 00000100:00100000:3.0:1788572127.359054:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788572127.359065:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:190493:x1875444584232192:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788572127.359089:0:190500:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788572127.359114:0:190500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788572127.359118:0:190500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788572127.359121:0:190500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788572127.359124:0:190500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 326 00000100:00100000:2.0:1788572127.359509:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232192:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788572127.359642:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572127.359652:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 8 00000100:00080000:1.0:1788572127.359660:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788572127.359666:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788572127.359670:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a41267000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788572127.359686:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788572127.359693:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584231680:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788572127.359717:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584231808:0@lo:8:llog_process_th.0 10000000:01000000:2.0:1788572127.360434:0:190493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572127.360455:0:190493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.360467:0:190493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572127.360477:0:190493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e59059d0000 from 1 10000000:01000000:2.0:1788572127.360509:0:190493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572127.360540:0:190493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.360549:0:190493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.360559:0:190493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572127.360576:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572127.360615:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.360647:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59069630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.360700:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584232320 00000100:00100000:2.0:1788572127.360706:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584232320 00000100:00100000:2.0:1788572127.360742:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788572127.360750:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:190493:x1875444584232320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572127.360766:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572127.360780:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd0a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd099 expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.360801:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd0a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd099 expref: 11 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.360812:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd0a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd099 expref: 11 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.360820:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1c00, rc 0) 00000100:00100000:2.0:1788572127.360854:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190493:x1875444584232320:12345-0@lo:101:mount.lustre.0 Request processed in 104us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.360860:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788572127.360903:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572127.360916:0:190493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.360924:0:190493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572127.360982:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572127.361007:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.361020:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59069630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.361038:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584232448 00000100:00100000:2.0:1788572127.361042:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584232448 00000100:00100000:2.0:1788572127.361063:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572127.361068:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190493:x1875444584232448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572127.361210:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190493:x1875444584232448:12345-0@lo:501:mount.lustre.0 Request processed in 141us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.361217:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572127.361248:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572127.361279:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572127.361333:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.361347:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59069630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.361363:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584232576 00000100:00100000:2.0:1788572127.361367:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584232576 00000100:00100000:2.0:1788572127.361387:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788572127.361393:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190493:x1875444584232576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572127.361474:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190493:x1875444584232576:12345-0@lo:503:mount.lustre.0 Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.361507:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788572127.361548:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584232576:0@lo:503:mount.lustre.0 00000004:00080000:2.0:1788572127.361703:0:190511:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788572127.361770:0:190511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8880356290174ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788572127.361777:0:190511:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788572127.363941:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584231680:12345-0@lo:8:llog_process_th.0 Request processed in 20415us (21461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.363956:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22592 00000100:00100000:0.0:1788572127.364077:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584232704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572127.364137:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.364182:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584232704 00000100:00100000:0.0:1788572127.364188:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584232704 00000100:00100000:0.0:1788572127.364230:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6191 00000100:00100000:0.0:1788572127.364238:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584232704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572127.364264:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572127.364302:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584232704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.364309:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6191 00000100:00100000:0.0:1788572127.364542:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584232704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572127.364573:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572127.364703:0:190515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190515:1875444584232832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572127.364758:0:190515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.364783:0:190515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572127.364809:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584232832 00000100:00100000:0.0:1788572127.364814:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584232832 00000100:00100000:0.0:1788572127.364842:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788572127.364849:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190515:x1875444584232832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572127.366163:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572127.366347:0:190494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788572127.366897:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584231808 00000100:00100000:0.0:1788572127.366906:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584231808 00000100:00100000:0.0:1788572127.366944:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22593 00000100:00100000:0.0:1788572127.366951:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3640:x1875444584231808:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788572127.366982:0:43931:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8880 last 0 00000020:00000080:0.0:1788572127.367019:0:43931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd0a7 00002000:00100000:0.0:1788572127.367036:0:43931:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e590bb63800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788572127.367040:0:43931:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788572127.367043:0:43931:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788572127.367118:0:43931:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788572127.367150:0:43931:0:(import.c:65:import_set_state_nolock()) ffff8e590bb66000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572127.367222:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584231808:12345-0@lo:8:llog_process_th.0 Request processed in 270us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.367230:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22593 00000100:00100000:1.0:1788572127.367400:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572127.367409:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788572127.367417:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788572127.367423:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788572127.367425:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788572127.367442:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788572127.367447:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584231808:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788572127.367526:0:190513:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788572127.367589:0:190513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8880362108497ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788572127.367595:0:190513:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788572127.368635:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190515:x1875444584232832:12345-0@lo:502:llog_process_th.0 Request processed in 3783us (3873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.368647:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788572127.368715:0:190515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190515:1875444584232832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572127.368746:0:190515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572127.368756:0:190515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.368758:0:190515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788572127.368767:0:190515:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e59059d0000 00000020:00000080:2.0:1788572127.368769:0:190515:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788572127.368777:0:190515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572127.368779:0:190515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.368780:0:190515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788572127.368783:0:190515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572127.368785:0:190515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.368786:0:190515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788572127.368790:0:190515:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e59059d0000 00000020:00000080:2.0:1788572127.368792:0:190515:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788572127.368862:0:190515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190515:1875444584233088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572127.368924:0:190515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.368953:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584233088 00000100:00100000:2.0:1788572127.368958:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584233088 00000100:00100000:2.0:1788572127.368993:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788572127.369002:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190515:x1875444584233088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572127.369091:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190515:x1875444584233088:12345-0@lo:502:llog_process_th.0 Request processed in 90us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.369098:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788572127.369144:0:190515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906963c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.369157:0:190515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190515:1875444584233088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572127.369176:0:190515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572127.369181:0:190515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572127.369183:0:190515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788572127.369186:0:190515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:1.0:1788572127.369568:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584232960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572127.369607:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788572127.371503:0:190493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788572127.371543:0:190493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572127.371562:0:190493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.371575:0:190493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572127.371642:0:190493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788572127.371645:0:190493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e59059d0000 10000000:01000000:0.0:1788572127.371649:0:190493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e59059d0000 10000000:01000000:0.0:1788572127.371652:0:190493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572127.371659:0:190493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e59059d0000 from 1 10000000:01000000:0.0:1788572127.371662:0:190493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572127.371695:0:190493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.371703:0:190493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.371713:0:190493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572127.371737:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584233216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572127.371794:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.371828:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681480 going to sleep for 11 seconds 00000100:00100000:1.0:1788572127.372238:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584232960 00000100:00100000:1.0:1788572127.372246:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584232960 00000100:00100000:1.0:1788572127.372298:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6192 00000100:00100000:1.0:1788572127.372309:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584232960:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572127.372466:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584233216 00000100:00100000:2.0:1788572127.372471:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584233216 00000100:00100000:2.0:1788572127.372516:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572127.372524:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190493:x1875444584233216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572127.372535:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572127.372549:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bd0b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd0ae expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.372573:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bd0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd0ae expref: 12 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.372583:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bd0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd0ae expref: 12 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.372591:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1a00, rc 0) 00000100:00100000:2.0:1788572127.372637:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:190493:x1875444584233216:12345-0@lo:101:mount.lustre.0 Request processed in 114us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.372644:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572127.372694:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584233216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572127.372709:0:190493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572127.372719:0:190493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572127.372775:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584233344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572127.372803:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.372825:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59069639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.372838:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584233344 00000100:00100000:2.0:1788572127.372842:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584233344 00000100:00100000:2.0:1788572127.372864:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788572127.372871:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:190493:x1875444584233344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572127.372981:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:190493:x1875444584233344:12345-0@lo:501:mount.lustre.0 Request processed in 110us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.372989:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788572127.373022:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584233344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572127.373053:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584233472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572127.373093:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.373107:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59069639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.373119:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584233472 00000100:00100000:2.0:1788572127.373122:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584233472 00000100:00100000:2.0:1788572127.373143:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788572127.373149:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:190493:x1875444584233472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572127.373226:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:190493:x1875444584233472:12345-0@lo:503:mount.lustre.0 Request processed in 76us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.373233:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788572127.373273:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584233472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572127.373704:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190493:x1875444584232192:12345-0@lo:256:mount.lustre.0 Request processed in 14640us (15328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.373713:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00000024:1.0:1788572127.376563:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572127.376662:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584232960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4351us (7050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572127.376674:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6192 00000100:00100000:1.0:1788572127.376754:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584232960:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788572127.379676:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572127.381769:0:190517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190517:1875444584233600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572127.381867:0:190517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572127.382011:0:190517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.387069:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584233600 00000100:00100000:2.0:1788572127.387085:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584233600 00000100:00100000:2.0:1788572127.387191:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788572127.387202:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190517:x1875444584233600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572127.387447:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190517:x1875444584233600:12345-0@lo:502:llog_process_th.0 Request processed in 247us (5580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.387456:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788572127.387609:0:190517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190517:1875444584233600:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788572127.387698:0:190517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788572127.387715:0:190517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e5a37200000) 00000020:00000080:1.0:1788572127.387747:0:190517:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788572127.387858:0:190517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e59059d0000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788572127.387861:0:190517:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e59059d0000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788572127.387864:0:190517:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e59059d0000 4 00010000:00080000:1.0:1788572127.387908:0:190517:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e59019de000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:1.0:1788572127.389600:0:190517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000004:00080000:2.0:1788572127.394968:0:190494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:00000080:0.0:1788572127.396679:0:190517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788572127.396742:0:190517:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788572127.396760:0:190517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x265cfe11109bd0c3 00000100:00080000:0.0:1788572127.396772:0:190517:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572127.396779:0:190517:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e59019de000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572127.396813:0:190517:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f33100 x1875444584233728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572127.396843:0:190517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788572127.397101:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584233728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572127.397173:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572127.399639:0:190517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190517:1875444584233856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572127.399723:0:190517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572127.399772:0:190517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.401189:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584233856 00000100:00100000:2.0:1788572127.401202:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584233856 00000100:00100000:0.0:1788572127.401690:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584233728 00000100:00100000:0.0:1788572127.401698:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584233728 00000100:00100000:0.0:1788572127.401732:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1788572127.401741:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584233728:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788572127.401846:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584233728:12345-0@lo:38:llog_process_th.0 Request processed in 104us (4672us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572127.401853:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1788572127.402133:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572127.402142:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019de000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572127.402147:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788572127.402151:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584233728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788572127.402244:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788572127.402256:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190517:x1875444584233856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572127.402416:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190517:x1875444584233856:12345-0@lo:502:llog_process_th.0 Request processed in 163us (2692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.402423:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788572127.402936:0:190517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190517:1875444584233856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572127.403002:0:190517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190517:1875444584233984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572127.403048:0:190517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572127.403078:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584233984 00000100:00100000:1.0:1788572127.403084:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584233984 00000100:00100000:1.0:1788572127.403119:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788572127.403126:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190517:x1875444584233984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572127.403200:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190517:x1875444584233984:12345-0@lo:502:llog_process_th.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572127.403207:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788572127.403261:0:190517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572127.403275:0:190517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190517:1875444584233984:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788572127.403294:0:190517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788572127.409291:0:190493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788572127.409360:0:190493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572127.410601:0:190493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.410616:0:190493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788572127.410741:0:190493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788572127.410744:0:190493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788572127.410745:0:190493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572127.410747:0:190493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572127.410749:0:190493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572127.410750:0:190493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572127.410752:0:190493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572127.410754:0:190493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788572127.410756:0:190493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572127.410758:0:190493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788572127.410763:0:190493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788572127.410765:0:190493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788572127.410767:0:190493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788572127.410768:0:190493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572127.410770:0:190493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572127.410771:0:190493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572127.410772:0:190493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572127.410773:0:190493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572127.410774:0:190493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788572127.410776:0:190493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572127.410777:0:190493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788572127.410808:0:190493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788572127.410831:0:190493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584234112:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788572127.410914:0:190493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572127.410961:0:190493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.411238:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584234112 00000100:00100000:2.0:1788572127.411290:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584234112 00000100:00100000:2.0:1788572127.411354:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788572127.411365:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190493:x1875444584234112:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788572127.411392:0:190499:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788572127.411406:0:190499:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788572127.421961:0:190499:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572127.421984:0:190499:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788572127.422262:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:190493:x1875444584234112:12345-0@lo:253:mount.lustre.0 Request processed in 10895us (11343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572127.422275:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788572127.422390:0:190493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:190493:1875444584234112:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788572127.422405:0:190493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788572127.422408:0:190493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788572127.422410:0:190493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788572127.422411:0:190493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572127.422412:0:190493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572127.422413:0:190493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572127.422414:0:190493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572127.422416:0:190493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572127.422417:0:190493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788572127.422419:0:190493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572127.422420:0:190493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788572127.422435:0:190493:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788572127.425225:0:190502:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788572127.425233:0:190502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788572127.425270:0:190502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.425291:0:190502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd08b expref: 10 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.425298:0:190502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.425350:0:190502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bd08b expref: 10 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.425366:0:190502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109bd08b expref: 10 pid: 190501 timeout: 8980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572127.425380:0:190502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:190502:1875444584234240:0@lo:104: 00000100:00100000:0.0:1788572127.425450:0:190502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.425532:0:190502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572127.425731:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584234240 00000100:00100000:3.0:1788572127.425741:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584234240 00000100:00100000:3.0:1788572127.425794:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5391 00000100:00100000:3.0:1788572127.425804:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:190502:x1875444584234240:12345-0@lo:104: 00010000:00010000:3.0:1788572127.425820:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.425906:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572127.425913:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:190502:x1875444584234240:12345-0@lo:104: Request processed in 110us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.425919:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5391 00010000:00010000:3.0:1788572127.425945:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572127.425950:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.425957:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572127.425961:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.425970:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572127.425977:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572127.425983:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572127.426010:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426016:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572127.426035:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426042:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bd08b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bd092 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426066:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572127.426067:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572127.426069:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572127.426091:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584234368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572127.426119:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.426170:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584234368 00000100:00100000:3.0:1788572127.426174:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584234368 00010000:00010000:3.0:1788572127.426191:0:152004:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bd08b expref: 11 pid: 190501 timeout: 8980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572127.426213:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12892 00000100:00100000:3.0:1788572127.426220:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:3644:x1875444584234368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572127.426230:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572127.426236:0:152004:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bd08b expref: 11 pid: 190501 timeout: 8980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426246:0:152004:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109bd08b expref: 11 pid: 190501 timeout: 8980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426263:0:152004:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426271:0:152004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788572127.426283:0:152004:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001050624s 00010000:00010000:3.0:1788572127.426287:0:152004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426300:0:152004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426307:0:152004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426324:0:152004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426331:0:152004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572127.426335:0:152004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426343:0:152004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426351:0:152004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426361:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572127.426394:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:3644:x1875444584234368:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.426402:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12892 00000100:00100000:3.0:1788572127.426436:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584234368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572127.426464:0:190502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a00031800/0x265cfe11109bd092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bd08b expref: 10 pid: 190501 timeout: 8980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572127.426475:0:190502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:190502:1875444584234240:0@lo:104: 00010000:00010000:3.0:1788572127.426516:0:190502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426525:0:190502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426531:0:190502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.426538:0:190502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd0ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788572127.437543:0:190493:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 326417522199 00000040:01000000:2.0:1788572127.438281:0:190493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788572127.439154:0:190524:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788572127.439465:0:190493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788572127.440587:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584234496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.440666:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.440725:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddfb40 going to sleep for 11 seconds 00000040:01000000:2.0:1788572127.441357:0:190493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788572127.441401:0:190493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572127.441910:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584234496 00000100:00100000:0.0:1788572127.441921:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584234496 00000100:00100000:0.0:1788572127.441982:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788572127.441993:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584234496:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.442096:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584234496:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 105us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.442104:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788572127.442584:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584234496:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788572127.442621:0:190525:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788572127.442659:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584234624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.442703:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.442755:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddfb40 going to sleep for 11 seconds 00000020:00080000:1.0:1788572127.443081:0:190523:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 326417522199 00000020:00080000:1.0:1788572127.443087:0:190523:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522199 00000100:00100000:1.0:1788572127.443100:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584234624 00000100:00100000:1.0:1788572127.443105:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584234624 00000100:00100000:1.0:1788572127.443146:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788572127.443156:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584234624:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572127.443288:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584234624:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 134us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572127.443295:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788572127.443570:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584234624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.443642:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584234752:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.443670:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.443702:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584234752 00000100:00100000:3.0:1788572127.443706:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584234752 00000100:00100000:3.0:1788572127.443733:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788572127.443740:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584234752:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.444333:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584234752:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 591us (659us total) trans 0 rc 0/0 00000004:00000080:2.0:1788572127.445117:0:190493:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788572127.445137:0:190493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788572127.445249:0:190493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572127.446223:0:190493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788572127.446812:0:190493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788572127.446848:0:190493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788572127.446939:0:190493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788572127.447398:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788572127.447456:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572127.447514:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584234752:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.447635:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590b63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584234880:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.447741:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.447796:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572127.447893:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584234880 00000100:00100000:0.0:1788572127.447900:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584234880 00000100:00100000:0.0:1788572127.447947:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788572127.447957:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584234880:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.448155:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584234880:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 199us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.448164:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788572127.448244:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584234880:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788572127.448287:0:190525:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 7, last_idx 9 00000100:00100000:3.0:1788572127.448385:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590b63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584235008:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.448428:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.448456:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572127.448510:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584235008 00000100:00100000:0.0:1788572127.448515:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584235008 00000100:00100000:0.0:1788572127.448548:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788572127.448555:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584235008:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.448670:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584235008:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 115us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.448677:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788572127.449102:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584235008:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788572127.449138:0:190525:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 9 synced_idx: 0 lgh_last_idx: 9 00000040:00080000:3.0:1788572127.449142:0:190525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002728:0x1:0x0] at index 8 of catalog [0x2400007ec:0x1:0x0] 00000100:00100000:3.0:1788572127.449189:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590b63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584235136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.449222:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.449253:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572127.449507:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584235136 00000100:00100000:0.0:1788572127.449512:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584235136 00000100:00100000:0.0:1788572127.449546:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788572127.449554:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584235136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.449611:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584235136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 58us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.449618:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788572127.449692:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584235136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.449750:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590b63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584235264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.449809:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.449835:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572127.449891:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584235264 00000100:00100000:0.0:1788572127.449896:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584235264 00000100:00100000:0.0:1788572127.449924:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788572127.449931:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584235264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.450075:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584235264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 143us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.450082:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788572127.450200:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590b63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584235264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.450271:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584235392:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572127.450296:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572127.450330:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572127.450444:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584235392 00000100:00100000:0.0:1788572127.450449:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584235392 00000100:00100000:0.0:1788572127.450511:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788572127.450519:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584235392:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.450571:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584235392:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 53us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.450577:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788572127.450651:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584235392:0@lo:1000:lod0000_rec0001.0 00000004:00080000:3.0:1788572127.450695:0:190525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31ddfc00 with version 1 00000040:00080000:3.0:1788572127.450723:0:190525:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 8, last_idx 9 00000004:00080000:3.0:1788572127.450735:0:190525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5a31ddf6c0 with version 2 00000040:00080000:3.0:1788572127.450739:0:190525:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240002728:0x1:0x0] at index 8 of catalog [0x2400007ec:0x1:0x0] 00000004:00080000:0.0:1788572127.451544:0:190509:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5a02befb40 version 1 rpc_version 1 00000020:00100000:0.0:1788572127.451570:0:190509:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572127.451577:0:190509:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f31c00 x1875444584235648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572127.451593:0:190509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190509:1875444584235648:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572127.451638:0:190509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.451671:0:190509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572127.451735:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584235648 00000100:00100000:3.0:1788572127.451740:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584235648 00000100:00100000:0.0:1788572127.451867:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788572127.451887:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:190509:x1875444584235648:12345-0@lo:1000:osp_up1-0.0 00080000:10000000:2.0:1788572127.452457:0:190493:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x81:0x0] (8/32) registered 00000040:00080000:1.0:1788572127.453991:0:190524:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x20001a210:0x1:0x0] first idx 4, last_idx 5 00000040:00080000:1.0:1788572127.454098:0:190524:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788572127.454103:0:190524:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200025d90:0x1:0x0] at index 5 of catalog [0x20001a210:0x1:0x0] 00000040:00080000:1.0:1788572127.454367:0:190524:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200025d90:0x1:0x0] at index 5 of catalog [0x20001a210:0x1:0x0] 00000040:00080000:1.0:1788572127.454385:0:190524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 5 count 1 00000004:00080000:1.0:1788572127.454450:0:190524:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00080000:2.0:1788572127.456290:0:190493:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 330712481932 00010000:00080000:1.0:1788572127.457244:0:190526:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 190526 00010000:02000000:1.0:1788572127.457263:0:190526:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788572127.457267:0:190526:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788572127.457270:0:190526:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788572127.457550:0:190493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788572127.457567:0:190493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788572127.457590:0:190493:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788572127.457611:0:190493:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788572127.461797:0:190493:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572127.466676:0:190493:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1788572127.469704:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837469 is committed 00000001:00100000:0.0:1788572127.469715:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788572127.469844:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:190509:x1875444584235648:12345-0@lo:1000:osp_up1-0.0 Request processed in 17955us (18200us total) trans 21474837469 rc 0/0 00000100:00100000:0.0:1788572127.469861:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000004:00080000:0.0:1788572127.469930:0:190509:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837469 committed transno 21474837469 00000100:00100000:0.0:1788572127.469935:0:190509:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837469 gen 2 00000100:00100000:0.0:1788572127.469953:0:190509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190509:1875444584235648:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788572127.469982:0:190509:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5a02befb40 version 2 rpc_version 2 00000020:00100000:0.0:1788572127.470006:0:190509:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572127.470013:0:190509:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40f31c00 x1875444584235904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572127.470033:0:190509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190509:1875444584235904:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572127.470070:0:190509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.470104:0:190509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.470511:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584235904 00000100:00100000:2.0:1788572127.470519:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584235904 00000100:00100000:2.0:1788572127.470559:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788572127.470568:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:190509:x1875444584235904:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572127.470749:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:190509:x1875444584235904:12345-0@lo:1000:osp_up1-0.0 Request processed in 181us (677us total) trans 21474837470 rc 0/0 00000100:00100000:2.0:1788572127.470757:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788572127.470804:0:190509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190509:1875444584235904:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788572127.474839:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584236032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.474956:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.475005:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584236032 00000100:00100000:0.0:1788572127.475012:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584236032 00000100:00100000:0.0:1788572127.475067:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788572127.475076:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584236032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.477238:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584236032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2156us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.477251:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788572127.477291:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572127.477333:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584236032:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788572127.478492:0:190525:0:(llog.c:805:llog_process_thread()) index: 9, lh_last_idx: 9 synced_idx: 9 lgh_last_idx: 9 00000040:00080000:0.0:1788572127.478497:0:190525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002728:0x2:0x0] at index 9 of catalog [0x2400007ec:0x1:0x0] 00000100:00100000:0.0:1788572127.478586:0:190525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584236160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.479425:0:190525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572127.479475:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584236160 00000100:00100000:0.0:1788572127.479511:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584236160 00000100:00100000:0.0:1788572127.479564:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788572127.479573:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584236160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572127.479665:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:190525:x1875444584236160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.479673:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788572127.479695:0:190525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59066816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572127.479717:0:190525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190525:1875444584236160:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788572127.479767:0:190525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788572127.479810:0:190525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5906681e40 with version 3 00000004:00080000:0.0:1788572127.479851:0:190525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e5906681540 with version 4 00000040:00080000:0.0:1788572127.479856:0:190525:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240002728:0x2:0x0] at index 9 of catalog [0x2400007ec:0x1:0x0] 00000040:00080000:0.0:1788572127.479883:0:190525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 9 count 1 00000004:00080000:0.0:1788572127.479952:0:190525:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788572127.479956:0:190525:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:2.0:1788572127.481608:0:190509:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5a02befb40 version 3 rpc_version 3 00000020:00100000:2.0:1788572127.481783:0:190509:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572127.481797:0:190509:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1fbb4380 x1875444584236416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572127.481821:0:190509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190509:1875444584236416:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572127.483116:0:190509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.483176:0:190509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906580c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.487688:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584236416 00000100:00100000:2.0:1788572127.487704:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584236416 00000100:00100000:2.0:1788572127.487781:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788572127.487793:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:190509:x1875444584236416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572127.488106:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:190509:x1875444584236416:12345-0@lo:1000:osp_up1-0.0 Request processed in 314us (4998us total) trans 21474837471 rc 0/0 00000100:00100000:2.0:1788572127.488118:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788572127.488188:0:190509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190509:1875444584236416:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1788572127.488204:0:190509:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5a02befb40 version 4 rpc_version 4 00000020:00100000:2.0:1788572127.488233:0:190509:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788572127.488240:0:190509:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1fbb7100 x1875444584236672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572127.488263:0:190509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190509:1875444584236672:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572127.488301:0:190509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572127.488359:0:190509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906580c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.488377:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584236672 00000100:00100000:2.0:1788572127.488381:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584236672 00000100:00100000:2.0:1788572127.488407:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788572127.488414:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:190509:x1875444584236672:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1788572127.488541:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:190509:x1875444584236672:12345-0@lo:1000:osp_up1-0.0 Request processed in 127us (238us total) trans 21474837472 rc 0/0 00000100:00100000:2.0:1788572127.488548:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788572127.488582:0:190509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190509:1875444584236672:0@lo:1000:osp_up1-0.0 00010000:00080000:1.0:1788572127.490184:0:190526:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:1.0:1788572127.685896:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788572128.316553:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572128.316562:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e59059d0000 from 327 10000000:01000000:3.0:1788572128.316568:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572128.316619:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.316632:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.316644:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.316669:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584236800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.316736:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.316796:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf480 going to sleep for 11 seconds 00000100:00100000:1.0:1788572128.317061:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584236800 00000100:00100000:1.0:1788572128.317070:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584236800 00000100:00100000:1.0:1788572128.317126:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572128.317136:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:6515:x1875444584236800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572128.317149:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572128.317164:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd2400/0x265cfe11109bd0d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd0d1 expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.317188:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd2400/0x265cfe11109bd0d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd0d1 expref: 11 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.317198:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd2400/0x265cfe11109bd0d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd0d1 expref: 11 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.317206:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd2400, rc 0) 00000100:00100000:1.0:1788572128.317257:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584236800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572128.317268:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788572128.317500:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584236800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572128.317517:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.317527:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572128.317604:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584236928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788572128.317638:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572128.317656:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.317717:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584236928 00000100:00100000:3.0:1788572128.317722:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584236928 00000100:00100000:3.0:1788572128.317746:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788572128.317752:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584236928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572128.317766:0:190500:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788572128.317782:0:190500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572128.317785:0:190500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 327 00000100:00100000:3.0:1788572128.317877:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584236928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.317884:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572128.318063:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584236928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788572128.318105:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788572128.318112:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.318120:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572128.318129:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788572128.318131:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a412c6800 from 52 10000000:01000000:0.0:1788572128.318133:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572128.318150:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.318157:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.318165:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572128.318176:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572128.318197:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572128.318225:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.318263:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584237056 00000100:00100000:2.0:1788572128.318267:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584237056 00000100:00100000:2.0:1788572128.318306:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788572128.318320:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a370eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584237056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572128.318327:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572128.318335:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe0400/0x265cfe11109bd0e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd0df expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.318355:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe0400/0x265cfe11109bd0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd0df expref: 12 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.318364:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe0400/0x265cfe11109bd0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd0df expref: 12 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.318371:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0400, rc 0) 00000100:00100000:2.0:1788572128.318404:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a370eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584237056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572128.318409:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788572128.318528:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572128.318538:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.318546:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd0e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572128.318594:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572128.318615:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572128.318634:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.318681:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584237184 00000100:00100000:3.0:1788572128.318685:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584237184 00000100:00100000:3.0:1788572128.318712:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788572128.318717:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584237184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.318825:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584237184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.318832:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788572128.319607:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.319640:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.319685:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.319706:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572128.319761:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584237312 00000100:00100000:0.0:1788572128.319766:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584237312 00000100:00100000:0.0:1788572128.319802:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788572128.319809:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584237312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572128.320115:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584237312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 305us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572128.320123:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788572128.320746:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572128.323232:0:190557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788572128.323565:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788572128.323608:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788572128.323621:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.323633:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572128.323644:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788572128.323647:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a412c6800 from 324 10000000:01000000:2.0:1788572128.323650:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788572128.323692:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.323701:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.323713:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572128.323745:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.323816:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.324161:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584237440 00000100:00100000:3.0:1788572128.324169:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584237440 00000100:00100000:3.0:1788572128.324220:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788572128.324230:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584237440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.324245:0:190503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572128.324260:0:190503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a00030400/0x265cfe11109bd0f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd0ed expref: -99 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.324284:0:190503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a00030400/0x265cfe11109bd0f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd0ed expref: 13 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.324306:0:190503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a00030400/0x265cfe11109bd0f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd0ed expref: 13 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572128.324695:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b8000 going to sleep for 11 seconds 00010000:00010000:3.0:1788572128.324742:0:190503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00030400, rc 0) 00000100:00100000:3.0:1788572128.324863:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584237440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 633us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.324870:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788572128.325032:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572128.325048:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.325058:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd0f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572128.325115:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.325149:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572128.325202:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.325238:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584237568 00000100:00100000:3.0:1788572128.325243:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584237568 00000100:00100000:3.0:1788572128.325328:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788572128.325337:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584237568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572128.325354:0:190500:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788572128.325373:0:190500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572128.325376:0:190500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788572128.325379:0:190500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788572128.325382:0:190500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788572128.325384:0:190500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 327 00000100:00100000:3.0:1788572128.325530:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584237568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 195us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.325537:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788572128.325605:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788572128.325687:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788572128.325694:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.325703:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572128.325711:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788572128.325713:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788572128.325716:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788572128.325741:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.325763:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.325776:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572128.325790:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572128.325820:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572128.326663:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.327055:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584237696 00000100:00100000:2.0:1788572128.327064:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584237696 00000100:00100000:2.0:1788572128.327108:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572128.327116:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584237696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572128.327128:0:190499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572128.327144:0:190499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe0c00/0x265cfe11109bd102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd0fb expref: -99 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.327168:0:190499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe0c00/0x265cfe11109bd102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd0fb expref: 14 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.327178:0:190499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe0c00/0x265cfe11109bd102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd0fb expref: 14 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.327193:0:190499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0c00, rc 0) 00000100:00100000:2.0:1788572128.327235:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584237696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572128.327242:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572128.327281:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572128.327308:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd102 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.327630:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd102 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572128.327706:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.327738:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572128.327762:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.327776:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584237824 00000100:00100000:2.0:1788572128.327780:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584237824 00000100:00100000:2.0:1788572128.328092:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788572128.328104:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584237824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.328235:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584237824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572128.328242:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788572128.328272:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.328382:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.328622:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572128.328638:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.328650:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584237952 00000100:00100000:2.0:1788572128.328654:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584237952 00000100:00100000:2.0:1788572128.328672:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788572128.328678:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584237952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.330102:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584237952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1417us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572128.330114:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788572128.334084:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584237952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572128.335762:0:190558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1788572128.335997:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1788572128.336033:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788572128.336045:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd102 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.336057:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd102 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572128.336068:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788572128.336072:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a412c6800 from 1 10000000:01000000:0.0:1788572128.336075:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788572128.336114:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.336122:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.336132:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572128.336156:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572128.336220:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572128.336445:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.336708:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584238080 00000100:00100000:3.0:1788572128.336715:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584238080 00000100:00100000:3.0:1788572128.336812:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788572128.336823:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584238080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.336839:0:190503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572128.337083:0:190503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a00030600/0x265cfe11109bd110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd109 expref: -99 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.337113:0:190503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a00030600/0x265cfe11109bd110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd109 expref: 15 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.337124:0:190503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a00030600/0x265cfe11109bd110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd109 expref: 15 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.337133:0:190503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00030600, rc 0) 00000100:00100000:3.0:1788572128.337210:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584238080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 388us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.337217:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788572128.337306:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572128.337331:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd110 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.337340:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd110 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572128.337355:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788572128.337359:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd110 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.337366:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd110 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572128.337373:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788572128.337375:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a412c6800 from 7 10000000:01000000:0.0:1788572128.337377:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788572128.337394:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.337402:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.337409:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572128.337423:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572128.337462:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572128.337890:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.338052:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584238208 00000100:00100000:2.0:1788572128.338059:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584238208 00000100:00100000:1.0:1788572128.338109:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788572128.338121:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584238208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572128.338131:0:190499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572128.338142:0:190499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd2000/0x265cfe11109bd11e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd117 expref: -99 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.338159:0:190499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd2000/0x265cfe11109bd11e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd117 expref: 16 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.338168:0:190499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd2000/0x265cfe11109bd11e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd117 expref: 16 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.338175:0:190499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd2000, rc 0) 00000100:00100000:1.0:1788572128.338220:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584238208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572128.338226:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788572128.338378:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572128.338391:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd11e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.338400:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd11e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572128.338596:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572128.338624:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572128.338724:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.338855:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584238336 00000100:00100000:3.0:1788572128.338860:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584238336 00000100:00100000:3.0:1788572128.338886:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788572128.338893:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584238336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.339140:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584238336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.339148:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788572128.339187:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.339213:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.339260:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.339279:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584238464 00000100:00100000:3.0:1788572128.339283:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584238464 00000100:00100000:3.0:1788572128.339321:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788572128.339327:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584238464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.339404:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584238464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.339410:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788572128.339454:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.339654:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572128.340438:0:190559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788572128.341102:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788572128.341135:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572128.341142:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd11e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.341150:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd11e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572128.341157:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788572128.341159:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a40f56000 from 52 10000000:01000000:3.0:1788572128.341161:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572128.341188:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.341193:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.341201:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.341216:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.341260:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.341305:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.341325:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584238592 00000100:00100000:3.0:1788572128.341331:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584238592 00000100:00100000:3.0:1788572128.341365:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788572128.341374:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584238592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.341386:0:190503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572128.341399:0:190503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a00031200/0x265cfe11109bd12c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd125 expref: -99 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.341422:0:190503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a00031200/0x265cfe11109bd12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd125 expref: 17 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.341433:0:190503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a00031200/0x265cfe11109bd12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd125 expref: 17 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.341441:0:190503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00031200, rc 0) 00000100:00100000:3.0:1788572128.341811:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584238592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.341818:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788572128.342902:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.342923:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd12c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.346874:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd12c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.346988:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.347064:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.347160:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.350624:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584238720 00000100:00100000:2.0:1788572128.350637:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584238720 00000100:00100000:2.0:1788572128.350698:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572128.350711:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584238720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.350889:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584238720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (3824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572128.350897:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788572128.351156:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.351221:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.351273:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.351338:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31ddf540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.351428:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584238848 00000100:00100000:3.0:1788572128.351433:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584238848 00000100:00100000:3.0:1788572128.351468:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788572128.351647:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584238848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.351835:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584238848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 359us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.351843:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788572128.359211:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572128.360189:0:190561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788572128.370610:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788572128.370659:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788572128.370671:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd12c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.370684:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd12c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572128.372736:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788572128.372743:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788572128.372749:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788572128.372794:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.372806:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.372818:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572128.372845:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.373058:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572128.373106:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a2450db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.373162:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584238976 00000100:00100000:2.0:1788572128.373169:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584238976 00000100:00100000:2.0:1788572128.373222:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572128.373233:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584238976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572128.373247:0:190500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572128.373260:0:190500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bd13a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd133 expref: -99 pid: 190500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.373287:0:190500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bd13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd133 expref: 18 pid: 190500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.373314:0:190500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bd13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd133 expref: 18 pid: 190500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.373322:0:190500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1400, rc 0) 00000100:00100000:2.0:1788572128.373381:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584238976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572128.373387:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788572128.373510:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584238976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.373526:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd13a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.373537:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd13a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.373601:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.373626:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.373663:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.373799:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584239104 00000100:00100000:2.0:1788572128.373805:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584239104 00000100:00100000:2.0:1788572128.373831:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572128.373837:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a415c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584239104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.373983:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a415c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584239104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572128.373991:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788572128.374164:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.374195:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.374239:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.374271:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572128.374336:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584239232 00000100:00100000:1.0:1788572128.374340:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584239232 00000100:00100000:1.0:1788572128.374374:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788572128.374382:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fadd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584239232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.375257:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fadd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584239232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 873us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572128.375267:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788572128.375363:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572128.377260:0:190563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788572128.377656:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788572128.377702:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788572128.377715:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd13a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.377728:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd13a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572128.377737:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572128.377740:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a40f56000 from 7 10000000:01000000:1.0:1788572128.377744:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572128.377784:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.377791:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.377802:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572128.377825:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.377903:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572128.377950:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a2450d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.378109:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584239360 00000100:00100000:3.0:1788572128.378116:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584239360 00000100:00100000:3.0:1788572128.378167:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788572128.378177:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fadf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584239360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.378191:0:190499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572128.378206:0:190499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd148 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd141 expref: -99 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.378228:0:190499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd141 expref: 19 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.378240:0:190499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd141 expref: 19 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.378249:0:190499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60c800, rc 0) 00000100:00100000:3.0:1788572128.378312:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fadf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584239360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.378320:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788572128.378705:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572128.378721:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd148 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.378731:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd148 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572128.378793:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.378822:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572128.378854:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a2450d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.379052:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584239488 00000100:00100000:3.0:1788572128.379057:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584239488 00000100:00100000:3.0:1788572128.379094:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788572128.379102:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fadf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584239488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.379208:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fadf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584239488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.379215:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788572128.379422:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.379451:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.379571:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572128.379596:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a2450d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.379709:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584239616 00000100:00100000:3.0:1788572128.379713:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584239616 00000100:00100000:3.0:1788572128.379743:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788572128.379750:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fadc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584239616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.379838:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fadc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584239616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.379845:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572128.380169:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572128.381365:0:190564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788572128.381765:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788572128.381810:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572128.381822:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd148 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.381834:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd148 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572128.381845:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788572128.381848:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e59028fe800 from 52 10000000:01000000:3.0:1788572128.381851:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572128.381893:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.381901:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.381910:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.381947:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.382006:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.382057:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584239744 00000100:00100000:3.0:1788572128.382063:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584239744 00000100:00100000:3.0:1788572128.382109:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788572128.382119:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fadd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584239744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.382133:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572128.382146:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590a60dc00/0x265cfe11109bd156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd14f expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.382168:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590a60dc00/0x265cfe11109bd156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd14f expref: 20 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.382179:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590a60dc00/0x265cfe11109bd156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd14f expref: 20 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.382187:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60dc00, rc 0) 00000100:00100000:3.0:1788572128.382223:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fadd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584239744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.382230:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788572128.382264:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.382284:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.382322:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd156 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.382333:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd156 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.382389:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.382413:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.382435:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584239872 00000100:00100000:3.0:1788572128.382439:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584239872 00000100:00100000:3.0:1788572128.382461:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788572128.382467:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fadf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584239872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.382796:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fadf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584239872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.382803:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788572128.382828:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.382839:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584239872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.382866:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.382919:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.383001:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584240000 00000100:00100000:3.0:1788572128.383006:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584240000 00000100:00100000:3.0:1788572128.383026:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788572128.383031:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0efb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584240000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.383102:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0efb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584240000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572128.383112:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788572128.383140:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.383150:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572128.386145:0:190565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788572128.396217:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788572128.396267:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788572128.396280:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd156 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.396304:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd156 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572128.396335:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788572128.396339:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788572128.396342:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788572128.396381:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.396390:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.396402:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.396430:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.396822:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572128.396940:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584240128 00000100:00100000:1.0:1788572128.396950:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584240128 00000100:00100000:1.0:1788572128.396997:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788572128.397006:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584240128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572128.397020:0:190499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572128.397033:0:190499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd2c00/0x265cfe11109bd164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd15d expref: -99 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.397056:0:190499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd2c00/0x265cfe11109bd164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd15d expref: 21 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.397067:0:190499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd2c00/0x265cfe11109bd164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd15d expref: 21 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.397077:0:190499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd2c00, rc 0) 00000100:00100000:1.0:1788572128.401330:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584240128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4315us (4499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572128.401345:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788572128.406662:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.406703:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.406729:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd164 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.406742:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd164 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.406828:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.406898:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572128.407596:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584240256 00000100:00100000:1.0:1788572128.407606:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584240256 00000100:00100000:1.0:1788572128.407660:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788572128.407670:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584240256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.408341:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584240256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 671us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572128.408350:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788572128.413109:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572128.413151:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.413212:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.413285:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572128.413365:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584240384 00000100:00100000:0.0:1788572128.413373:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584240384 00000100:00100000:0.0:1788572128.413433:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788572128.413442:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584240384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.414208:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.414433:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584240384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 989us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572128.414451:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788572128.414679:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572128.415971:0:190569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788572128.416136:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788572128.416163:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788572128.416173:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd164 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.416184:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd164 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572128.416193:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788572128.416196:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e59028fe800 from 7 10000000:01000000:3.0:1788572128.416198:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572128.416234:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.416242:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.416253:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.416274:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.416341:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572128.416399:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572128.417024:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584240512 00000100:00100000:0.0:1788572128.417034:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584240512 00000100:00100000:0.0:1788572128.417090:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788572128.417099:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584240512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572128.417114:0:190503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572128.417128:0:190503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5c00/0x265cfe11109bd172 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd16b expref: -99 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.417154:0:190503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5c00/0x265cfe11109bd172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd16b expref: 22 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.417168:0:190503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb5c00/0x265cfe11109bd172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd16b expref: 22 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.417175:0:190503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5c00, rc 0) 00000100:00100000:0.0:1788572128.417230:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584240512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572128.417237:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788572128.417432:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572128.417455:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd172 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.417465:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd172 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572128.417557:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572128.417588:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572128.418139:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.420241:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584240640 00000100:00100000:2.0:1788572128.420255:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584240640 00000100:00100000:1.0:1788572128.420375:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788572128.420387:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584240640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.420606:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584240640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572128.420613:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788572128.421547:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.421601:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.421658:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572128.421689:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1723f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572128.422274:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584240768 00000100:00100000:0.0:1788572128.422281:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584240768 00000100:00100000:0.0:1788572128.423516:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788572128.423531:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0b5ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584240768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572128.423686:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0b5ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584240768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572128.423693:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788572128.428867:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572128.432234:0:190571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788572128.432683:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788572128.432710:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572128.432722:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd172 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.432734:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd172 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572128.432750:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788572128.432753:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e5a0efbb380 from 1 10000000:01000000:2.0:1788572128.432756:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788572128.432793:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.432801:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.432811:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572128.432836:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.432906:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572128.432947:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a2467b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572128.438679:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584240896 00000100:00100000:0.0:1788572128.438696:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584240896 00000100:00100000:0.0:1788572128.438757:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788572128.438768:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584240896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572128.438786:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572128.438806:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb4c00/0x265cfe11109bd180 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd179 expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.438835:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb4c00/0x265cfe11109bd180 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd179 expref: 23 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.438867:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb4c00/0x265cfe11109bd180 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd179 expref: 23 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572128.438877:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4c00, rc 0) 00000100:00100000:0.0:1788572128.439146:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584240896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 379us (6239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572128.439154:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788572128.439867:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584240896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572128.439888:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd180 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.439899:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd180 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572128.439922:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788572128.439927:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd180 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.439935:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd180 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572128.440023:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788572128.440028:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5a0efbb380 from 1 10000000:01000000:1.0:1788572128.440031:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788572128.440062:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.440069:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.440077:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572128.440099:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584241024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.440147:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572128.440190:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a177f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.440242:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584241024 00000100:00100000:2.0:1788572128.440247:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584241024 00000100:00100000:2.0:1788572128.440303:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788572128.440319:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584241024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572128.440328:0:190500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572128.440339:0:190500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe0200/0x265cfe11109bd18e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd187 expref: -99 pid: 190500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.440355:0:190500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe0200/0x265cfe11109bd18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd187 expref: 24 pid: 190500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.440364:0:190500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe0200/0x265cfe11109bd18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd187 expref: 24 pid: 190500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.440370:0:190500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0200, rc 0) 00000100:00100000:2.0:1788572128.440409:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584241024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572128.440415:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788572128.440699:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584241024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572128.440711:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd18e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572128.440720:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd18e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572128.440783:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584241152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572128.440810:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572128.440833:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a177f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572128.440944:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584241152 00000100:00100000:2.0:1788572128.440949:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584241152 00000100:00100000:2.0:1788572128.440980:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788572128.440987:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584241152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572128.441068:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584241152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (258us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572128.441075:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788572128.441471:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584241152:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788572128.441524:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788572128.441530:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd18e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572128.441538:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd18e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572128.703890:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572129.734381:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572130.173098:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584241280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572130.173174:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572130.173249:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584241280 00000100:00100000:2.0:1788572130.173381:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2722b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584241408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572130.173412:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572130.173443:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584241408 00000100:00100000:2.0:1788572130.173447:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584241408 00000100:00100000:2.0:1788572130.173525:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6193 00000100:00100000:2.0:1788572130.173537:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584241408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572130.173572:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572130.173613:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584241408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572130.173621:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6193 00000100:00080000:2.0:1788572130.173640:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572130.173682:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2722b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584241408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572130.173745:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584241280 00000100:00100000:0.0:1788572130.173787:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6194 00000100:00100000:0.0:1788572130.173794:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584241280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572130.173812:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572130.173846:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584241280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572130.173852:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6194 00000100:00080000:2.0:1788572130.174367:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572130.174399:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584241280:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572130.756595:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572131.180813:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572131.180853:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572131.180891:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572131.180928:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572131.180963:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569459840 00000100:00100000:3.0:1788572131.180975:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569459840 00000100:00100000:3.0:1788572131.181042:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7557 00000100:00100000:3.0:1788572131.181054:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569459840:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572131.181133:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569459840:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572131.181141:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7557 00000100:00100000:3.0:1788572131.181167:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569459456 00000100:00100000:3.0:1788572131.181171:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569459456 00000100:00100000:3.0:1788572131.181193:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 60 00000100:00100000:3.0:1788572131.181199:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a413c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2396:x1875444569459456:12345-192.168.202.57@tcp:250:kworker.0 00010000:00080000:3.0:1788572131.181244:0:190503:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 712ceec8-7c82-4602-bd77-3db1811a6b63@192.168.202.57@tcp t0 exp 0000000000000000 cur 8884 last 0 00000020:00000080:3.0:1788572131.181279:0:190503:0:(genops.c:1385:class_connect()) connect: client 712ceec8-7c82-4602-bd77-3db1811a6b63, cookie 0x265cfe11109bd195 00000100:00080000:3.0:1788572131.181439:0:190503:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f059000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572131.181471:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a413c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+5:2396:x1875444569459456:12345-192.168.202.57@tcp:250:kworker.0 Request processed in 271us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572131.181505:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 60 00000100:00080000:3.0:1788572131.181535:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572131.182076:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569459712 00000100:00100000:0.0:1788572131.182084:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569459712 00000100:00100000:0.0:1788572131.182122:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569459584 00000100:00100000:0.0:1788572131.182126:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569459584 00000100:00100000:0.0:1788572131.182144:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 93 00000100:00100000:0.0:1788572131.182152:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569459712:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572131.182195:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569459712:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 44us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572131.182205:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 93 00000100:00100000:0.0:1788572131.182243:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 912 00000100:00100000:0.0:1788572131.182248:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569459584:12345-192.168.202.57@tcp:38:kworker.0 00010000:00080000:0.0:1788572131.182266:0:188048:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '700c1fe3-c9bd-4b4d-876e-3774b25f2a3d' at ffff8e590b8c9800, cookie 0x265cfe11109bd01b 00010000:00080000:0.0:1788572131.182272:0:188048:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp recovering/t326417519807 exp ffff8e590b8c9800 cur 8884 last 1788572127 00010000:02000400:0.0:1788572131.182279:0:188048:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788572131.182285:0:188048:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788572131.182307:0:188048:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788572131.182423:0:188048:0:(import.c:65:import_set_state_nolock()) ffff8e5a40dde800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572131.182452:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569459584:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 203us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572131.182460:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 912 00000100:00080000:3.0:1788572131.184120:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572131.205948:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572131.205995:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444567597824 00000100:00100000:2.0:1788572131.206007:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444567597824 00000100:00100000:2.0:1788572131.206063:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 913 00000100:00100000:2.0:1788572131.206076:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444567597824:12345-192.168.202.57@tcp:101:lfs.0 00010000:00080000:2.0:1788572131.206101:0:188048:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 330712481933, current: 326417519807, replaying 00000020:02000000:2.0:1788572131.206108:0:188048:0:(tgt_handler.c:403:tgt_handle_request0()) *** cfs_fail_loc=302, val=2147483648*** 00000100:00100000:2.0:1788572131.211279:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444567597824:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 5194us (5331us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572131.211293:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 913 00010000:00010000:3.0:1788572131.774653:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572132.523122:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572132.523210:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569459968 00000100:00100000:2.0:1788572132.523222:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569459968 00000100:00100000:2.0:1788572132.523283:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 61 00000100:00100000:2.0:1788572132.523294:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a373adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+5:15203:x1875444569459968:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572132.523313:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572132.523333:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1200/0x265cfe11109bd19c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb201 expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572132.523361:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1200/0x265cfe11109bd19c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb201 expref: 6 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572132.523373:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1200/0x265cfe11109bd19c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb201 expref: 6 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572132.523381:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1200, rc 0) 00000100:00100000:2.0:1788572132.523440:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a373adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+6:15203:x1875444569459968:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 148us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572132.523446:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 61 00000100:00100000:3.0:1788572132.525180:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572132.525317:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569460096 00000100:00100000:0.0:1788572132.525325:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569460096 00000100:00100000:0.0:1788572132.525372:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 62 00000100:00100000:0.0:1788572132.525381:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+6:15203:x1875444569460096:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788572132.525403:0:190503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788572132.525419:0:190503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788572132.525424:0:190503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788572132.525427:0:190503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788572132.525430:0:190503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788572132.525432:0:190503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 327 00000100:00100000:3.0:1788572132.528102:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+6:15203:x1875444569460096:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 Request processed in 2711us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572132.528117:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 62 00000100:00100000:1.0:1788572132.533333:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572132.533434:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569460224 00000100:00100000:0.0:1788572132.533444:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569460224 00000100:00100000:0.0:1788572132.533529:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 63 00000100:00100000:0.0:1788572132.533540:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+6:15203:x1875444569460224:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572132.533558:0:190501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572132.533579:0:190501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5400/0x265cfe11109bd1a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb208 expref: -99 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572132.533610:0:190501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5400/0x265cfe11109bd1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb208 expref: 7 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572132.533623:0:190501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb5400/0x265cfe11109bd1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb208 expref: 7 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572132.533631:0:190501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5400, rc 0) 00000100:00100000:0.0:1788572132.533702:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+7:15203:x1875444569460224:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 164us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572132.533709:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 63 00000100:00100000:0.0:1788572132.535958:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572132.536028:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569460352 00000100:00100000:3.0:1788572132.536039:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569460352 00000100:00100000:3.0:1788572132.536099:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 64 00000100:00100000:3.0:1788572132.536109:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+7:15203:x1875444569460352:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572132.537437:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+8:15203:x1875444569460352:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 1322us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572132.537451:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 64 00000100:00100000:2.0:1788572132.549509:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572132.549866:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569460480 00000100:00100000:3.0:1788572132.549876:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569460480 00000100:00100000:3.0:1788572132.549938:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 65 00000100:00100000:3.0:1788572132.549948:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+8:15203:x1875444569460480:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572132.550095:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+8:15203:x1875444569460480:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 Request processed in 148us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572132.550103:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 65 00000100:00100000:1.0:1788572132.554942:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572132.555879:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569460608 00000100:00100000:0.0:1788572132.555891:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569460608 00000100:00100000:0.0:1788572132.556012:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 66 00000100:00100000:0.0:1788572132.556022:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+8:15203:x1875444569460608:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572132.556041:0:190503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572132.556062:0:190503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb4200/0x265cfe11109bd1aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb20f expref: -99 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572132.556092:0:190503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb4200/0x265cfe11109bd1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb20f expref: 9 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572132.556105:0:190503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb4200/0x265cfe11109bd1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb20f expref: 9 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572132.556115:0:190503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4200, rc 0) 00000100:00100000:0.0:1788572132.556198:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569460608:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 177us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572132.556205:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 66 00000100:00100000:1.0:1788572132.568244:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572132.568329:0:190501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569460736 00000100:00100000:3.0:1788572132.568339:0:190501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569460736 00000100:00100000:3.0:1788572132.568407:0:190501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 67 00000100:00100000:3.0:1788572132.568418:0:190501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569460736:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572132.568592:0:190501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569460736:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 175us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572132.568601:0:190501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 67 00000100:00100000:1.0:1788572132.575430:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572132.575533:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569460864 00000100:00100000:3.0:1788572132.575543:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569460864 00000100:00100000:3.0:1788572132.575604:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 68 00000100:00100000:3.0:1788572132.575615:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569460864:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572132.575895:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569460864:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 Request processed in 280us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572132.575904:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 68 00000100:00100000:3.0:1788572132.586640:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572132.586905:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569460992 00000100:00100000:0.0:1788572132.586917:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569460992 00000100:00100000:0.0:1788572132.586971:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 69 00000100:00100000:0.0:1788572132.586982:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569460992:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572132.587000:0:190499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572132.587019:0:190499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd1b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb216 expref: -99 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572132.587047:0:190499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd1b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb216 expref: 10 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572132.587060:0:190499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd1b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb216 expref: 10 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572132.587069:0:190499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5200, rc 0) 00000100:00100000:0.0:1788572132.587123:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+10:15203:x1875444569460992:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 143us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572132.587130:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 69 00000100:00100000:3.0:1788572132.588973:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572132.589142:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569461120 00000100:00100000:0.0:1788572132.589152:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569461120 00000100:00100000:0.0:1788572132.589225:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 70 00000100:00100000:0.0:1788572132.589235:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:15203:x1875444569461120:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572132.589347:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:15203:x1875444569461120:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 113us (383us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572132.589354:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 70 00000100:00100000:1.0:1788572132.732691:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572132.732712:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584241536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572132.732787:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572132.732869:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572132.732874:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572132.732877:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572132.732883:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8880 00000100:00080000:1.0:1788572132.732888:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572132.732894:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572132.732903:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584241536 00000100:00100000:3.0:1788572132.732912:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584241536 00000100:00100000:1.0:1788572132.732917:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cd3b80 x1875444584241792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572132.732947:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572132.732950:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572132.732952:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572132.732955:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8880 00000100:00080000:1.0:1788572132.732958:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1788572132.732958:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00080000:1.0:1788572132.732961:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572132.732967:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3644:x1875444584241536:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572132.732973:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf4a80 x1875444584242048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572132.732986:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572132.732989:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572132.732991:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572132.732994:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8880 00000100:00080000:1.0:1788572132.732997:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572132.733000:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000004:00000024:3.0:1788572132.733007:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572132.733008:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf6300 x1875444584242304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572132.733025:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572132.733027:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572132.733029:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572132.733032:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8880 00000100:00080000:1.0:1788572132.733034:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572132.733037:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572132.733047:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf6d80 x1875444584242688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572132.733048:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3644:x1875444584241536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572132.733055:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:1.0:1788572132.733065:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788572132.733068:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572132.733069:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e59019de000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572132.733073:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e59019de000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572132.733083:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf5f80 x1875444584243072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572132.733102:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584242432:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733131:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572132.733202:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788572132.733208:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584241664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572132.733263:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584242560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733285:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572132.733301:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584242432 00000100:00100000:3.0:1788572132.733306:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584242432 00000100:00100000:1.0:1788572132.733310:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584241792:0@lo:38:kworker.0 00000100:00100000:1.0:1788572132.733335:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572132.733342:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584242560 00000100:00100000:3.0:1788572132.733345:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584242560 00000100:00100000:1.0:1788572132.733352:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584242048:0@lo:38:kworker.0 00000100:00100000:3.0:1788572132.733368:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7558 00000100:00100000:1.0:1788572132.733372:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572132.733374:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584242432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733387:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584242304:0@lo:38:kworker.0 00000100:00100000:3.0:1788572132.733426:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584242432:12345-0@lo:400:kworker.0 Request processed in 52us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.733429:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572132.733434:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7558 00000100:00100000:1.0:1788572132.733446:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584242688:0@lo:38:kworker.0 00000100:00100000:3.0:1788572132.733446:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7559 00000100:00100000:3.0:1788572132.733453:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584242560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572132.733498:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584242560:12345-0@lo:400:kworker.0 Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.733501:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584243072:0@lo:38:kworker.0 00000100:00100000:3.0:1788572132.733506:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7559 00000100:00100000:1.0:1788572132.733521:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572132.733535:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572132.733539:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572132.733549:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584241920:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572132.733584:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584242816:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733604:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572132.733636:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572132.733642:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584242176:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733664:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572132.733674:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584242944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733693:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572132.733724:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584241664 00000100:00100000:1.0:1788572132.733728:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584241664 00000100:00100000:1.0:1788572132.733759:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788572132.733766:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584241664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733796:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584241664:12345-0@lo:400:kworker.0 Request processed in 31us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.733803:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788572132.733831:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584242816 00000100:00100000:1.0:1788572132.733834:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584242816 00000100:00100000:1.0:1788572132.733860:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584242944 00000100:00100000:1.0:1788572132.733863:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584242944 00000100:00100000:1.0:1788572132.733877:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7560 00000100:00100000:1.0:1788572132.733883:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584242816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733911:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584242816:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.733917:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7560 00000100:00100000:1.0:1788572132.733926:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7561 00000100:00100000:1.0:1788572132.733931:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584242944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.733950:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584242944:12345-0@lo:400:kworker.0 Request processed in 20us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.733956:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7561 00000100:00100000:1.0:1788572132.733973:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584241792 00000100:00100000:1.0:1788572132.733976:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584241792 00000100:00100000:1.0:1788572132.733985:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584242048 00000100:00100000:1.0:1788572132.733987:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584242048 00000100:00100000:1.0:1788572132.733993:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584242688 00000100:00100000:1.0:1788572132.733994:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584242688 00000100:00100000:1.0:1788572132.734001:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584243072 00000100:00100000:1.0:1788572132.734003:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584243072 00000100:00100000:1.0:1788572132.734009:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584241920 00000100:00100000:1.0:1788572132.734012:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584241920 00000100:00100000:1.0:1788572132.734025:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584242176 00000100:00100000:1.0:1788572132.734026:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584242176 00000100:00100000:1.0:1788572132.734039:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788572132.734044:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584241920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.734067:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584241920:12345-0@lo:400:kworker.0 Request processed in 23us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.734073:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788572132.734081:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788572132.734086:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584242176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.734104:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584242176:12345-0@lo:400:kworker.0 Request processed in 18us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.734109:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788572132.734117:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788572132.734120:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584241792:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572132.734140:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8885 last 0 00000020:00000080:1.0:1788572132.734183:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x265cfe11109bd1b8 00000004:00100000:1.0:1788572132.734197:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572132.734333:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e59019dc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572132.734370:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875444584241792:12345-0@lo:38:kworker.0 Request processed in 248us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.734377:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788572132.734391:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1788572132.734395:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584242048:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572132.734407:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8885 last 0 00000020:00000080:1.0:1788572132.734428:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x265cfe11109bd1bf 00000004:00100000:1.0:1788572132.734435:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572132.734451:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f314800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572132.734474:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875444584242048:12345-0@lo:38:kworker.0 Request processed in 78us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.734504:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1788572132.734515:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1788572132.734520:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584242688:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572132.734533:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8885 last 0 00000020:00000080:1.0:1788572132.734555:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x265cfe11109bd1c6 00000004:00100000:1.0:1788572132.734560:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572132.734573:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f317000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572132.734596:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875444584242688:12345-0@lo:38:kworker.0 Request processed in 75us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.734601:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1788572132.734612:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1788572132.734616:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584243072:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572132.734626:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8885 last 0 00000020:00000080:1.0:1788572132.734644:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x265cfe11109bd1cd 00000004:00100000:1.0:1788572132.734649:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572132.734660:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f316800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572132.734684:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584243072:12345-0@lo:38:kworker.0 Request processed in 67us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.734690:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1788572132.734716:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584242304 00000100:00100000:1.0:1788572132.734721:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584242304 00000100:00100000:1.0:1788572132.734741:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788572132.734746:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584242304:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572132.734760:0:189111:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8e590b8ca800, cookie 0x265cfe11109bd022 00010000:00080000:1.0:1788572132.734764:0:189111:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8e590b8ca800 cur 8885 last 1788572127 00000004:00100000:1.0:1788572132.734772:0:189111:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572132.734786:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f317800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572132.734822:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584242304:12345-0@lo:38:kworker.0 Request processed in 75us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572132.734828:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00080000:1.0:1788572132.734867:0:190526:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788572132.734872:0:190526:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 330712481933 00000020:00080000:1.0:1788572132.734876:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572132.734880:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 330712481933 00000020:00080000:1.0:1788572132.734883:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572132.734885:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 330712481933 00000100:00080000:1.0:1788572132.734894:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572132.734897:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572132.734900:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572132.734928:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584242176:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.734939:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584242944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.734948:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584241920:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.734958:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584242816:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.734993:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584241536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572132.735012:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584241664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.735020:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584242560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572132.735029:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584242432:0@lo:400:kworker.0 00010000:00080000:1.0:1788572132.735050:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a31cd3b80 x1875444584241792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572132.735062:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 78 00000100:00080000:1.0:1788572132.735881:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8e5a31cd3b80 x1875444584241792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572152 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572132.735891:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572132.735895:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572132.735899:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572132.735903:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584241792:0@lo:38:kworker.0 00010000:00080000:1.0:1788572132.735926:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1fdf4a80 x1875444584242048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572132.735937:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 78 00000001:00100000:3.0:1788572132.741046:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788572132.742015:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837472 is committed 00000100:00080000:1.0:1788572132.742749:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8e5a1fdf4a80 x1875444584242048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572152 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572132.742763:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572132.742768:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572132.742772:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572132.742778:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584242048:0@lo:38:kworker.0 00000100:00080000:1.0:1788572132.742822:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 78 00000100:00080000:1.0:1788572132.742834:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788572132.742838:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1788572132.742840:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 326417519069 gen 2 00000100:00080000:1.0:1788572132.742845:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a1f80e800 from lustre-MDT0000_UUID committed 326417519069 last 0 00000100:00080000:1.0:1788572132.742848:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00080000:1.0:1788572132.747358:0:190760:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1788572132.747366:0:190760:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1788572132.747371:0:190760:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1788572132.747974:0:190760:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788572132.748102:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584242304:0@lo:38:kworker.0 00010000:00080000:2.0:1788572132.748142:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1fdf6d80 x1875444584242688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572132.748161:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 78 00000100:00080000:2.0:1788572132.751183:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8e5a1fdf6d80 x1875444584242688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572147 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572132.751198:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788572132.751203:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788572132.751208:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788572132.751215:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584242688:0@lo:38:kworker.0 00010000:00080000:2.0:1788572132.751272:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1fdf5f80 x1875444584243072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572132.751290:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 78 00000100:00080000:2.0:1788572132.751313:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788572132.751319:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788572132.751322:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019de000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788572132.751327:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584243072:0@lo:38:kworker.0 00000100:00100000:2.0:1788572132.751616:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584243200:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788572132.751748:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572132.752249:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584243200 00000100:00100000:2.0:1788572132.752257:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584243200 00000100:00100000:2.0:1788572132.756272:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788572132.756296:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584243200:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788572132.756323:0:188053:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e5a27228000 x1875444584243200/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:548/0 lens 224/0 e 0 to 0 dl 1788572143 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572132.756354:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584243200:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 68us (4606us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572132.756360:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000020:00080000:2.0:1788572132.756393:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572132.756397:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481933 00000001:00100000:0.0:1788572132.759945:0:184840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788572132.798843:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572133.029732:0:190778:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788572133.821428:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788572134.220229:0:190831:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788572134.223282:0:190831:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788572134.847612:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572135.292908:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2722b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584243328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572135.292985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572135.293037:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572135.293044:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584243456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572135.293069:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572135.293124:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584243328 00000100:00100000:1.0:1788572135.293133:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584243328 00000100:00100000:0.0:1788572135.293237:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584243456 00000100:00100000:0.0:1788572135.293242:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584243456 00000100:00100000:0.0:1788572135.293296:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6195 00000100:00100000:0.0:1788572135.293306:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584243456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572135.293336:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572135.293385:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584243456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572135.293393:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6195 00000100:00100000:0.0:1788572135.293440:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584243456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572135.297209:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6196 00000100:00100000:1.0:1788572135.297236:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584243328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572135.297279:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572135.297376:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584243328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (4391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572135.297383:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6196 00000100:00080000:2.0:1788572135.325928:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572135.325939:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572135.327103:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2722b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584243328:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1788572135.427106:0:190882:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788572135.427463:0:190882:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788572135.868700:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572136.300201:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572136.300253:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572136.300296:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572136.300667:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569461248 00000100:00100000:0.0:1788572136.300678:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569461248 00000100:00100000:0.0:1788572136.300754:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 72 00000100:00100000:0.0:1788572136.300765:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569461248:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572136.300838:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569461248:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 74us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572136.300846:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 72 00000100:00100000:3.0:1788572136.301568:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569461504 00000100:00100000:3.0:1788572136.301574:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569461504 00000100:00100000:3.0:1788572136.301640:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7562 00000100:00100000:3.0:1788572136.301649:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569461504:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572136.301691:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569461504:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 43us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572136.301698:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7562 00000100:00080000:2.0:1788572136.301958:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572136.302157:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569461376 00000100:00100000:1.0:1788572136.302163:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569461376 00000100:00100000:1.0:1788572136.302223:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 96 00000100:00100000:1.0:1788572136.302231:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569461376:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572136.302325:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569461376:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 95us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572136.302344:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 96 00000100:00080000:2.0:1788572136.302400:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788572136.895848:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572137.853114:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572137.853135:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584243584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572137.853210:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572137.853289:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584243584 00000100:00100000:1.0:1788572137.853296:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584243584 00000100:00100000:1.0:1788572137.853334:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788572137.853343:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584243584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572137.853377:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572137.853420:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584243584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572137.853427:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788572137.853465:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837472 gen 2 00000004:00080000:1.0:1788572137.853471:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837470 committed transno 21474837472 00000004:00080000:1.0:1788572137.853520:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837471 committed transno 21474837472 00000004:00080000:1.0:1788572137.853530:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837472 committed transno 21474837472 00000100:00100000:1.0:1788572137.853547:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584243584:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788572137.854244:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572137.854250:0:105698:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1788572137.854298:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584244096:0@lo:400:kworker.0 00000100:00100000:0.0:1788572137.854342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572137.854372:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584244608:0@lo:400:kworker.0 00000100:00100000:0.0:1788572137.854392:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572137.854412:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572137.854418:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584243712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572137.854443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572137.854463:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584244224:0@lo:400:kworker.0 00000100:00100000:0.0:1788572137.854634:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572137.854728:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584243968:0@lo:400:kworker.0 00000100:00100000:1.0:1788572137.861362:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584243840:0@lo:400:kworker.0 00000100:00100000:2.0:1788572137.864712:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572137.864940:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584244736:0@lo:400:kworker.0 00000100:00100000:0.0:1788572137.865015:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572137.871776:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584243712 00000100:00100000:1.0:1788572137.871792:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584243712 00000100:00100000:1.0:1788572137.871850:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788572137.871860:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584243712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572137.871932:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584243712:12345-0@lo:400:kworker.0 Request processed in 73us (17487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572137.871938:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788572137.871993:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584243712:0@lo:400:kworker.0 00000100:00100000:2.0:1788572137.872184:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584244480:0@lo:400:kworker.0 00000100:00100000:2.0:1788572137.872220:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572137.872237:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584244992:0@lo:400:kworker.0 00000100:00100000:2.0:1788572137.872255:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572137.875146:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584244096 00000100:00100000:3.0:1788572137.875163:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584244096 00000100:00100000:3.0:1788572137.875231:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584244608 00000100:00100000:3.0:1788572137.875235:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584244608 00000100:00100000:3.0:1788572137.875253:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584244224 00000100:00100000:3.0:1788572137.875256:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584244224 00000100:00100000:3.0:1788572137.875290:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584243968 00000100:00100000:3.0:1788572137.875294:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584243968 00000100:00100000:3.0:1788572137.875313:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788572137.875323:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584244096:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788572137.875342:0:188050:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a1ffa8380 x1875444584244096/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1788572148 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572137.875443:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584244096:12345-0@lo:400:kworker.0 Request processed in 122us (21100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572137.875451:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788572137.875470:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788572137.875476:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584244608:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788572137.875502:0:188050:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a40f31c00 x1875444584244608/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1788572148 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572137.875545:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584244608:12345-0@lo:400:kworker.0 Request processed in 69us (21152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572137.875552:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788572137.875564:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788572137.875571:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584244224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572137.875598:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584244224:12345-0@lo:400:kworker.0 Request processed in 28us (20965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572137.875605:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788572137.875615:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788572137.875621:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584243968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572137.875646:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584243968:12345-0@lo:400:kworker.0 Request processed in 26us (10945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572137.875652:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788572137.875682:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584244736 00000100:00100000:3.0:1788572137.875687:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584244736 00000100:00100000:3.0:1788572137.875712:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584244480 00000100:00100000:3.0:1788572137.875715:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584244480 00000100:00100000:3.0:1788572137.875735:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7563 00000100:00100000:3.0:1788572137.875742:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584244736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572137.875776:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584244736:12345-0@lo:400:kworker.0 Request processed in 35us (10761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572137.875783:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7563 00000100:00100000:3.0:1788572137.875795:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7564 00000100:00100000:3.0:1788572137.875801:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584244480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572137.875838:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584244480:12345-0@lo:400:kworker.0 Request processed in 38us (3617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572137.875844:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7564 00000100:00100000:3.0:1788572137.875898:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584244224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572137.875918:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584244736:0@lo:400:kworker.0 00010000:00080000:3.0:1788572137.875931:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1ffa9180 x1875444584244096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572137.875940:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584244096:0@lo:400:kworker.0 00010000:00080000:3.0:1788572137.875951:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1ffa8700 x1875444584244608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572137.875959:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584244608:0@lo:400:kworker.0 00000100:00080000:3.0:1788572137.876237:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572137.876241:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572137.876244:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572137.881600:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584243968:0@lo:400:kworker.0 00000100:00100000:2.0:1788572137.881625:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584244480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572137.881720:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584244992 00000100:00100000:3.0:1788572137.881729:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584244992 00000100:00100000:3.0:1788572137.881803:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788572137.881822:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584244992:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788572137.881842:0:188050:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a31cba300 x1875444584244992/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1788572148 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572137.881928:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584244992:12345-0@lo:400:kworker.0 Request processed in 116us (9671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572137.881935:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788572137.882083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572137.882122:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584244352:0@lo:400:kworker.0 00000100:00100000:1.0:1788572137.882161:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572137.882194:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584244864:0@lo:400:kworker.0 00000100:00100000:1.0:1788572137.882219:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572137.882292:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584243840 00000100:00100000:0.0:1788572137.882297:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584243840 00000100:00100000:0.0:1788572137.882347:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788572137.882356:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584243840:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788572137.882365:0:188833:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a3f8f0a80 x1875444584243840/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1788572148 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572137.882406:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584243840:12345-0@lo:400:kworker.0 Request processed in 52us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572137.882412:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788572137.882539:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584244352 00000100:00100000:3.0:1788572137.882544:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584244352 00000100:00100000:3.0:1788572137.882588:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584244864 00000100:00100000:3.0:1788572137.882591:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584244864 00000100:00100000:3.0:1788572137.882615:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7565 00000100:00100000:3.0:1788572137.882621:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584244352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572137.882656:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584244352:12345-0@lo:400:kworker.0 Request processed in 36us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572137.882661:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7565 00000100:00100000:3.0:1788572137.882672:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7566 00000100:00100000:3.0:1788572137.882679:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584244864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572137.882704:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584244864:12345-0@lo:400:kworker.0 Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572137.882710:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7566 00000100:00080000:0.0:1788572137.882774:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572137.882779:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788572137.882913:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1ffaa300 x1875444584243840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572137.882926:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584243840:0@lo:400:kworker.0 00000100:00100000:1.0:1788572137.882937:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584244352:0@lo:400:kworker.0 00000100:00100000:1.0:1788572137.882945:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584244864:0@lo:400:kworker.0 00010000:00080000:2.0:1788572137.883049:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1ffa9f80 x1875444584244992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572137.883059:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584244992:0@lo:400:kworker.0 00010000:00010000:1.0:1788572137.917710:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572138.942571:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572139.967721:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572140.412815:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572140.412843:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584245120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572140.412903:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572140.412915:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584245248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572140.412920:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572140.413000:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572140.413121:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584245120 00000100:00100000:2.0:1788572140.413129:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584245120 00000100:00100000:0.0:1788572140.413177:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584245248 00000100:00100000:0.0:1788572140.413183:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584245248 00000100:00100000:2.0:1788572140.413197:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6197 00000100:00100000:2.0:1788572140.413211:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584245120:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572140.413217:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6198 00000100:00100000:0.0:1788572140.413228:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584245248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572140.413246:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00002000:00000024:0.0:1788572140.413251:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572140.413306:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584245120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572140.413308:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584245248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572140.413321:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6197 00000100:00100000:1.0:1788572140.413399:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584245120:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572140.413513:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572140.413517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572140.413541:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584245248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572140.419299:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6198 00010000:00010000:0.0:1788572140.989311:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572141.422270:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572141.422323:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572141.422419:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572141.422520:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569461760 00000100:00100000:0.0:1788572141.422531:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569461760 00000100:00100000:0.0:1788572141.422597:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 74 00000100:00100000:0.0:1788572141.422609:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569461760:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572141.422688:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569461760:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 81us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572141.422697:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 74 00000100:00100000:3.0:1788572141.423251:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569461888 00000100:00100000:3.0:1788572141.423257:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569461888 00000100:00100000:3.0:1788572141.423324:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 103 00000100:00100000:3.0:1788572141.423335:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569461888:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572141.423380:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569461888:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 49us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572141.423387:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 103 00000100:00080000:0.0:1788572141.424774:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572141.427257:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569462016 00000100:00100000:1.0:1788572141.427273:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569462016 00000100:00100000:1.0:1788572141.427368:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7567 00000100:00100000:1.0:1788572141.427378:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569462016:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572141.427463:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569462016:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 87us (5141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572141.427469:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7567 00000100:00080000:0.0:1788572141.427688:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788572142.012828:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572142.973139:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572142.973165:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584245376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572142.973238:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572142.973581:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572142.973586:0:186041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1788572142.973636:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584245632:0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.973671:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572142.973698:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584246144:0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.973722:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572142.973740:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584246656:0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.973764:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572142.973788:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572142.973793:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584245760:0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.973814:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572142.973830:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584246272:0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.973851:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572142.973869:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584246784:0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.973905:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572142.973941:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584246144 00000100:00100000:2.0:1788572142.973949:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584246144 00000100:00100000:2.0:1788572142.973999:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584246656 00000100:00100000:2.0:1788572142.974001:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584246656 00000100:00100000:2.0:1788572142.974020:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584246272 00000100:00100000:2.0:1788572142.974022:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584246272 00000100:00100000:2.0:1788572142.974040:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7568 00000100:00100000:2.0:1788572142.974048:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584246144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.974097:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584246144:12345-0@lo:400:kworker.0 Request processed in 49us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572142.974108:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7568 00000100:00100000:2.0:1788572142.974122:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7569 00000100:00100000:2.0:1788572142.974128:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584246656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.974154:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584246656:12345-0@lo:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572142.974160:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7569 00000100:00100000:2.0:1788572142.974169:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7570 00000100:00100000:2.0:1788572142.974175:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584246272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.974198:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584246272:12345-0@lo:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572142.974204:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7570 00000100:00080000:2.0:1788572142.974223:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572142.974227:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572142.974253:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584246272:0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.974263:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584246144:0@lo:400:kworker.0 00000100:00100000:2.0:1788572142.974273:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584246656:0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.974363:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584245632 00000100:00100000:3.0:1788572142.974368:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584245632 00000100:00100000:3.0:1788572142.974412:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584245760 00000100:00100000:3.0:1788572142.974417:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584245760 00000100:00100000:3.0:1788572142.974438:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584246784 00000100:00100000:3.0:1788572142.974441:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584246784 00000100:00100000:3.0:1788572142.974455:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788572142.974461:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584245632:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788572142.974474:0:188050:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a407e0380 x1875444584245632/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1788572153 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572142.974541:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584245632:12345-0@lo:400:kworker.0 Request processed in 81us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572142.974548:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788572142.974563:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788572142.974570:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584245760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.974597:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584245760:12345-0@lo:400:kworker.0 Request processed in 27us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572142.974602:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788572142.974614:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788572142.974619:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584246784:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788572142.974627:0:188050:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e590a804000 x1875444584246784/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1788572153 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572142.974655:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584246784:12345-0@lo:400:kworker.0 Request processed in 36us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572142.974661:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788572142.974680:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572142.974690:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584245888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.974717:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572142.974734:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584246400:0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.974752:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572142.974766:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572142.974772:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584245504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.974798:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572142.974819:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584246016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.974841:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572142.974852:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584246528:0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.974870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572142.974908:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584246528 00000100:00100000:3.0:1788572142.974912:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584246528 00000100:00100000:3.0:1788572142.974941:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7571 00000100:00100000:3.0:1788572142.974947:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584246528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.974979:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584246528:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572142.974985:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7571 00000100:00080000:3.0:1788572142.975002:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572142.975019:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584246528:0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.975035:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584245888 00000100:00100000:3.0:1788572142.975037:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584245888 00000100:00100000:3.0:1788572142.975052:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584246400 00000100:00100000:3.0:1788572142.975055:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584246400 00000100:00100000:3.0:1788572142.975063:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584246016 00000100:00100000:3.0:1788572142.975065:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584246016 00000100:00100000:3.0:1788572142.975082:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788572142.975088:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584245888:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788572142.975096:0:188050:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a1fafd500 x1875444584245888/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1788572153 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572142.975128:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584245888:12345-0@lo:400:kworker.0 Request processed in 40us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572142.975134:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788572142.975151:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788572142.975157:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584246400:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788572142.975164:0:188050:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a1fafd180 x1875444584246400/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1788572153 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572142.975191:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584246400:12345-0@lo:400:kworker.0 Request processed in 34us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572142.975197:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788572142.975207:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788572142.975213:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584246016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.975235:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584246016:12345-0@lo:400:kworker.0 Request processed in 23us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572142.975241:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788572142.975252:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572142.975266:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584246016:0@lo:400:kworker.0 00010000:00080000:3.0:1788572142.975276:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5905161c00 x1875444584245888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572142.975285:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584245888:0@lo:400:kworker.0 00010000:00080000:3.0:1788572142.975294:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5905161500 x1875444584246400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572142.975303:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584246400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572142.975558:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584245376 00000100:00100000:1.0:1788572142.975563:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584245376 00000100:00100000:1.0:1788572142.975604:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788572142.975613:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584245376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572142.975640:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572142.975687:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584245376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572142.975693:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788572142.975723:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584245504 00000100:00100000:1.0:1788572142.975726:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584245504 00000100:00100000:1.0:1788572142.975750:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788572142.975755:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584245504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572142.975787:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584245504:12345-0@lo:400:kworker.0 Request processed in 31us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572142.975793:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788572142.975890:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584245376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572142.975981:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584245760:0@lo:400:kworker.0 00010000:00080000:2.0:1788572142.975994:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a407e2300 x1875444584246784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572142.976002:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584246784:0@lo:400:kworker.0 00010000:00080000:2.0:1788572142.976013:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5905160a80 x1875444584245632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572142.976020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584245632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572142.977059:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584245504:0@lo:400:kworker.0 00010000:00010000:1.0:1788572143.038062:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572144.060665:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572145.084805:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572145.532800:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584247040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572145.532900:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584246912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572145.532970:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572145.533032:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572145.533139:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584246912 00000100:00100000:3.0:1788572145.533139:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584247040 00000100:00100000:3.0:1788572145.533150:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584247040 00000100:00100000:1.0:1788572145.533151:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584246912 00000100:00080000:2.0:1788572145.533232:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572145.533236:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572145.533286:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6199 00000100:00100000:3.0:1788572145.533299:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584247040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572145.533330:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572145.533383:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584247040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572145.533390:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6199 00000100:00100000:2.0:1788572145.533455:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584247040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572145.537690:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6200 00000100:00100000:1.0:1788572145.537717:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584246912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572145.537767:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572145.537879:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584246912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 176us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572145.537888:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6200 00000100:00100000:2.0:1788572145.539011:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584246912:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572146.112573:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572146.544527:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572146.544573:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572146.544617:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572146.544725:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569462272 00000100:00100000:1.0:1788572146.544737:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569462272 00000100:00100000:1.0:1788572146.544840:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 110 00000100:00100000:1.0:1788572146.544851:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569462272:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572146.544946:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569462272:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572146.544953:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 110 00000100:00080000:0.0:1788572146.545179:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572146.546196:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569462144 00000100:00100000:3.0:1788572146.546209:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569462144 00000100:00100000:3.0:1788572146.546277:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 76 00000100:00100000:3.0:1788572146.546287:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569462144:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572146.546363:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569462144:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 78us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572146.546370:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 76 00000100:00100000:2.0:1788572146.549813:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569462400 00000100:00100000:2.0:1788572146.549831:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569462400 00000100:00100000:2.0:1788572146.549932:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7572 00000100:00100000:2.0:1788572146.549943:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569462400:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572146.550038:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569462400:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 97us (5464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572146.550046:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7572 00000100:00080000:0.0:1788572146.550175:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572146.591377:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572146.591531:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569462528 00000100:00100000:2.0:1788572146.591542:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569462528 00000100:00100000:2.0:1788572146.591601:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 111 00000100:00100000:2.0:1788572146.591613:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569462528:12345-192.168.202.57@tcp:38:ptlrpcd_rcv.0 00010000:02000400:2.0:1788572146.591652:0:188048:0:(ldlm_lib.c:974:target_handle_reconnect()) lustre-MDT0000: Client 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d (at 192.168.202.57@tcp) reconnected, waiting for 2 clients in recovery for 0:54 00010000:00080000:2.0:1788572146.604269:0:188048:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp recovering/t326417519807 exp ffff8e590b8c9800 cur 8899 last 1788572146 00000004:00100000:2.0:1788572146.604322:0:188048:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.57@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1788572146.604353:0:188048:0:(import.c:65:import_set_state_nolock()) ffff8e5a40dde800 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1788572146.604363:0:188048:0:(import.c:65:import_set_state_nolock()) ffff8e5a40dde800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572146.604471:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569462528:12345-192.168.202.57@tcp:38:ptlrpcd_rcv.0 Request processed in 12860us (13103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572146.604526:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 111 00000100:00100000:3.0:1788572146.610609:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572146.610723:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444567597824 00000100:00100000:1.0:1788572146.610735:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444567597824 00000100:00100000:1.0:1788572146.610836:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 918 00000100:00100000:1.0:1788572146.610848:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444567597824:12345-192.168.202.57@tcp:101:lfs.0 00010000:00080000:1.0:1788572146.610867:0:188050:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 330712481933, current: 326417519807, replaying 00010000:00010000:1.0:1788572146.610880:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572146.610914:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109bd1d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25aed8a expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572146.622066:0:188050:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11089us 00000004:00080000:1.0:1788572146.646543:0:188050:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff8e5a1faff480 x1875444567597824/t0(326417519807) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 520/3488 e 0 to 0 dl 1788572157 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00000400:1.0:1788572146.646563:0:188050:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff8e5a1faff480 x1875444567597824/t326417519807(326417519807) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 520/3488 e 0 to 0 dl 1788572157 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00200000:1.0:1788572146.671275:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00080000:1.0:1788572146.671307:0:188050:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x1b8b:0x0], cookie = 0x265cfe1110980399 00000004:00080000:1.0:1788572146.671310:0:188050:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x265cfe1110980399 in new mfd 00010000:00010000:1.0:1788572146.671473:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109bd1d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 7 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.671598:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabd00) 00010000:00010000:1.0:1788572146.671601:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572146.671607:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109bd1d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 7 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.671630:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3a00, rc 0) 00000100:00100000:1.0:1788572146.671748:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444567597824:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 60901us (61148us total) trans 326417519807 rc 301/301 00000100:00100000:1.0:1788572146.671757:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 918 00000100:00100000:1.0:1788572146.677110:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572146.677233:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569452160 00000100:00100000:0.0:1788572146.677244:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569452160 00000100:00100000:0.0:1788572146.677349:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 919 00000100:00100000:0.0:1788572146.677361:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569452160:12345-192.168.202.57@tcp:101:multiop.0 00010000:00080000:0.0:1788572146.677386:0:188049:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 330712481933, current: 330712481931, replaying 00010000:00010000:0.0:1788572146.677399:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572146.677426:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bd1e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb1d7 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572146.677855:0:188049:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x203d:0x0], cookie = 0x265cfe11109bcf03 00000004:00080000:0.0:1788572146.677859:0:188049:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x265cfe11109bcf03 in new mfd 00010000:00010000:0.0:1788572146.678027:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bd1e2 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d7 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.678045:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a1fdacb00) 00010000:00010000:0.0:1788572146.678048:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572146.678053:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bd1e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1d7 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.678072:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5000, rc 0) 00000100:00100000:0.0:1788572146.678189:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2396:x1875444569452160:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 829us (1095us total) trans 330712481931 rc 301/301 00000100:00100000:0.0:1788572146.678197:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 919 00000100:00100000:3.0:1788572146.695115:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572146.697559:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569453568 00000100:00100000:1.0:1788572146.697578:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569453568 00000100:00100000:1.0:1788572146.697651:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 920 00000100:00100000:1.0:1788572146.697663:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2396:x1875444569453568:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00080000:1.0:1788572146.697687:0:188833:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 330712481933, current: 330712481933, replaying 00000100:00100000:1.0:1788572146.697702:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2396:x1875444569453568:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 43us (2600us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572146.697710:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 920 00000020:00080000:2.0:1788572146.697802:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572146.697807:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 330712481933, next_transno: 330712481933 00010000:00080000:2.0:1788572146.697811:0:190526:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (330712481933) 00000020:00080000:2.0:1788572146.697813:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572146.697824:0:190526:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569453568 t330712481933 from 192.168.202.57@tcp req@ffff8e5a1fafc000 x1875444569453568/t0(330712481933) o36->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 528/0 e 0 to 0 dl 1788572157 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572146.698034:0:190526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698055:0:190526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698071:0:190526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698085:0:190526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698091:0:190526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698098:0:190526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698529:0:190526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698539:0:190526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698548:0:190526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698555:0:190526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572146.698559:0:190526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698568:0:190526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698581:0:190526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a16272300) 00010000:00010000:2.0:1788572146.698584:0:190526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572146.698589:0:190526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698595:0:190526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1000/0x265cfe11109bd1f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572146.698614:0:190526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094c12a21 reply state 00000000bc2e1e7e transno 330712481933 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698625:0:190526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.698631:0:190526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a16272c00) 00010000:00010000:2.0:1788572146.698634:0:190526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572146.698636:0:190526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572146.698752:0:190526:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1788572146.698778:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572146.698781:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481934 00000020:00080000:2.0:1788572146.698786:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572146.698788:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481934 00000100:00100000:3.0:1788572146.702834:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572146.702929:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569454080 00000100:00100000:2.0:1788572146.702941:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569454080 00000100:00100000:2.0:1788572146.703028:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 921 00000100:00100000:2.0:1788572146.703040:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2396:x1875444569454080:12345-192.168.202.57@tcp:36:rm.0 00010000:00080000:2.0:1788572146.703062:0:188048:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 330712481934, current: 330712481934, replaying 00000100:00100000:2.0:1788572146.703082:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2396:x1875444569454080:12345-192.168.202.57@tcp:36:rm.0 Request processed in 45us (260us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572146.703089:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 921 00000020:00080000:3.0:1788572146.703258:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572146.703262:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 330712481934, next_transno: 330712481934 00010000:00080000:3.0:1788572146.703267:0:190526:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (330712481934) 00000020:00080000:3.0:1788572146.703270:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572146.703281:0:190526:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569454080 t330712481934 from 192.168.202.57@tcp req@ffff8e5a1fafd880 x1875444569454080/t0(330712481934) o36->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 512/0 e 0 to 0 dl 1788572157 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572146.703401:0:190526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703420:0:190526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703434:0:190526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703447:0:190526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703455:0:190526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703462:0:190526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703614:0:190526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703624:0:190526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703631:0:190526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703890:0:190526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703899:0:190526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703907:0:190526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703913:0:190526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572146.703918:0:190526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703926:0:190526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703941:0:190526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203e:0x0].0x0 (ffff8e590430c300) 00010000:00010000:3.0:1788572146.703944:0:190526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572146.703949:0:190526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703968:0:190526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d800/0x265cfe11109bd20c lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x203e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.703993:0:190526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.704000:0:190526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.704004:0:190526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.704010:0:190526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60de00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572146.704012:0:190526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.704018:0:190526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.704026:0:190526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590430c800) 00010000:00010000:3.0:1788572146.704029:0:190526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572146.704032:0:190526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.704038:0:190526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd1fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572146.704049:0:190526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebd36e9e reply state 0000000054a4dae7 transno 330712481934 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.704060:0:190526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.704066:0:190526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a16272c00) 00010000:00010000:3.0:1788572146.704068:0:190526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572146.704070:0:190526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572146.704160:0:190526:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572146.704179:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572146.704183:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481935 00000020:00080000:3.0:1788572146.704187:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572146.704190:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481935 00000100:00100000:2.0:1788572146.716145:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572146.716185:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572146.716413:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569462656 00000100:00100000:0.0:1788572146.716435:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569462656 00000100:00100000:0.0:1788572146.716519:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569462784 00000100:00100000:0.0:1788572146.716523:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569462784 00000100:00100000:0.0:1788572146.716549:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 922 00000100:00100000:0.0:1788572146.716560:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2396:x1875444569462656:12345-192.168.202.57@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788572146.716589:0:188833:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8e590a805880 x1875444569462656/t0(0) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 328/0 e 0 to 0 dl 1788572157 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572146.716608:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2396:x1875444569462656:12345-192.168.202.57@tcp:101:ldlm_lock_repla.0 Request processed in 51us (476us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572146.716628:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 922 00000100:00100000:0.0:1788572146.716639:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 923 00000100:00100000:0.0:1788572146.716647:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2396:x1875444569462784:12345-192.168.202.57@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788572146.716655:0:188833:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8e590a804380 x1875444569462784/t0(0) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 328/0 e 0 to 0 dl 1788572157 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572146.716664:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2396:x1875444569462784:12345-192.168.202.57@tcp:101:ldlm_lock_repla.0 Request processed in 20us (479us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572146.716669:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 923 00000020:00080000:0.0:1788572146.716685:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572146.716689:0:190526:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 330712481935 00010000:00080000:0.0:1788572146.716693:0:190526:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1788572146.716696:0:190526:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572146.716704:0:190526:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788572146.716707:0:190526:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788572146.716712:0:190526:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.202.57@tcp: req@ffff8e590a805880 x1875444569462656/t0(0) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 328/0 e 0 to 0 dl 1788572157 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572146.716730:0:190526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572146.716756:0:190526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4e00/0x265cfe11109bd213 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25aed8a expref: -99 pid: 190526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.716798:0:190526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4e00/0x265cfe11109bd213 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 13 pid: 190526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.716817:0:190526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4e00/0x265cfe11109bd213 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 13 pid: 190526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.716825:0:190526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4e00, rc 0) 00010000:00080000:0.0:1788572146.716889:0:190526:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572146.716906:0:190526:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788572146.716908:0:190526:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788572146.716913:0:190526:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.202.57@tcp: req@ffff8e590a804380 x1875444569462784/t0(0) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 328/0 e 0 to 0 dl 1788572157 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572146.716924:0:190526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572146.716935:0:190526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bd21a lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25aecaa expref: -99 pid: 190526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.716951:0:190526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bd21a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aecaa expref: 13 pid: 190526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.717097:0:190526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bd21a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aecaa expref: 13 pid: 190526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.717105:0:190526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4600, rc 0) 00010000:00080000:0.0:1788572146.717128:0:190526:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572146.717135:0:190526:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1788572146.720657:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572146.720763:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569462912 00000100:00100000:3.0:1788572146.720782:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569462912 00000100:00100000:3.0:1788572146.720842:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 112 00000100:00100000:3.0:1788572146.720854:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:2396:x1875444569462912:12345-192.168.202.57@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788572146.720878:0:188833:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e5a411b1c00 x1875444569462912/t0(0) o400->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 224/0 e 0 to 0 dl 1788572157 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572146.720895:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:2396:x1875444569462912:12345-192.168.202.57@tcp:400:ptlrpcd_rcv.0 Request processed in 44us (251us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572146.720902:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 112 00010000:00080000:0.0:1788572146.721067:0:190526:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788572146.721193:0:190526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 78, last_transno is 335007449088 00000001:00100000:3.0:1788572146.723445:0:190494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000001:00100000:3.0:1788572146.723455:0:190494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788572146.723594:0:190494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 330712481934 is committed 00000001:00080000:0.0:1788572146.723673:0:190526:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788572146.723714:0:190526:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788572146.723739:0:190526:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8e5a27228000 x1875444584243200/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/0 e 1 to 0 dl 1788572155 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788572146.723888:0:190526:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.202.57@tcp: req@ffff8e5a411b1c00 x1875444569462912/t0(0) o400->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:562/0 lens 224/0 e 0 to 0 dl 1788572157 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788572146.723951:0:190526:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:15, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1788572146.724532:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1788572146.724545:0:3640:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8e5a3f8f1500 x1875444584243200/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1788572160 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572146.724555:0:3640:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8e5a3f8f1500 x1875444584243200/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1788572160 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572146.724562:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572146.724576:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1788572146.724582:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cc74e409): req@ffff8e5a1ffaf800 x1875444584220416/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572115 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572146.724599:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584243200:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788572146.724967:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572146.725277:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584247168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572146.725307:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572146.725355:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584220416 00000100:00100000:1.0:1788572146.725362:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584220416 00000100:00100000:1.0:1788572146.725412:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584247168 00000100:00100000:1.0:1788572146.725415:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584247168 00000100:00100000:1.0:1788572146.725430:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788572146.725439:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1875444584220416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572146.725474:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1788572146.725543:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1875444584220416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572146.725549:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788572146.725565:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788572146.725572:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584247168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572146.725584:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1788572146.725612:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584247168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572146.725618:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788572146.725659:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584220416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572146.725684:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584247168:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572146.728011:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728030:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728039:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728046:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572146.728052:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728061:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728079:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a16272c00) 00010000:00010000:2.0:1788572146.728084:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572146.728089:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728096:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bd1f7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728116:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728123:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728129:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728135:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572146.728139:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728145:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728153:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a16272c00) 00010000:00010000:2.0:1788572146.728155:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572146.728158:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.728165:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d600/0x265cfe11109bd205 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572146.730764:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572146.730973:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569461632 00000100:00100000:1.0:1788572146.730985:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569461632 00000100:00100000:1.0:1788572146.731047:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 924 00000100:00100000:1.0:1788572146.731058:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+8:158017:x1875444569461632:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572146.731083:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572146.731112:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bd221 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb21d expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.731186:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109bd228 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.731203:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109bd228 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.731219:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109bd228 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572146.731349:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572146.731354:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572146.731381:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109bd228 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.731410:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109bd221 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb21d expref: 10 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.731431:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109bd228 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb21d expref: 9 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.731438:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabd00) 00010000:00010000:1.0:1788572146.731442:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572146.731447:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3a00, rc 0) 00000100:00100000:1.0:1788572146.731536:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:158017:x1875444569461632:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 479us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572146.731543:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 924 00000100:00100000:3.0:1788572146.735909:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572146.735977:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569463040 00000100:00100000:1.0:1788572146.735988:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569463040 00000100:00100000:1.0:1788572146.736053:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 925 00000100:00100000:1.0:1788572146.736063:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:158017:x1875444569463040:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:1.0:1788572146.736095:0:188049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1788572146.736169:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:158017:x1875444569463040:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 108us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572146.736177:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 925 00000100:00100000:2.0:1788572146.745940:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572146.746022:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569463168 00000100:00100000:1.0:1788572146.746035:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569463168 00000100:00100000:1.0:1788572146.746110:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 926 00000100:00100000:1.0:1788572146.746124:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158017:x1875444569463168:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:1.0:1788572146.746175:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572146.746282:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158017:x1875444569463168:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 161us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572146.746289:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 926 00000100:00100000:3.0:1788572146.753823:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572146.754381:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569463296 00000100:00100000:2.0:1788572146.754392:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569463296 00000100:00100000:2.0:1788572146.754456:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6201 00000100:00100000:2.0:1788572146.754468:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158017:x1875444569463296:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:2.0:1788572146.754524:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572146.754604:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158017:x1875444569463296:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 138us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572146.754611:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6201 00000100:00100000:2.0:1788572146.761762:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572146.761939:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569463424 00000100:00100000:3.0:1788572146.761951:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569463424 00000100:00100000:3.0:1788572146.762006:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22594 00000100:00100000:3.0:1788572146.762015:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2396:x1875444569463424:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:3.0:1788572146.762057:0:43929:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp t0 exp 0000000000000000 cur 8899 last 0 00000020:00000080:3.0:1788572146.762089:0:43929:0:(genops.c:1385:class_connect()) connect: client 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d, cookie 0x265cfe11109bd22f 00002000:00100000:3.0:1788572146.762103:0:43929:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d/ffff8e5a0f05d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788572146.762116:0:43929:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788572146.762217:0:43929:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788572146.762252:0:43929:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f05e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572146.762327:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569463424:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 311us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572146.762336:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22594 00000100:00100000:3.0:1788572146.770859:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572146.770961:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569463552 00000100:00100000:2.0:1788572146.770972:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569463552 00000100:00100000:2.0:1788572146.771049:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6202 00000100:00100000:2.0:1788572146.771061:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158017:x1875444569463552:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:2.0:1788572146.771089:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572146.771160:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158017:x1875444569463552:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 101us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572146.771167:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6202 00000100:00080000:0.0:1788572146.771445:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000080:1.0:1788572146.771871:0:190526:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaac78871be10 00100000:10000000:1.0:1788572146.771883:0:190526:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788572146.782054:0:190902:0:(mdd_orphans.c:363:mdd_orphan_key_test_and_delete()) Found orphan [0x20001a9e3:0x203d:0x0] count 1, skip it 00000004:00080000:3.0:1788572146.782903:0:190514:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1989:0x0] 00000100:00100000:3.0:1788572146.782956:0:190514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190514:1875444584247296:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788572146.783030:0:190514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572146.783074:0:190514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36c9fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572146.783172:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584247296 00000100:00100000:1.0:1788572146.783180:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584247296 00000100:00100000:1.0:1788572146.783266:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22595 00000100:00100000:1.0:1788572146.783278:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:190514:x1875444584247296:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788572146.783313:0:17061:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6593 -> diff = -56 00002000:02000040:1.0:1788572146.783318:0:17061:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6538 to 0x2c0000401:6593) 00000004:00080000:0.0:1788572146.783673:0:190512:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x19c2:0x0] 00000100:00100000:0.0:1788572146.783702:0:190512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190512:1875444584247424:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788572146.783744:0:190512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572146.783777:0:190512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572146.783793:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584247424 00000100:00100000:0.0:1788572146.783798:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584247424 00000100:00100000:0.0:1788572146.783828:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22596 00000100:00100000:0.0:1788572146.783836:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:190512:x1875444584247424:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788572146.783851:0:177556:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6625 -> diff = -31 00002000:02000040:0.0:1788572146.783853:0:177556:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6595 to 0x280000401:6625) 00000100:00080000:2.0:1788572146.784197:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572146.784203:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788572146.799983:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.800000:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800018:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c1:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.800022:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.800029:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800052:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800063:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800072:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800099:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572146.800220:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.800226:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800235:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c0:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.800238:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.800242:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800252:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800261:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800272:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800292:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788572146.800330:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.800335:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800342:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19bf:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.800345:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.800349:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800353:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572146.800357:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800361:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800365:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800370:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.800372:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800374:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800384:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800387:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572146.800400:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800408:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5e6adec/0x265cfe11109bd236 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.800423:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.800427:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800431:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572146.800434:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800435:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19be:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.800438:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.800443:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800448:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.800451:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800452:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800461:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800463:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800470:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800471:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.800474:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572146.800503:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572146.800509:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbe01203/0x265cfe11109bd23d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800513:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572146.800518:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.800521:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800524:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.800526:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.800528:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.800530:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.800534:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.800539:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.800546:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800548:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.800568:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800579:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.800585:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800588:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001187a88/0x265cfe11109bd24b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.800603:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088bcc14c/0x265cfe11109bd244 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800611:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.800615:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.800617:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.800624:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.800627:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.800629:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.800636:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572146.800665:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.800671:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800680:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19bd:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.800683:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.800688:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800697:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800705:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800713:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800735:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572146.800752:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.800757:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800765:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.800778:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.800780:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.800786:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800787:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800794:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19bc:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.800796:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572146.800799:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800800:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800807:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bd252 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800810:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800818:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800821:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.800823:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.800825:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.800826:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800851:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572146.800900:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.800905:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800913:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19bb:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.800917:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.800920:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800928:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800936:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800943:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.800963:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572146.800964:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572146.800968:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800975:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.800979:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.800987:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.800997:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572146.800998:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801002:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801005:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bd259 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801010:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ba:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.801013:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.801017:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801023:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572146.801026:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801027:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801034:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801034:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.801037:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801043:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801045:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801047:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.801056:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801060:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572146.801064:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bd260 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801065:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.801073:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801079:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.801082:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.801085:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.801086:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.801092:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.801092:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.801103:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801108:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801116:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b9:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.801123:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.801126:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801128:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801146:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bd267 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801151:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801161:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801163:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.801165:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.801168:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.801173:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801191:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572146.801207:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.801213:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801220:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.801224:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801232:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.801235:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.801245:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801249:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801265:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b8:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.801267:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bd26e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801269:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.801279:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801286:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.801289:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.801291:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.801292:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801302:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801310:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801330:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572146.801365:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.801370:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801376:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572146.801378:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b7:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.801380:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572146.801381:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801385:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801388:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.801392:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801393:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801400:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801402:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801409:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801411:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801419:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bd275 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801428:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572146.801432:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.801435:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801442:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.801445:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801446:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.801455:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.801462:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572146.801465:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801467:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801473:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd27c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801474:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b6:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.801499:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.801504:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801510:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.801512:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.801514:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801514:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.801522:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801531:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801554:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572146.801592:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.801596:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801604:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b5:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.801606:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.801609:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801617:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801623:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801629:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801646:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788572146.801682:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.801688:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801695:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b4:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:3.0:1788572146.801697:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572146.801699:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572146.801701:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801704:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801710:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.801710:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.801713:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801719:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801721:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801730:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801742:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.801743:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801745:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801749:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801761:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572146.801763:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801765:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801784:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd283 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801794:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801800:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.801803:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bd28a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801806:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.801807:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.801816:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.801826:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.801831:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801836:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b3:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.801839:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572146.801841:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801843:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801846:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.801850:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.801853:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801855:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.801856:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801862:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.801864:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd291 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801866:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801874:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801890:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572146.801926:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.801931:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801939:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b2:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.801941:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.801945:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801950:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572146.801954:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801956:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801973:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801974:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.801980:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.801987:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.801993:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802006:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572146.802008:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802017:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bd298 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802031:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.802034:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802041:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.802045:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.802047:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.802058:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802059:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802081:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b1:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.802084:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802086:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.802094:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802097:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bd29f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802112:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802117:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.802120:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.802124:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.802126:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802135:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802155:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572146.802169:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.802174:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802182:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.802185:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802193:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.802194:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.802204:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802210:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802217:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b0:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.802222:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b96d4d2/0x265cfe11109bd2a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802223:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.802231:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802241:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.802244:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802245:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.802248:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.802258:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802266:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802283:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572146.802324:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.802329:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802336:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19af:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.802339:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.802343:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802351:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802359:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802367:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802383:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788572146.802418:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.802423:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802431:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ae:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.802434:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.802438:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802446:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802454:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802462:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802473:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788572146.802516:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572146.802522:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802530:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.802534:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.802536:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.802546:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802548:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802564:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ad:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.802569:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.802570:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802574:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802588:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bd2ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802594:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802605:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802608:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572146.802615:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802618:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802635:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.802640:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572146.802641:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802652:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802663:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802670:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bd2b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.802677:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.802684:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572146.802685:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802689:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802703:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ac:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.802704:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.802709:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802716:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802724:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.802728:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802731:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802748:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bd2bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.802753:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802761:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572146.802764:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802776:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802783:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.802787:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802794:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802803:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802809:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109bd2c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.802823:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.802825:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.802826:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.802831:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.802834:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.802956:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.802959:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.802961:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.802966:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.813071:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813136:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572146.813283:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.813290:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813304:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ab:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.813309:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.813316:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813342:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813353:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813359:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813386:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788572146.813427:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.813432:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813441:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19aa:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.813444:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.813448:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813456:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813465:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813473:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813508:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788572146.813521:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572146.813531:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813542:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.813548:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.813549:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.813560:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813565:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813572:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a9:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.813580:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.813585:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813591:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813595:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813607:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109bd2c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813612:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813624:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813636:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788572146.813641:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572146.813646:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813654:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.813657:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813665:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.813676:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.813681:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813689:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813691:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bd2d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813711:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a8:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.813715:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.813719:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572146.813720:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813724:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813740:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.813740:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813746:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813757:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813760:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813781:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813789:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813805:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bd2d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813807:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572146.813822:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572146.813826:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813834:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.813839:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813847:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.813849:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.813860:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813864:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.813869:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572146.813872:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a7:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.813875:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.813879:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.813887:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813895:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813898:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bd2de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.813903:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.813910:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.813910:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.813919:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.813921:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813922:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.813926:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.813930:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.813932:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572146.813941:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.813942:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813947:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.813957:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bd2e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.813961:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.813967:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.813970:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572146.813979:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.813981:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.813983:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.813984:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.813986:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.813990:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a6:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:3.0:1788572146.813995:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.813997:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572146.814003:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.814004:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814007:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814015:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814018:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109bd2ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814029:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814051:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814056:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.814060:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.814064:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814071:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572146.814072:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.814078:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814085:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814097:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814099:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.814107:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bd2f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.814113:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.814121:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.814121:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814126:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.814129:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.814134:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a5:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.814137:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.814138:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.814144:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814154:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814162:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814170:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814188:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572146.814227:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.814233:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814241:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a4:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.814244:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.814248:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814256:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814264:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814271:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814276:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.814280:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814288:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.814290:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572146.814292:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814300:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814311:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814324:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bd2fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.814325:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.814330:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814337:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a3:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:3.0:1788572146.814338:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572146.814340:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572146.814341:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814344:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814348:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.814351:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814354:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814359:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814363:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814369:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814370:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814378:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bd301 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814382:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572146.814388:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.814391:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814397:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.814401:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814408:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572146.814412:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.814416:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.814418:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814424:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a2:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.814427:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.814430:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814438:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814446:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814452:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.814468:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572146.814473:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.814502:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814512:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.814517:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814525:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814537:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814545:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bd30f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814562:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.814566:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bd308 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.814567:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.814571:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.814579:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.814589:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.814591:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.814593:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.814600:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788572146.814712:0:17061:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6537 00000100:00100000:2.0:1788572146.814847:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:190514:x1875444584247296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 31567us (31812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572146.814859:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22595 00000100:00100000:3.0:1788572146.815638:0:190514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190514:1875444584247296:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788572146.815659:0:190514:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x19c1:0x0] from OST, last_created [0x2c0000401:0x19c1:0x0]last_used is [0x2c0000401:0x1989:0x0] 00000100:00100000:3.0:1788572146.815744:0:190514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190514:1875444584247680:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788572146.815802:0:190514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572146.815848:0:190514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36c9fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572146.815870:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584247680 00000100:00100000:3.0:1788572146.815887:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584247680 00000100:00100000:3.0:1788572146.815938:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22597 00000100:00100000:3.0:1788572146.815947:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:190514:x1875444584247680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788572146.815988:0:177557:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6594 00000100:00100000:3.0:1788572146.817585:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:190514:x1875444584247680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1633us (1778us total) trans 4294975674 rc 0/0 00000100:00100000:3.0:1788572146.817597:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22597 00000100:00100000:3.0:1788572146.817656:0:190514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190514:1875444584247680:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788572146.817670:0:190514:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x19c1:0x0]-[0x2c0000401:0x19e1:0x0] 00000100:00100000:2.0:1788572146.821518:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572146.821550:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584247552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572146.821635:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1788572146.826007:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.826024:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826048:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e1:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.826053:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.826059:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826075:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826088:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826096:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826121:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572146.826249:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.826254:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826263:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e0:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.826265:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.826269:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826277:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826285:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826291:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826306:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572146.826317:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572146.826323:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572146.826381:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584247552 00000100:00100000:3.0:1788572146.826391:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584247552 00010000:00010000:0.0:1788572146.826417:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.826424:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.826434:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.826439:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.826450:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572146.826460:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6203 00010000:00010000:0.0:1788572146.826469:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572146.826472:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584247552:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572146.826497:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bd31d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.826519:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.826522:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.826524:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:3.0:1788572146.826524:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00010000:00010000:1.0:1788572146.826678:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.826681:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826689:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826700:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826708:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bd316 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826722:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.826724:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.826726:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572146.826807:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.826813:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826820:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19df:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.826823:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.826828:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826836:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826844:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826850:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826863:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572146.826870:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.826887:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826894:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.826897:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826908:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826919:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826926:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bd324 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.826940:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.826941:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.826943:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572146.826988:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.826993:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827001:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19de:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.827004:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.827008:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827016:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827024:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827031:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827045:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572146.827088:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.827093:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827101:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19dd:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.827104:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.827108:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827117:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827124:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827131:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827145:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572146.827187:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.827192:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827200:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19dc:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.827203:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.827207:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827216:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827224:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827230:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827243:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572146.827281:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.827286:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827294:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19db:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.827298:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.827302:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827311:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827319:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.827325:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572146.827400:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584247552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 929us (5763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572146.827410:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6203 00010000:00010000:3.0:1788572146.827446:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572146.827451:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827460:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.827464:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827474:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827508:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827522:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bd32b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827538:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572146.827542:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827550:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.827553:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827561:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827571:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827578:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bd332 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827590:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.827593:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827600:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.827604:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827612:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827623:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827631:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bd339 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.827643:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.827645:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.827646:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.827813:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.828353:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572146.828429:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.828436:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828447:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19da:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.828451:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.828456:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828465:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828472:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828493:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828515:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572146.828526:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572146.828530:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828537:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.828540:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828549:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828560:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828566:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034552887/0x265cfe11109bd340 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828581:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.828585:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828591:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.828593:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828605:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828614:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828620:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011436b15/0x265cfe11109bd347 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828630:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.828632:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.828634:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572146.828680:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.828685:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828692:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d9:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.828694:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.828698:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828706:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828712:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828719:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828731:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572146.828779:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.828785:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828793:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d8:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.828795:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.828799:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828808:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828816:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828823:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.828834:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572146.828868:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.829390:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829400:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d7:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.829404:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.829407:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829417:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829425:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829431:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829448:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788572146.829457:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572146.829462:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829469:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.829473:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829502:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829521:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829529:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e61ead76/0x265cfe11109bd34e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829543:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572146.829548:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.829551:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829553:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829575:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.829575:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.829581:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829583:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829603:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829606:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829623:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829633:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094def872/0x265cfe11109bd35c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829636:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829649:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ec78c0d/0x265cfe11109bd355 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829653:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.829656:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.829659:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.829668:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.829671:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.829673:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.829680:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.829686:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572146.829720:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.829725:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829734:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d6:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.829737:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.829742:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829750:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829758:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829773:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829796:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572146.829838:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.829844:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.829852:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d5:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.829856:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.829860:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829958:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.829964:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829971:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.829974:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829982:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829992:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.829998:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014793408/0x265cfe11109bd363 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.830012:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.830013:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.830015:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572146.830130:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584247552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572146.830165:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.831028:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.831044:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.831053:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832587:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572146.832733:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.832742:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832758:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d4:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.832761:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.832778:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832794:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832804:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832813:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832839:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572146.832867:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572146.832875:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572146.832879:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.832883:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.832884:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.832889:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832890:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d3:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.832894:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.832898:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.832898:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832907:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832914:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832921:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.832921:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.832930:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd723ad/0x265cfe11109bd36a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832933:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572146.832956:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572146.832960:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572146.832966:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.832966:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.832969:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832971:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.832977:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832979:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d2:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.832982:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.832986:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.832988:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.832995:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.832996:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5693263/0x265cfe11109bd371 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833004:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833008:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.833012:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833012:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833019:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.833022:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833023:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572146.833029:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833038:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833045:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e0df03/0x265cfe11109bd378 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572146.833053:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572146.833055:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.833057:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833058:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833065:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d1:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:2.0:1788572146.833065:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.833068:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.833069:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833072:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833077:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833081:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833085:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833090:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833093:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa8fb5a9/0x265cfe11109bd37f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833099:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.833102:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.833104:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.833105:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833111:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572146.833117:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.833122:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833129:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.833133:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833140:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833149:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833156:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005361a5bd/0x265cfe11109bd386 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833169:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833172:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833174:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572146.833212:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.833217:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833224:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d0:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.833226:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.833230:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833239:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833246:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833253:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833271:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572146.833307:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.833312:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833319:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19cf:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.833321:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.833325:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833333:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833340:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833346:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833357:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572146.833364:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572146.833367:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833372:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.833375:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833383:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833392:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833399:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000874b14f/0x265cfe11109bd38d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833410:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.833413:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833419:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.833422:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833429:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833437:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833443:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003020de19/0x265cfe11109bd394 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833452:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833454:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833456:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572146.833522:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.833527:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833535:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ce:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.833539:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.833543:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833554:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833561:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833569:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833582:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572146.833589:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.833592:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833600:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.833603:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833611:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833622:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833636:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006675b799/0x265cfe11109bd39b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833649:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833651:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833653:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572146.833694:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.833699:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833707:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19cd:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.833710:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.833715:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833725:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833732:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833740:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833753:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572146.833760:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.833764:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833784:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.833788:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833797:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833808:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833816:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000314f5b55/0x265cfe11109bd3a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833829:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833831:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833833:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572146.833873:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.833879:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833886:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19cc:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.833889:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.833893:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833906:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833914:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833921:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833932:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572146.833938:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.833941:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833947:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.833950:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833958:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833968:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833975:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056762bfc/0x265cfe11109bd3a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.833987:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833988:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.833990:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572146.834028:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.834033:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834041:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19cb:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.834044:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.834047:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.834051:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.834056:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834063:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834069:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834078:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572146.834084:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.834087:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834099:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.834102:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834110:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834120:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834128:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077ad9f67/0x265cfe11109bd3b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834139:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.834142:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.834144:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572146.834184:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.834189:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834197:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ca:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.834200:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.834205:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834218:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834225:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834231:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834251:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572146.834288:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.834294:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834301:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c9:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.834303:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.834306:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834315:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834323:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834334:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834356:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572146.834382:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572146.834390:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572146.834395:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.834404:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.834406:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834410:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834424:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c8:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.834430:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.834430:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834439:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834449:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834453:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834465:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c943ea7a/0x265cfe11109bd3b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834472:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834517:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834526:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572146.834529:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572146.834534:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834542:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.834546:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834554:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572146.834566:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.834567:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834575:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834579:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8fa212e/0x265cfe11109bd3be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834596:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c7:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.834600:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572146.834603:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.834605:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834608:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834625:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572146.834627:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834629:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834651:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834659:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834664:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834675:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834678:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572146.834688:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7564414/0x265cfe11109bd3c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834702:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.834706:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834714:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.834718:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572146.834722:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572146.834728:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834730:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834750:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c6:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:1.0:1788572146.834751:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834756:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.834776:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834778:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bacd56fc/0x265cfe11109bd3cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834798:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834808:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834811:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.834816:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834816:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.834820:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.834835:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572146.834848:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572146.834854:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.834855:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.834864:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572146.834868:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572146.834871:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.834884:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834893:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834896:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c5:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.834904:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.834913:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834916:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834933:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834933:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acfeda85/0x265cfe11109bd3d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.834954:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834957:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.834962:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.834963:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.834965:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.834992:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572146.835036:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.835041:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.835049:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c4:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.835051:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.835055:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.835063:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.835071:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.835078:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.838616:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788572146.839351:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572146.839363:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.839382:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c3:0x0].0x0 since=8899s v=(0 0) 00010000:00010000:0.0:1788572146.839387:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.839393:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.839407:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.839417:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.839425:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.839501:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572146.839509:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.839517:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572146.839517:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572146.839522:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.839524:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.839531:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.839534:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.839534:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.839550:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.839553:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.839559:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b0a67b3/0x265cfe11109bd3da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.839565:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.839570:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bea30e3/0x265cfe11109bd3e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.839585:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572146.839585:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572146.839587:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.839588:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.839589:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.839594:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572146.839597:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.839600:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.839604:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.839605:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.839613:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.839619:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.839620:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572146.839622:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572146.842796:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.845674:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572146.845690:0:177556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000751b8703/0x265cfe11109bd3e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572146.845897:0:177556:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6594 00000100:00100000:1.0:1788572146.846003:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:190512:x1875444584247424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 62163us (62253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572146.846014:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22596 00000100:00100000:0.0:1788572146.848447:0:190512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190512:1875444584247424:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788572146.848470:0:190512:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x19e1:0x0] from OST, last_created [0x280000401:0x19e1:0x0]last_used is [0x280000401:0x19c2:0x0] 00000100:00100000:0.0:1788572146.848576:0:190512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190512:1875444584247936:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788572146.848634:0:190512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572146.848663:0:190512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572146.848678:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572146.848691:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584247808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572146.848716:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572146.848757:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584247936 00000100:00100000:0.0:1788572146.848763:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584247936 00000100:00100000:0.0:1788572146.848827:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22598 00000100:00100000:0.0:1788572146.848835:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:190512:x1875444584247936:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788572146.848889:0:43923:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 6626 00000100:00100000:1.0:1788572146.848984:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584247808 00000100:00100000:1.0:1788572146.848990:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584247808 00000100:00100000:1.0:1788572146.849036:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6204 00000100:00100000:1.0:1788572146.849046:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584247808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572146.849062:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 896 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572146.849115:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584247808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572146.849125:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6204 00000100:00100000:1.0:1788572146.850608:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584247808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572146.856024:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:190512:x1875444584247936:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7179us (7379us total) trans 34359738468 rc 0/0 00000100:00100000:1.0:1788572146.856039:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22598 00000100:00100000:0.0:1788572146.861131:0:190512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190512:1875444584247936:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788572146.861153:0:190512:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x19e1:0x0]-[0x280000401:0x1a01:0x0] 00010000:00010000:3.0:1788572146.861644:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572147.134569:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572148.093195:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584248192:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.093269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572148.093303:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584248704:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.093328:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572148.093355:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584249216:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.093375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572148.093398:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572148.093404:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584248320:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.093423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572148.093438:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584248832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.093459:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572148.093475:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584249344:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.093524:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572148.093559:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584248192 00000100:00100000:2.0:1788572148.093567:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584248192 00000100:00100000:2.0:1788572148.093630:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584248320 00000100:00100000:2.0:1788572148.093633:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584248320 00000100:00100000:2.0:1788572148.093657:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788572148.093666:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584248192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.093719:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584248192:12345-0@lo:400:kworker.0 Request processed in 53us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572148.093727:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788572148.094083:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584248064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094119:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572148.094146:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584248576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094170:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572148.094180:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584249088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094199:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572148.094209:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584249600:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094231:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572148.094243:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572148.094249:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584248448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094268:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572148.094279:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584248960:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094300:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572148.094317:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584249472:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094337:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572148.094392:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584248064 00000100:00100000:0.0:1788572148.094395:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584248064 00000100:00100000:0.0:1788572148.094426:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788572148.094434:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584248064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094469:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584248064:12345-0@lo:400:kworker.0 Request processed in 35us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572148.094476:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788572148.094534:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584248832 00000100:00100000:0.0:1788572148.094538:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584248832 00000100:00100000:0.0:1788572148.094564:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584249344 00000100:00100000:0.0:1788572148.094567:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584249344 00000100:00100000:0.0:1788572148.094584:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584248960 00000100:00100000:0.0:1788572148.094587:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584248960 00000100:00100000:0.0:1788572148.094605:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584249472 00000100:00100000:0.0:1788572148.094608:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584249472 00000100:00100000:0.0:1788572148.094629:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7573 00000100:00100000:0.0:1788572148.094635:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584248832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094666:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584248832:12345-0@lo:400:kworker.0 Request processed in 32us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572148.094672:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7573 00000100:00100000:0.0:1788572148.094697:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7574 00000100:00100000:0.0:1788572148.094704:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584249344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.094837:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584248576 00000100:00100000:2.0:1788572148.094840:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584248576 00000100:00100000:2.0:1788572148.094857:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584249088 00000100:00100000:2.0:1788572148.094859:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584249088 00000100:00100000:2.0:1788572148.094869:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584249600 00000100:00100000:2.0:1788572148.094872:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584249600 00000100:00100000:2.0:1788572148.094882:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584248448 00000100:00100000:2.0:1788572148.094884:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584248448 00000100:00100000:2.0:1788572148.094899:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788572148.094905:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584248320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.094998:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584249344:12345-0@lo:400:kworker.0 Request processed in 294us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572148.095006:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7574 00000100:00100000:0.0:1788572148.095019:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7575 00000100:00100000:0.0:1788572148.095025:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584248960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095055:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584248960:12345-0@lo:400:kworker.0 Request processed in 30us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572148.095062:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7575 00000100:00100000:0.0:1788572148.095240:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7576 00000100:00100000:0.0:1788572148.095246:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584249472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095271:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584249472:12345-0@lo:400:kworker.0 Request processed in 25us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572148.095277:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7576 00000100:00100000:0.0:1788572148.095338:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584248960:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584249472:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095358:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584248064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095421:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788572148.095429:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584248576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095462:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584248576:12345-0@lo:400:kworker.0 Request processed in 34us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572148.095468:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788572148.095507:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788572148.095514:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584249088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095541:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584249088:12345-0@lo:400:kworker.0 Request processed in 28us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572148.095547:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788572148.095557:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788572148.095563:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584249600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095586:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584249600:12345-0@lo:400:kworker.0 Request processed in 24us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572148.095592:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788572148.095602:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788572148.095609:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584248448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095634:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584248448:12345-0@lo:400:kworker.0 Request processed in 26us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572148.095640:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788572148.095666:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584248448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095677:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584248576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095686:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584249088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572148.095697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584249600:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.095856:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584248320:12345-0@lo:400:kworker.0 Request processed in 950us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572148.095863:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1788572148.095885:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572148.095890:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572148.095892:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572148.095894:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572148.095906:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572148.096177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584249728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572148.096218:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572148.096276:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584248320:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.096289:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584248832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.096302:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584249344:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.096316:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584248192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572148.096463:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584248704 00000100:00100000:3.0:1788572148.096469:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584248704 00000100:00100000:3.0:1788572148.096523:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584249216 00000100:00100000:3.0:1788572148.096527:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584249216 00000100:00100000:3.0:1788572148.096538:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584249728 00000100:00100000:3.0:1788572148.096540:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584249728 00000100:00100000:3.0:1788572148.096551:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788572148.096559:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584248704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572148.096627:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584248704:12345-0@lo:400:kworker.0 Request processed in 69us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572148.096634:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788572148.096647:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788572148.096654:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584249216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572148.096697:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584249216:12345-0@lo:400:kworker.0 Request processed in 44us (3321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572148.096704:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788572148.096716:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788572148.096722:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584249728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572148.096761:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1788572148.096797:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584249728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572148.096803:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788572148.097063:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584249728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572148.097091:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584248704:0@lo:400:kworker.0 00000100:00100000:2.0:1788572148.097099:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584249216:0@lo:400:kworker.0 00010000:00010000:3.0:1788572148.158011:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572149.180807:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572150.205627:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572150.652857:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584249856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572150.652960:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572150.653184:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572150.653197:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584249984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572150.653303:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572150.653345:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584249856 00000100:00100000:0.0:1788572150.653355:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584249856 00000100:00100000:0.0:1788572150.653434:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584249984 00000100:00100000:0.0:1788572150.653438:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584249984 00000100:00100000:0.0:1788572150.653461:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6205 00000100:00100000:0.0:1788572150.653472:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584249856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572150.653545:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572150.654828:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584249856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1349us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572150.654840:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6205 00000100:00100000:0.0:1788572150.654876:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6206 00000100:00100000:0.0:1788572150.654888:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584249984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572150.654919:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572150.654960:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584249984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572150.654966:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6206 00000100:00080000:0.0:1788572150.654988:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572150.654993:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572150.655045:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584249984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572150.656001:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584249856:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788572151.229676:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572151.665706:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572151.665756:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572151.665791:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572151.665815:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572151.665842:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572151.665886:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569464064 00000100:00100000:2.0:1788572151.665899:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569464064 00000100:00100000:2.0:1788572151.665974:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569464192 00000100:00100000:2.0:1788572151.665978:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569464192 00000100:00100000:2.0:1788572151.666008:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7577 00000100:00100000:2.0:1788572151.666023:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569464064:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572151.666121:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569464064:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.666129:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7577 00000100:00100000:2.0:1788572151.666150:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7578 00000100:00100000:2.0:1788572151.666157:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569464192:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572151.666182:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569464192:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.666189:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7578 00000100:00100000:2.0:1788572151.666208:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569463680 00000100:00100000:2.0:1788572151.666212:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569463680 00000100:00100000:2.0:1788572151.666237:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 78 00000100:00100000:2.0:1788572151.666244:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569463680:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572151.666271:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569463680:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 28us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.666278:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 78 00000100:00100000:2.0:1788572151.666309:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569463808 00000100:00100000:2.0:1788572151.666313:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569463808 00000100:00100000:2.0:1788572151.666340:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569463936 00000100:00100000:2.0:1788572151.666343:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569463936 00000100:00100000:2.0:1788572151.666362:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 119 00000100:00100000:2.0:1788572151.666369:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2399:x1875444569463808:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572151.666398:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2399:x1875444569463808:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 30us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.666404:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 119 00000100:00100000:2.0:1788572151.666415:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 120 00000100:00100000:2.0:1788572151.666421:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569463936:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572151.666442:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569463936:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 21us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.666449:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 120 00000100:00080000:0.0:1788572151.666746:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572151.666753:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572151.666756:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572151.666759:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572152.189049:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584250112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572152.189165:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572152.189319:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584250112 00000100:00100000:1.0:1788572152.189330:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584250112 00000100:00100000:1.0:1788572152.189405:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6207 00000100:00100000:1.0:1788572152.189417:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584250112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572152.189460:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572152.189541:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584250112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572152.189548:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6207 00000100:00080000:1.0:1788572152.189576:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572152.189654:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584250112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572152.190818:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584250240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572152.190893:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572152.190955:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572152.190962:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584250368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572152.190992:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572152.191102:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584250368 00000100:00100000:0.0:1788572152.191111:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584250368 00000100:00100000:0.0:1788572152.191179:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6208 00000100:00100000:0.0:1788572152.191188:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584250368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572152.191221:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572152.191270:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584250368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572152.191278:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6208 00000100:00080000:2.0:1788572152.191340:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572152.191384:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584250368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572152.197763:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584250240 00000100:00100000:1.0:1788572152.197786:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584250240 00000100:00100000:1.0:1788572152.197864:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788572152.197877:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584250240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572152.197932:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1788572152.198050:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584250240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (7155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572152.198058:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788572152.198137:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584250240:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788572152.253226:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788572152.709792:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975674 is committed 00000001:00100000:3.0:1788572152.709862:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000100:00100000:1.0:1788572153.213838:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584250624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.213943:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.213992:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a37103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584251136:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214016:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214040:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584251648:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214085:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788572153.214091:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584250496:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214118:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214133:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584251008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214161:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214178:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584251520:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214196:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214208:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584252032:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214225:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214249:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584250752:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214278:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a37102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584251264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214296:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214308:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584251776:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214325:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214338:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572153.214343:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584250880:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214359:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214367:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a37103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584251392:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214383:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214396:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584251904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214412:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572153.214437:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584251136 00000100:00100000:1.0:1788572153.214446:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584251136 00000100:00100000:1.0:1788572153.214526:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584251648 00000100:00100000:1.0:1788572153.214528:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584251648 00000100:00100000:1.0:1788572153.214545:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788572153.214555:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584251136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214634:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584251136:12345-0@lo:400:kworker.0 Request processed in 79us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.214641:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788572153.214659:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788572153.214665:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584251648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214694:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584251648:12345-0@lo:400:kworker.0 Request processed in 29us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.214703:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788572153.214724:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584250624 00000100:00100000:1.0:1788572153.214728:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584250624 00000100:00100000:1.0:1788572153.214764:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584251008 00000100:00100000:1.0:1788572153.214767:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584251008 00000100:00100000:1.0:1788572153.214779:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584251520 00000100:00100000:1.0:1788572153.214782:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584251520 00000100:00100000:1.0:1788572153.214791:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584252032 00000100:00100000:1.0:1788572153.214793:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584252032 00000100:00100000:1.0:1788572153.214803:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584250752 00000100:00100000:1.0:1788572153.214806:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584250752 00000100:00100000:1.0:1788572153.214819:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584250880 00000100:00100000:1.0:1788572153.214821:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584250880 00000100:00100000:1.0:1788572153.214837:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788572153.214844:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584250624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214874:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584250624:12345-0@lo:400:kworker.0 Request processed in 32us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.214880:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788572153.214891:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788572153.214897:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584251008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214924:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584251008:12345-0@lo:400:kworker.0 Request processed in 29us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.214931:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788572153.214941:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788572153.214946:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584251520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.214971:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584251520:12345-0@lo:400:kworker.0 Request processed in 26us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.214977:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788572153.214986:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788572153.214992:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584252032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215019:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584252032:12345-0@lo:400:kworker.0 Request processed in 27us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.215025:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788572153.215036:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788572153.215042:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584250752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215077:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584250752:12345-0@lo:400:kworker.0 Request processed in 35us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.215083:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788572153.215094:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788572153.215100:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584250880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215129:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584250880:12345-0@lo:400:kworker.0 Request processed in 29us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.215136:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788572153.215157:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584251264 00000100:00100000:1.0:1788572153.215161:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584251264 00000100:00100000:1.0:1788572153.215189:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584251776 00000100:00100000:1.0:1788572153.215191:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584251776 00000100:00100000:1.0:1788572153.215209:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584251392 00000100:00100000:1.0:1788572153.215212:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584251392 00000100:00100000:1.0:1788572153.215231:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584251904 00000100:00100000:1.0:1788572153.215235:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584251904 00000100:00100000:1.0:1788572153.215253:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7579 00000100:00100000:1.0:1788572153.215258:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584251264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215288:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584251264:12345-0@lo:400:kworker.0 Request processed in 30us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.215298:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7579 00000100:00100000:1.0:1788572153.215308:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7580 00000100:00100000:1.0:1788572153.215313:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584251776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215338:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584251776:12345-0@lo:400:kworker.0 Request processed in 25us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.215344:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7580 00000100:00100000:1.0:1788572153.215354:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7581 00000100:00100000:1.0:1788572153.215360:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584251392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215386:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584251392:12345-0@lo:400:kworker.0 Request processed in 27us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.215392:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7581 00000100:00100000:1.0:1788572153.215402:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7582 00000100:00100000:1.0:1788572153.215407:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584251904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215433:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584251904:12345-0@lo:400:kworker.0 Request processed in 26us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572153.215439:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7582 00000100:00080000:1.0:1788572153.215472:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572153.215511:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572153.215515:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572153.215518:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572153.215569:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584250880:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215597:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a37103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584251392:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215609:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975674 gen 2 00000100:00100000:1.0:1788572153.215633:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584251904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215648:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584250752:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215660:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a37102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584251264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215671:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584251776:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215724:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584251008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215737:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584251520:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215749:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584252032:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215760:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584250624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215774:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a37103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584251136:0@lo:400:kworker.0 00000100:00100000:1.0:1788572153.215786:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584251648:0@lo:400:kworker.0 00000100:00100000:0.0:1788572153.217694:0:190499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584250496 00000100:00100000:0.0:1788572153.217708:0:190499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584250496 00000100:00100000:0.0:1788572153.217795:0:190499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788572153.217809:0:190499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584250496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572153.218038:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572153.218063:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584252160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572153.218161:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572153.218236:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584252160 00000100:00100000:3.0:1788572153.218240:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584252160 00000100:00100000:3.0:1788572153.218275:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788572153.218283:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584252160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572153.218318:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1788572153.218367:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584252160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572153.218375:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788572153.218434:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584252160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572153.220271:0:190499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584250496:12345-0@lo:400:kworker.0 Request processed in 1346us (5031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572153.220294:0:190499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788572153.226185:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584250496:0@lo:400:kworker.0 00000001:00080000:2.0:1788572153.226474:0:184840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738468 is committed 00010000:00010000:3.0:1788572153.278377:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572154.300988:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572155.324916:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788572155.586565:0:191097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:2.0:1788572155.773692:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584252288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572155.773807:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572155.773995:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572155.774004:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584252416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572155.774032:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572155.774067:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584252288 00000100:00100000:2.0:1788572155.774077:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584252288 00000100:00100000:2.0:1788572155.774140:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584252416 00000100:00100000:2.0:1788572155.774143:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584252416 00000100:00100000:2.0:1788572155.774165:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6209 00000100:00100000:2.0:1788572155.774177:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3a49ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584252288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572155.774222:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572155.774276:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3a49ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584252288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572155.774287:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6209 00000100:00100000:2.0:1788572155.774586:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6210 00000100:00100000:2.0:1788572155.774595:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584252416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572155.774614:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572155.774646:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584252416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572155.774652:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6210 00000100:00100000:2.0:1788572155.774701:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584252416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572155.774716:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584252288:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572155.776087:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572155.776098:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572156.353021:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572156.780321:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572156.780376:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572156.780400:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572156.780421:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572156.780447:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572156.780507:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569464832 00000100:00100000:2.0:1788572156.780519:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569464832 00000100:00100000:2.0:1788572156.780585:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569464704 00000100:00100000:2.0:1788572156.780588:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569464704 00000100:00100000:2.0:1788572156.780618:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7583 00000100:00100000:2.0:1788572156.780631:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569464832:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572156.780727:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569464832:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 98us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572156.780746:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7583 00000100:00100000:2.0:1788572156.780766:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7584 00000100:00100000:2.0:1788572156.780773:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569464704:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572156.781160:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569464320 00000100:00100000:3.0:1788572156.781166:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569464320 00000100:00100000:3.0:1788572156.781205:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 80 00000100:00100000:3.0:1788572156.781213:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569464320:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572156.781249:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569464320:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 38us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572156.781256:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 80 00000100:00100000:3.0:1788572156.781291:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569464576 00000100:00100000:3.0:1788572156.781295:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569464576 00000100:00100000:3.0:1788572156.781325:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569464448 00000100:00100000:3.0:1788572156.781328:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569464448 00000100:00100000:3.0:1788572156.781352:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 127 00000100:00100000:3.0:1788572156.781359:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569464576:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572156.781389:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569464576:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 30us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572156.781396:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 127 00000100:00100000:3.0:1788572156.781407:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 128 00000100:00100000:3.0:1788572156.781413:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2399:x1875444569464448:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572156.781434:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2399:x1875444569464448:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 21us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572156.781440:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 128 00000100:00080000:3.0:1788572156.781596:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572156.781601:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572156.781604:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572156.781606:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572156.783280:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569464704:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 2497us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572156.783295:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7584 00000100:00100000:1.0:1788572157.310526:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572157.310565:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584252544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572157.311021:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572157.313362:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572157.313396:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584252672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572157.313547:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572157.313619:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584252672 00000100:00100000:0.0:1788572157.313630:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584252672 00000100:00100000:0.0:1788572157.313707:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6211 00000100:00100000:0.0:1788572157.313718:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584252672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572157.313758:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572157.313814:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584252672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572157.313822:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6211 00000100:00080000:0.0:1788572157.313853:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572157.313903:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584252672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572157.314882:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584252800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572157.314941:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572157.314997:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584252800 00000100:00100000:0.0:1788572157.315002:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584252800 00000100:00100000:0.0:1788572157.315069:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6212 00000100:00100000:0.0:1788572157.315078:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584252800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572157.315413:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572157.315505:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584252800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 391us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572157.315514:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6212 00000100:00080000:0.0:1788572157.315540:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572157.315575:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738468 gen 2 00000100:00100000:0.0:1788572157.315612:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584252800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572157.315766:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584252544 00000100:00100000:3.0:1788572157.315772:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584252544 00000100:00100000:3.0:1788572157.315818:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788572157.315827:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584252544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572157.315868:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572157.315939:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584252544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (4920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572157.315946:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788572157.320434:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584252544:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572157.391277:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788572158.070347:0:191146:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1788572158.342560:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584252928:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.342680:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.342741:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584253440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.342776:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.342806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584253952:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.342829:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.342850:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584254464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.342875:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.342911:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788572158.342918:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584253312:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.342958:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.342986:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584253824:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343014:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.343047:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584254336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343069:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.343103:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584253184:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343131:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.343144:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584253696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343178:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.343200:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584254208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343226:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.343250:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572158.343257:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584253056:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343282:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.343294:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584253568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343321:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.343343:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584254080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343367:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572158.343412:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584253440 00000100:00100000:1.0:1788572158.343425:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584253440 00000100:00100000:1.0:1788572158.343594:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584253952 00000100:00100000:1.0:1788572158.343598:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584253952 00000100:00100000:1.0:1788572158.343616:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584254464 00000100:00100000:1.0:1788572158.343620:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584254464 00000100:00100000:1.0:1788572158.343633:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584253312 00000100:00100000:1.0:1788572158.343636:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584253312 00000100:00100000:1.0:1788572158.343652:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584253184 00000100:00100000:1.0:1788572158.343655:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584253184 00000100:00100000:1.0:1788572158.343674:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584253056 00000100:00100000:1.0:1788572158.343677:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584253056 00000100:00100000:1.0:1788572158.343699:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788572158.343712:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584253440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343817:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584253440:12345-0@lo:400:kworker.0 Request processed in 106us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.343827:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788572158.343853:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788572158.343860:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584253952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343894:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584253952:12345-0@lo:400:kworker.0 Request processed in 35us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.343901:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788572158.343913:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788572158.343919:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584254464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.343952:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584254464:12345-0@lo:400:kworker.0 Request processed in 33us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.343963:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788572158.343975:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788572158.343981:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584253312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344015:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584253312:12345-0@lo:400:kworker.0 Request processed in 34us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.344022:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788572158.344033:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788572158.344039:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584253184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344079:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584253184:12345-0@lo:400:kworker.0 Request processed in 39us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.344085:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788572158.344096:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788572158.344104:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584253056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344136:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584253056:12345-0@lo:400:kworker.0 Request processed in 33us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.344142:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788572158.344183:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584253824 00000100:00100000:1.0:1788572158.344189:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584253824 00000100:00100000:1.0:1788572158.344229:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584254336 00000100:00100000:1.0:1788572158.344233:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584254336 00000100:00100000:1.0:1788572158.344257:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584253696 00000100:00100000:1.0:1788572158.344260:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584253696 00000100:00100000:1.0:1788572158.344284:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584254208 00000100:00100000:1.0:1788572158.344287:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584254208 00000100:00100000:1.0:1788572158.344310:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7585 00000100:00100000:1.0:1788572158.344317:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584253824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344359:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584253824:12345-0@lo:400:kworker.0 Request processed in 43us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.344366:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7585 00000100:00100000:1.0:1788572158.344379:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7586 00000100:00100000:1.0:1788572158.344385:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584254336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344414:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584254336:12345-0@lo:400:kworker.0 Request processed in 29us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.344419:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7586 00000100:00100000:1.0:1788572158.344430:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7587 00000100:00100000:1.0:1788572158.344435:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584253696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344515:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584253696:12345-0@lo:400:kworker.0 Request processed in 80us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.344521:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7587 00000100:00100000:1.0:1788572158.344531:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7588 00000100:00100000:1.0:1788572158.344537:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584254208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344563:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584254208:12345-0@lo:400:kworker.0 Request processed in 27us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.344568:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7588 00000100:00100000:1.0:1788572158.344592:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584253568 00000100:00100000:1.0:1788572158.344596:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584253568 00000100:00100000:1.0:1788572158.344622:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584254080 00000100:00100000:1.0:1788572158.344625:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584254080 00000100:00100000:1.0:1788572158.344637:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788572158.344644:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584253568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344682:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584253568:12345-0@lo:400:kworker.0 Request processed in 39us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.344692:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788572158.344703:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788572158.344709:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584254080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344736:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584254080:12345-0@lo:400:kworker.0 Request processed in 27us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572158.344742:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:1.0:1788572158.344764:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572158.344769:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572158.344772:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572158.344774:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572158.344837:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584253056:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344852:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584253568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344864:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584254080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344878:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584253184:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344889:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584253696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344901:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584254208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344969:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584253312:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344985:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584253824:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.344998:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584254336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.345013:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584253440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.345027:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584253952:0@lo:400:kworker.0 00000100:00100000:1.0:1788572158.345042:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584254464:0@lo:400:kworker.0 00000100:00100000:2.0:1788572158.346468:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584252928 00000100:00100000:2.0:1788572158.346505:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584252928 00000100:00100000:2.0:1788572158.346580:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788572158.346592:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584252928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572158.346727:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584252928:12345-0@lo:400:kworker.0 Request processed in 133us (4042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572158.346736:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788572158.346827:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584252928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572158.346915:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572158.346932:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584254592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572158.346985:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572158.347044:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584254592 00000100:00100000:0.0:1788572158.347048:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584254592 00000100:00100000:0.0:1788572158.347081:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788572158.347088:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584254592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572158.347123:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1788572158.347167:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584254592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572158.347174:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788572158.347218:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584254592:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788572158.405511:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572159.421623:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572160.337448:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572160.337686:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569464960 00000100:00100000:3.0:1788572160.337700:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569464960 00000100:00100000:3.0:1788572160.337804:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 927 00000100:00100000:3.0:1788572160.337819:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:158491:x1875444569464960:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572160.337889:0:188049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572160.337997:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:158491:x1875444569464960:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 182us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572160.338004:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 927 00000100:00080000:0.0:1788572160.338214:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572160.341438:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572160.341628:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569465088 00000100:00100000:1.0:1788572160.341641:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569465088 00000100:00100000:1.0:1788572160.341736:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 928 00000100:00100000:1.0:1788572160.341749:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158491:x1875444569465088:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:1.0:1788572160.341802:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572160.341919:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158491:x1875444569465088:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 164us (494us total) trans 0 rc 0/0 00000100:00080000:0.0:1788572160.341924:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572160.341927:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 928 00000100:00100000:2.0:1788572160.347779:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572160.348475:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569465216 00000100:00100000:0.0:1788572160.348537:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569465216 00000100:00100000:0.0:1788572160.348646:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6213 00000100:00100000:0.0:1788572160.348659:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158491:x1875444569465216:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572160.348705:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572160.348830:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:158491:x1875444569465216:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 173us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572160.348839:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6213 00000100:00080000:1.0:1788572160.349083:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572160.351760:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572160.352374:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569465344 00000100:00100000:0.0:1788572160.352399:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569465344 00000100:00100000:0.0:1788572160.352579:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6214 00000100:00100000:0.0:1788572160.352592:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:158491:x1875444569465344:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572160.352635:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572160.352726:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:158491:x1875444569465344:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 136us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572160.352734:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6214 00000100:00080000:1.0:1788572160.356643:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572160.407670:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572160.413359:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569465600 00000100:00100000:1.0:1788572160.413395:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569465600 00000100:00100000:1.0:1788572160.414749:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 929 00000100:00100000:1.0:1788572160.414780:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:157593:x1875444569465600:12345-192.168.202.57@tcp:36:multiop.0 00010000:00010000:1.0:1788572160.414930:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.415070:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.415088:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572160.415393:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000519047a9 reply state 0000000052900f6d transno 335007449089 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.415410:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.415420:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203d:0x0].0x0 (ffff8e5a36aab000) 00010000:00010000:1.0:1788572160.415423:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788572160.415429:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572160.415636:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:157593:x1875444569465600:12345-192.168.202.57@tcp:36:multiop.0 Request processed in 868us (7981us total) trans 335007449089 rc 0/0 00000100:00100000:1.0:1788572160.415645:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 929 00010000:00010000:0.0:1788572160.446534:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572160.449519:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572160.449669:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569465728 00000100:00100000:1.0:1788572160.449684:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569465728 00000100:00100000:1.0:1788572160.449769:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 930 00000100:00100000:1.0:1788572160.449782:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:157593:x1875444569465728:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1788572160.449832:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572160.449862:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bd3f6 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb224 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.449961:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bd3f6 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb224 expref: 12 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.449982:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bd3f6 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb224 expref: 12 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.450006:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203d:0x0].0x0 (ffff8e5a36aab000) 00010000:00010000:1.0:1788572160.450009:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572160.450013:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670600, rc 0) 00000100:00100000:1.0:1788572160.450087:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:157593:x1875444569465728:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 307us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572160.450096:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 930 00000100:00100000:3.0:1788572160.456552:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572160.456832:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569465856 00000100:00100000:2.0:1788572160.456848:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569465856 00000100:00100000:2.0:1788572160.456929:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22599 00000100:00100000:2.0:1788572160.456952:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569465856:12345-192.168.202.57@tcp:2:multiop.0 00002000:00010000:2.0:1788572160.457257:0:43921:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x19c2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788572160.457262:0:43921:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x19c2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788572160.457265:0:43921:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x19c2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788572160.457267:0:43921:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x19c2:0x0] updating lvb ctime from disk: 0 -> 1788572161 00002000:00010000:2.0:1788572160.457270:0:43921:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x19c2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788572160.457354:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2398:x1875444569465856:12345-192.168.202.57@tcp:2:multiop.0 Request processed in 413us (887us total) trans 34359738469 rc 0/0 00000100:00100000:2.0:1788572160.457364:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22599 00000100:00100000:3.0:1788572160.463149:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572160.464642:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569465984 00000100:00100000:2.0:1788572160.464665:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569465984 00000100:00100000:2.0:1788572160.464789:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 931 00000100:00100000:2.0:1788572160.464806:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:157593:x1875444569465984:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1788572160.465331:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572160.465363:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd3fd lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb22b expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.469098:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bd404 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.469141:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bd404 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.469160:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bd404 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572160.469254:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572160.471329:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bd404 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.471426:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd3fd lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb22b expref: 14 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.471456:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bd404 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb22b expref: 13 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.471468:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203d:0x0].0x0 (ffff8e5a36aab000) 00010000:00010000:2.0:1788572160.471472:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788572160.471515:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255400, rc 0) 00000100:00100000:2.0:1788572160.471619:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:157593:x1875444569465984:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6815us (8489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572160.471631:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 931 00000100:00100000:3.0:1788572160.490198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572160.490628:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569466240 00000100:00100000:2.0:1788572160.490643:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569466240 00000100:00100000:2.0:1788572160.490720:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 0 00000100:00100000:2.0:1788572160.490743:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:157593:x1875444569466240:12345-192.168.202.57@tcp:35:multiop.0 00000004:00080000:2.0:1788572160.491151:0:188051:0:(mdd_object.c:4014:mdd_close()) Object [0x20001a9e3:0x203d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788572160.491235:0:188051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x138:0x0].2, 64 off8320 00000004:00080000:2.0:1788572160.491249:0:188051:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8913485768818ns, next at 8914485765887ns, rc = 0 00010000:00010000:2.0:1788572160.491328:0:188051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.491353:0:188051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.491369:0:188051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.491393:0:188051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.491402:0:188051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.491409:0:188051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572160.491441:0:188051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572160.491665:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:157593:x1875444569466240:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 929us (1479us total) trans 335007449090 rc 0/0 00000100:00100000:2.0:1788572160.491678:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 0 00010000:00010000:3.0:1788572160.493112:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572160.493134:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572160.493148:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572160.493155:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572160.493169:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572160.493196:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203d:0x0].0x0 (ffff8e5a36aab000) 00010000:00010000:3.0:1788572160.493200:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572160.493208:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572160.493216:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd40b lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 188051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572160.493244:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572160.493247:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572160.493249:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572160.498391:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572160.498658:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569466368 00000100:00100000:1.0:1788572160.498672:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569466368 00000100:00100000:1.0:1788572160.498758:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 932 00000100:00100000:1.0:1788572160.498771:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:157448:x1875444569466368:12345-192.168.202.57@tcp:101:bash.0 00010000:00010000:1.0:1788572160.498805:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572160.498848:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb232 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499257:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499278:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499292:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499309:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499316:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499322:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499421:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499429:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499442:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499449:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572160.499453:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499462:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499475:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabd00) 00010000:00010000:1.0:1788572160.499632:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572160.499640:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499649:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671a00/0x265cfe11109bd419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499667:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499673:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499680:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499685:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572160.499689:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499699:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499707:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8e5a36aabc00) 00010000:00010000:1.0:1788572160.499710:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572160.499713:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.499718:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd420 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.500145:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd412 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb232 expref: 15 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.500160:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabd00) 00010000:00010000:1.0:1788572160.500163:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572160.500168:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb232 expref: 15 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.500179:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671400, rc 0) 00000100:00100000:1.0:1788572160.500282:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:157448:x1875444569466368:12345-192.168.202.57@tcp:101:bash.0 Request processed in 1512us (1919us total) trans 0 rc 301/301 00000100:00100000:1.0:1788572160.500292:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 932 00000100:00100000:3.0:1788572160.893152:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572160.893495:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572160.893541:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584254848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572160.893673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572160.893928:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584254848 00000100:00100000:0.0:1788572160.893940:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584254848 00000100:00100000:0.0:1788572160.894024:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6215 00000100:00100000:0.0:1788572160.894035:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584254848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572160.894070:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572160.894127:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584254848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572160.894135:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6215 00000100:00100000:2.0:1788572160.894335:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584254848:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572160.894437:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572160.894962:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584254720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572160.895028:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572160.902164:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584254720 00000100:00100000:0.0:1788572160.902189:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584254720 00000100:00100000:0.0:1788572160.902388:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6216 00000100:00100000:0.0:1788572160.902401:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584254720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572160.902440:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572160.902712:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584254720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572160.902934:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584254720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 535us (7905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572160.902942:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6216 00000100:00080000:1.0:1788572160.911230:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572161.473450:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572161.906354:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572161.906519:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572161.906558:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572161.906584:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572161.906618:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572161.906664:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569466752 00000100:00100000:3.0:1788572161.907786:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569466752 00000100:00100000:3.0:1788572161.907902:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569466624 00000100:00100000:3.0:1788572161.907908:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569466624 00000100:00100000:3.0:1788572161.907945:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 135 00000100:00100000:3.0:1788572161.907959:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569466752:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572161.908096:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569466752:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 139us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572161.908106:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 135 00000100:00100000:3.0:1788572161.908136:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 136 00000100:00100000:3.0:1788572161.908143:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:2398:x1875444569466624:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572161.908168:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:2398:x1875444569466624:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 27us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572161.908175:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 136 00000100:00100000:3.0:1788572161.908214:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569467008 00000100:00100000:3.0:1788572161.908218:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569467008 00000100:00100000:3.0:1788572161.908249:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569466880 00000100:00100000:3.0:1788572161.908253:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569466880 00000100:00100000:3.0:1788572161.908276:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7589 00000100:00100000:3.0:1788572161.908283:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569467008:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572161.908315:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569467008:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572161.908322:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7589 00000100:00100000:3.0:1788572161.908335:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7590 00000100:00100000:3.0:1788572161.908355:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2398:x1875444569466880:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572161.908382:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2398:x1875444569466880:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 41us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572161.908388:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7590 00000100:00100000:2.0:1788572161.912164:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569466496 00000100:00100000:2.0:1788572161.912186:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569466496 00000100:00100000:2.0:1788572161.912275:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 82 00000100:00100000:2.0:1788572161.912288:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569466496:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572161.912423:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569466496:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 137us (6098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572161.912440:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 82 00000100:00100000:2.0:1788572162.432446:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584254976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572162.432649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572162.432797:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572162.432810:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584255104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572162.432839:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584254976 00000100:00100000:1.0:1788572162.432851:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584254976 00000100:00100000:2.0:1788572162.432853:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572162.432892:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584255104 00000100:00100000:2.0:1788572162.432898:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584255104 00000100:00100000:1.0:1788572162.432925:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788572162.432937:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584254976:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572162.432962:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6217 00000100:00100000:2.0:1788572162.432974:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584255104:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:1.0:1788572162.432984:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00002000:00000024:2.0:1788572162.433004:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572162.435689:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572162.435735:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584255232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572162.440436:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584255104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7441us (7557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572162.440460:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6217 00000100:00100000:2.0:1788572162.440618:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584255104:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788572162.442543:0:190512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8915437058505ns, next at 8916437040508ns, rc = 0 00000100:00080000:0.0:1788572162.442646:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572162.443918:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584254976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10970us (11258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572162.443937:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788572162.446623:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584254976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572162.448848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572162.449016:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584255232 00000100:00100000:1.0:1788572162.449030:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584255232 00000100:00100000:1.0:1788572162.449129:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6218 00000100:00100000:1.0:1788572162.449145:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584255232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572162.449195:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572162.449285:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584255232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572162.449295:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6218 00000100:00080000:3.0:1788572162.449608:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572162.449679:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584255232:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572162.494763:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572163.453345:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584255360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572163.453455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572163.453627:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584255360 00000100:00100000:1.0:1788572163.453640:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584255360 00000100:00100000:1.0:1788572163.453719:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788572163.453732:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584255360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572163.453786:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572163.453849:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584255360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572163.453858:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788572163.454925:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584255360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572163.457573:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5906a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584255744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.457689:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572163.457739:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584256256:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.457771:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572163.457791:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584256768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.457813:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572163.457841:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572163.457848:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5906a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584255616:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.457879:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572163.457895:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584256128:0@lo:400:kworker.0 00000100:00100000:3.0:1788572163.458071:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584255744 00000100:00100000:3.0:1788572163.458082:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584255744 00000100:00100000:3.0:1788572163.458156:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584255616 00000100:00100000:3.0:1788572163.458160:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584255616 00000100:00100000:3.0:1788572163.458187:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788572163.458200:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584255744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572163.458285:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584255744:12345-0@lo:400:kworker.0 Request processed in 89us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572163.458292:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788572163.458325:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788572163.458333:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584255616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572163.458363:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584255616:12345-0@lo:400:kworker.0 Request processed in 32us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572163.458369:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788572163.458391:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572163.458396:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572163.458591:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584256256 00000100:00100000:1.0:1788572163.458596:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584256256 00000100:00100000:1.0:1788572163.458643:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584256768 00000100:00100000:1.0:1788572163.458646:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584256768 00000100:00100000:1.0:1788572163.458670:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7591 00000100:00100000:1.0:1788572163.458677:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584256256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.458724:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584256256:12345-0@lo:400:kworker.0 Request processed in 48us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572163.458731:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7591 00000100:00100000:1.0:1788572163.458744:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7592 00000100:00100000:1.0:1788572163.458750:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584256768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.458783:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584256768:12345-0@lo:400:kworker.0 Request processed in 33us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572163.458789:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7592 00000100:00100000:1.0:1788572163.458834:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584255872:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.458869:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572163.458890:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584256384:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.458913:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572163.459057:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584256896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.459081:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572163.459103:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572163.459112:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5906a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584255488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.459144:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572163.459179:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584256000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.459202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572163.459218:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584256512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.459240:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572163.459274:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584255488 00000100:00100000:1.0:1788572163.459279:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584255488 00000100:00100000:1.0:1788572163.459324:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788572163.459332:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584255488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.459372:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584255488:12345-0@lo:400:kworker.0 Request processed in 41us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572163.459378:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788572163.459441:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5906a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584255488:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.461264:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572163.461349:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584256640:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.461418:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572163.461498:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5906a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584255744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.461517:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584256256:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.461534:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584256768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.461594:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5906a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584255616:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.461645:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584256384 00000100:00100000:2.0:1788572163.461653:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584256384 00000100:00100000:2.0:1788572163.461726:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584256640 00000100:00100000:2.0:1788572163.461730:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584256640 00000100:00100000:2.0:1788572163.461759:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7593 00000100:00100000:2.0:1788572163.461770:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584256384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.461843:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584256384:12345-0@lo:400:kworker.0 Request processed in 74us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572163.461851:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7593 00000100:00100000:2.0:1788572163.461883:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7594 00000100:00100000:2.0:1788572163.461889:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584256640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572163.462424:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584256128 00000100:00100000:0.0:1788572163.462432:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584256128 00000100:00100000:0.0:1788572163.462472:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788572163.462504:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584256128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.462646:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584256384:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.462733:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584255872 00000100:00100000:1.0:1788572163.462737:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584255872 00000100:00100000:1.0:1788572163.462771:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584256896 00000100:00100000:1.0:1788572163.462774:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584256896 00000100:00100000:1.0:1788572163.462788:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584256000 00000100:00100000:1.0:1788572163.462791:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584256000 00000100:00100000:1.0:1788572163.462821:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584256512 00000100:00100000:1.0:1788572163.462825:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584256512 00000100:00100000:1.0:1788572163.462840:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788572163.462849:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584255872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.462897:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584255872:12345-0@lo:400:kworker.0 Request processed in 50us (4027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572163.462904:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788572163.462930:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788572163.462937:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584256896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.462966:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584256896:12345-0@lo:400:kworker.0 Request processed in 31us (3884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572163.462972:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788572163.462982:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788572163.462988:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584256000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.463019:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584256000:12345-0@lo:400:kworker.0 Request processed in 31us (3816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572163.463026:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788572163.463037:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788572163.463043:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584256512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.463073:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584256512:12345-0@lo:400:kworker.0 Request processed in 31us (3832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572163.463079:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788572163.463104:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572163.463109:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572163.463112:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572163.463115:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572163.463142:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584256000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.463156:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584256512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.463166:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584255872:0@lo:400:kworker.0 00000100:00100000:1.0:1788572163.463177:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584256896:0@lo:400:kworker.0 00000100:00100000:0.0:1788572163.469118:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584256128:12345-0@lo:400:kworker.0 Request processed in 6617us (7841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572163.469143:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788572163.469623:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584256128:0@lo:400:kworker.0 00000100:00100000:2.0:1788572163.475033:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584256640:12345-0@lo:400:kworker.0 Request processed in 13127us (13597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572163.475055:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7594 00000100:00100000:3.0:1788572163.475497:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584256640:0@lo:400:kworker.0 00010000:00010000:3.0:1788572163.518907:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572164.543938:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572165.566110:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572166.014732:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572166.014766:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584257024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572166.014883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572166.014993:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584257024 00000100:00100000:2.0:1788572166.015003:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584257024 00000100:00100000:2.0:1788572166.015074:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6219 00000100:00100000:2.0:1788572166.015087:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584257024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572166.015136:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572166.015195:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584257024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572166.015203:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6219 00000100:00080000:1.0:1788572166.015422:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572166.015521:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584257024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572166.016040:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572166.016054:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584257152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572166.016102:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572166.016451:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584257152 00000100:00100000:0.0:1788572166.016459:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584257152 00000100:00100000:0.0:1788572166.016547:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6220 00000100:00100000:0.0:1788572166.016558:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584257152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572166.016587:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572166.016642:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584257152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572166.016649:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6220 00000100:00100000:0.0:1788572166.016697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584257152:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572166.017011:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788572166.018857:0:190494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788572166.018904:0:190494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449090 is committed 00000004:00080000:3.0:1788572166.018912:0:190494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788572166.019080:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.019098:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.019154:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.019161:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572166.019168:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.019183:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.019209:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203d:0x0].0x0 (ffff8e5a36aab000) 00010000:00010000:0.0:1788572166.019213:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788572166.019220:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.019228:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd3ef lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572166.019833:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584257280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572166.019939:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572166.019988:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584257280 00000100:00100000:2.0:1788572166.020065:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584257280 00000100:00100000:2.0:1788572166.020196:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22600 00000100:00100000:2.0:1788572166.020210:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584257280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572166.020266:0:177557:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6594 count 1 00010000:00010000:2.0:1788572166.020301:0:177557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572166.020340:0:177557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1e5 expref: 6 pid: 43923 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572166.020350:0:177557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c2:0x0].0x0 since=81s v=(0 0) 00010000:00010000:2.0:1788572166.020357:0:177557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572166.020363:0:177557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572166.020411:0:177557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1e5 expref: 6 pid: 43923 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572166.020429:0:177557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1e5 expref: 6 pid: 43923 timeout: 9019 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572166.020441:0:177557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:177557:1875444584257408:192.168.202.57@tcp:104: 00000100:00100000:2.0:1788572166.020572:0:177557:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d1f00 going to sleep for 11 seconds 00000100:00080000:1.0:1788572166.020890:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572166.024745:0:177557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:177557:1875444584257408:192.168.202.57@tcp:104: 00000100:00100000:3.0:1788572166.024760:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1788572166.024795:0:177557:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572166.025764:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569467136 00000100:00100000:0.0:1788572166.025779:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569467136 00010000:00010000:0.0:1788572166.025865:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1e5 expref: 7 pid: 43923 timeout: 9019 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572166.025916:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12893 00000100:00100000:0.0:1788572166.025927:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2397:x1875444569467136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572166.025945:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572166.025952:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1e5 expref: 7 pid: 43923 timeout: 9019 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.025968:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1e5 expref: 7 pid: 43923 timeout: 9019 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.025998:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed0565f/0x265cfe11109bcf18 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb1e5 expref: 7 pid: 43923 timeout: 9019 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.026023:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572166.026028:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572166.026035:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.026047:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.026087:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1788572166.026088:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572166.026142:0:177557:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572166.026162:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569467136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 234us (1405us total) trans 0 rc 0/0 00010000:00010000:2.0:1788572166.026163:0:177557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572166.026179:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12893 00010000:00010000:2.0:1788572166.026185:0:177557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572166.026196:0:177557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572166.026232:0:177557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572166.026559:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584257280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6350us (6618us total) trans 34359738470 rc 0/0 00000100:00100000:2.0:1788572166.026569:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22600 00000001:00080000:3.0:1788572166.026599:0:184840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738469 is committed 00010000:00010000:0.0:1788572166.027973:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572166.027989:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.028005:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572166.028010:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.028023:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.028047:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.028062:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109bd427 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572166.028089:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572166.028091:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572166.028093:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572166.028204:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905164e00/2, rc 0, transno 34359738470 00000100:00100000:1.0:1788572166.028217:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584257280:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572166.588915:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572167.021611:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572167.021680:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572167.021714:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572167.021746:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572167.021784:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572167.021828:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569467648 00000100:00100000:3.0:1788572167.021837:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569467648 00000100:00100000:3.0:1788572167.021886:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569467776 00000100:00100000:3.0:1788572167.021890:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569467776 00000100:00100000:3.0:1788572167.021929:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7595 00000100:00100000:3.0:1788572167.021940:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569467648:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572167.022126:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569467648:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 187us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572167.022135:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7595 00000100:00100000:0.0:1788572167.022258:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7596 00000100:00100000:0.0:1788572167.022268:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2400:x1875444569467776:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572167.022298:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2400:x1875444569467776:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572167.022305:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7596 00000100:00080000:0.0:1788572167.022337:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572167.023908:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569467392 00000100:00100000:1.0:1788572167.023922:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569467392 00000100:00100000:1.0:1788572167.024067:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569467520 00000100:00100000:1.0:1788572167.024072:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569467520 00000100:00100000:1.0:1788572167.024109:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 143 00000100:00100000:1.0:1788572167.024119:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:2399:x1875444569467392:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572167.024272:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569467264 00000100:00100000:2.0:1788572167.024278:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569467264 00000100:00100000:2.0:1788572167.024311:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 84 00000100:00100000:2.0:1788572167.024317:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2400:x1875444569467264:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572167.024378:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2400:x1875444569467264:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 61us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572167.024385:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 84 00000100:00100000:1.0:1788572167.024568:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:2399:x1875444569467392:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 450us (2887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572167.024576:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 143 00000100:00100000:1.0:1788572167.024594:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 144 00000100:00100000:1.0:1788572167.024600:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2400:x1875444569467520:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572167.024624:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2400:x1875444569467520:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572167.024629:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 144 00000100:00080000:0.0:1788572167.026162:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572167.026171:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572167.548736:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584257664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572167.548769:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584257536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572167.548886:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572167.548902:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5906a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584257792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572167.556765:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572167.556980:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584257536 00000100:00100000:3.0:1788572167.556991:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584257536 00000100:00100000:3.0:1788572167.557076:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6221 00000100:00100000:3.0:1788572167.557088:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584257536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572167.557116:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572167.557180:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584257536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572167.557188:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6221 00000100:00100000:2.0:1788572167.557374:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584257536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572167.560346:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572167.560513:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584257792 00000100:00100000:2.0:1788572167.560523:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584257792 00000100:00100000:2.0:1788572167.560585:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788572167.560595:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584257792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572167.560637:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1788572167.560700:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584257792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572167.560707:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788572167.562944:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5906a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584257792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572167.564214:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572167.564361:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584257664 00000100:00100000:2.0:1788572167.564370:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584257664 00000100:00100000:2.0:1788572167.564439:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6222 00000100:00100000:2.0:1788572167.564448:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584257664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572167.564472:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572167.564568:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584257664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572167.564575:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6222 00000100:00100000:1.0:1788572167.564733:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584257664:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788572167.564874:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572167.612751:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788572168.530016:0:191341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 73b: open(O_CREAT), unlink, replay, reconnect at open_replay reply, close ========================================================== 21:36:07 (1788572167) 00000100:00100000:1.0:1788572168.574529:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572168.574571:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584257920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572168.574666:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572168.574787:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584257920 00000100:00100000:0.0:1788572168.574794:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584257920 00000100:00100000:0.0:1788572168.574843:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788572168.574851:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584257920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572168.574885:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1788572168.574930:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584257920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572168.574935:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788572168.574978:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584257920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572168.575534:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584258048:0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.575569:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572168.575599:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584258560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.575619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572168.575631:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584259072:0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.575643:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572168.575669:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584258048 00000100:00100000:1.0:1788572168.575674:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584258048 00000100:00100000:1.0:1788572168.575711:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788572168.575720:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584258048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.575757:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584258048:12345-0@lo:400:kworker.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572168.575764:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788572168.575794:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584258560 00000100:00100000:1.0:1788572168.575798:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584258560 00000100:00100000:1.0:1788572168.575828:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584259072 00000100:00100000:1.0:1788572168.575830:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584259072 00000100:00100000:1.0:1788572168.575845:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788572168.575850:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584258560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.575876:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584258560:12345-0@lo:400:kworker.0 Request processed in 27us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572168.575880:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788572168.575889:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788572168.575892:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584259072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.575913:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584259072:12345-0@lo:400:kworker.0 Request processed in 21us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572168.575918:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788572168.575936:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572168.575960:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584258048:0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.575970:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584258560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.575978:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584259072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576059:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584258432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576099:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572168.576134:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584258944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576162:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572168.576179:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584259456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576199:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572168.576231:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572168.576240:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584258304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572168.576283:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584258816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576299:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572168.576312:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584259328:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576325:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572168.576345:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584258944 00000100:00100000:2.0:1788572168.576348:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584258944 00000100:00100000:2.0:1788572168.576381:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584258816 00000100:00100000:2.0:1788572168.576384:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584258816 00000100:00100000:2.0:1788572168.576403:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584259328 00000100:00100000:2.0:1788572168.576406:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584259328 00000100:00100000:2.0:1788572168.576425:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7597 00000100:00100000:2.0:1788572168.576432:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584258944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576471:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584258944:12345-0@lo:400:kworker.0 Request processed in 39us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.576509:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7597 00000100:00100000:2.0:1788572168.576522:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7598 00000100:00100000:2.0:1788572168.576527:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584258816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576548:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584258816:12345-0@lo:400:kworker.0 Request processed in 22us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.576551:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7598 00000100:00100000:2.0:1788572168.576557:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7599 00000100:00100000:2.0:1788572168.576560:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584259328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576574:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584259328:12345-0@lo:400:kworker.0 Request processed in 14us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.576578:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7599 00000100:00100000:2.0:1788572168.576599:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584258432 00000100:00100000:2.0:1788572168.576601:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584258432 00000100:00100000:2.0:1788572168.576617:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584259456 00000100:00100000:2.0:1788572168.576618:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584259456 00000100:00100000:2.0:1788572168.576624:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584258304 00000100:00100000:2.0:1788572168.576626:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584258304 00000100:00100000:2.0:1788572168.576634:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788572168.576639:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584258432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576657:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584258432:12345-0@lo:400:kworker.0 Request processed in 19us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.576662:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788572168.576671:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788572168.576677:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584259456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576707:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584259456:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.576713:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788572168.576723:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788572168.576729:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584258304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576754:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584258304:12345-0@lo:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.576759:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788572168.576775:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572168.576778:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572168.576780:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572168.576782:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572168.576801:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584258304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576810:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584258816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576815:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584259328:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576822:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584258432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576828:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584258944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.576833:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584259456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572168.576958:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584258176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572168.576983:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572168.577005:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584258688:0@lo:400:kworker.0 00000100:00100000:0.0:1788572168.577020:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572168.577031:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584259200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572168.577046:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572168.577727:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584259200 00000100:00100000:2.0:1788572168.577740:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584259200 00000100:00100000:2.0:1788572168.577797:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7600 00000100:00100000:2.0:1788572168.577804:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584259200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.577848:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584259200:12345-0@lo:400:kworker.0 Request processed in 46us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.577853:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7600 00000100:00100000:2.0:1788572168.577885:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584259200:0@lo:400:kworker.0 00000100:00080000:2.0:1788572168.577904:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572168.577913:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584258176 00000100:00100000:2.0:1788572168.577915:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584258176 00000100:00100000:2.0:1788572168.577939:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788572168.577943:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584258176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572168.577965:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584258176:12345-0@lo:400:kworker.0 Request processed in 22us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.577969:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1788572168.577978:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572168.577987:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584258176:0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.580354:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584258688 00000100:00100000:1.0:1788572168.580368:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584258688 00000100:00100000:1.0:1788572168.580422:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788572168.580431:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584258688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572168.580544:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584258688:12345-0@lo:400:kworker.0 Request processed in 115us (3522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572168.580550:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788572168.580589:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584258688:0@lo:400:kworker.0 00010000:00010000:0.0:1788572168.638721:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572168.651733:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572168.651811:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569468032 00000100:00100000:1.0:1788572168.651821:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569468032 00000100:00100000:1.0:1788572168.651883:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 933 00000100:00100000:1.0:1788572168.651894:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:159094:x1875444569468032:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1788572168.651915:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572168.651918:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788572168.651944:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109bd228 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb21d expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.651964:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabd00) 00010000:00010000:1.0:1788572168.651976:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572168.651992:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670400/0x265cfe11109bd42e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb239 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653013:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653029:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653050:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653063:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653070:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653077:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572168.653574:0:188833:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x19c3:0x0], count =31 00000004:00080000:1.0:1788572168.653581:0:188833:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x19c3:0x0]+31 in llog 00000004:00080000:1.0:1788572168.653598:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x19e2:0x0], index 0: 0 00010000:00010000:1.0:1788572168.653760:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bd443 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653770:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bd443 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653778:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bd443 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653814:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653821:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653828:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653834:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572168.653838:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653845:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653856:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabb00) 00010000:00010000:1.0:1788572168.653859:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572168.653863:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653868:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671600/0x265cfe11109bd435 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572168.653880:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088663f80 reply state 000000000837f1e0 transno 335007449091 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653891:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653896:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8e5a36aab300) 00010000:00010000:1.0:1788572168.653899:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572168.653902:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572168.653934:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670400/0x265cfe11109bd42e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb239 expref: 13 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653953:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bd443 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb239 expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572168.653960:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e5a36aab100) 00010000:00010000:1.0:1788572168.653962:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572168.653965:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671000, rc 0) 00000100:00100000:1.0:1788572168.655303:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:159094:x1875444569468032:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2143us (2310us total) trans 335007449091 rc 0/0 00000100:00100000:1.0:1788572168.655322:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 933 00000100:00100000:0.0:1788572168.696764:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572168.696811:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569468160 00000100:00100000:2.0:1788572168.696821:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569468160 00000100:00100000:2.0:1788572168.696881:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 934 00000100:00100000:2.0:1788572168.696893:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:159096:x1875444569468160:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:2.0:1788572168.696918:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572168.696940:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bd451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb240 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572168.697008:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bd458 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572168.697024:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bd458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572168.697047:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bd458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572168.697097:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572168.697101:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572168.697123:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bd458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572168.697147:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bd451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb240 expref: 15 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572168.697165:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bd458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb240 expref: 14 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572168.697185:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a4215f200) 00010000:00010000:2.0:1788572168.697188:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572168.697192:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255e00, rc 0) 00000100:00100000:2.0:1788572168.697255:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:159096:x1875444569468160:12345-192.168.202.57@tcp:101:rm.0 Request processed in 364us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.697262:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 934 00000100:00100000:0.0:1788572168.711358:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572168.713654:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569468288 00000100:00100000:3.0:1788572168.713669:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569468288 00000100:00100000:3.0:1788572168.713751:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22601 00000100:00100000:3.0:1788572168.713762:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2400:x1875444569468288:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572168.713781:0:43931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572168.713805:0:43931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb247 expref: -99 pid: 43931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572168.713832:0:43931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572168.713851:0:43931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e2:0x0].0x0 since=8921s v=(0 0) 00010000:00010000:3.0:1788572168.713856:0:43931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572168.713865:0:43931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb247 expref: 6 pid: 43931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.713885:0:43931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb247 expref: 6 pid: 43931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.713900:0:43931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60d800, rc 0) 00000100:00100000:3.0:1788572168.713962:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2400:x1875444569468288:12345-192.168.202.57@tcp:101:rm.0 Request processed in 202us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572168.713970:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22601 00000100:00080000:2.0:1788572168.714144:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572168.722095:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572168.722229:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569468544 00000100:00100000:3.0:1788572168.722240:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569468544 00000100:00100000:3.0:1788572168.722301:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 935 00000100:00100000:3.0:1788572168.722313:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:159096:x1875444569468544:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572168.722366:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788572168.722394:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671000/0x265cfe11109bd443 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb239 expref: 14 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722413:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e5a36aab100) 00010000:00010000:3.0:1788572168.722431:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bd458 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb240 expref: 13 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722454:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a4215f200) 00010000:00010000:3.0:1788572168.722461:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572168.722515:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722528:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722538:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722549:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722557:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722565:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722680:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722689:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722696:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572168.722901:0:188048:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x20001a9e3:0x203f:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1788572168.722980:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.722988:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723005:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723010:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572168.723015:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723023:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723032:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e5a0a4b7f00) 00010000:00010000:3.0:1788572168.723034:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572168.723038:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723053:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd474 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723069:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723074:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723079:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723084:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60de00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572168.723087:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723096:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723103:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a4b7b00) 00010000:00010000:3.0:1788572168.723105:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572168.723107:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723112:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd466 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572168.723123:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c957261 reply state 00000000195d12e6 transno 335007449092 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723133:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.723138:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8e5a36aab300) 00010000:00010000:3.0:1788572168.723140:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572168.723143:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572168.723234:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:159096:x1875444569468544:12345-192.168.202.57@tcp:36:rm.0 Request processed in 922us (1147us total) trans 335007449092 rc 0/0 00000100:00100000:3.0:1788572168.723242:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 935 00000001:00080000:2.0:1788572169.603863:0:190494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449092 is committed 00000001:00080000:1.0:1788572169.604528:0:184840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738470 is committed 00010000:00010000:3.0:1788572169.604810:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604824:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604833:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604841:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572169.604846:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604855:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604873:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8e5a36aab300) 00010000:00010000:3.0:1788572169.604876:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572169.604882:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604888:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bd43c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604912:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604918:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604924:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604929:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572169.604932:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604939:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604951:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8e5a36aab300) 00010000:00010000:3.0:1788572169.604954:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572169.604957:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.604963:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd46d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572169.653684:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572169.653743:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569468672 00000100:00100000:3.0:1788572169.653766:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569468672 00000100:00100000:3.0:1788572169.653852:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 936 00000100:00100000:3.0:1788572169.653866:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+10:159105:x1875444569468672:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572169.653892:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572169.653921:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd47b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb24e expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.654011:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd482 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.654028:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.654040:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572169.654088:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1788572169.654092:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572169.654116:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.654141:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd47b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb24e expref: 12 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.654158:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb24e expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.654168:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a4b7f00) 00010000:00010000:3.0:1788572169.654171:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572169.654175:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60de00, rc 0) 00000100:00100000:3.0:1788572169.654245:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:159105:x1875444569468672:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 381us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572169.654253:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 936 00000100:00080000:3.0:1788572169.654281:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572169.665051:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572169.666051:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569468800 00000100:00100000:3.0:1788572169.666065:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569468800 00000100:00100000:3.0:1788572169.666134:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 937 00000100:00100000:3.0:1788572169.666145:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:159105:x1875444569468800:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572169.666193:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572169.666267:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:159105:x1875444569468800:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 123us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572169.666274:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 937 00010000:00010000:3.0:1788572169.671072:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572169.678280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572169.678415:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569468928 00000100:00100000:2.0:1788572169.678426:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569468928 00000100:00100000:2.0:1788572169.678518:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 938 00000100:00100000:2.0:1788572169.678531:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159105:x1875444569468928:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:2.0:1788572169.678573:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:2.0:1788572169.678645:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159105:x1875444569468928:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 118us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572169.678653:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 938 00000100:00080000:3.0:1788572169.678857:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572169.687677:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572169.687778:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569469056 00000100:00100000:2.0:1788572169.687789:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569469056 00000100:00100000:2.0:1788572169.687854:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6223 00000100:00100000:2.0:1788572169.687865:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159105:x1875444569469056:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:2.0:1788572169.687899:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572169.687961:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159105:x1875444569469056:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572169.687969:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6223 00000100:00100000:2.0:1788572169.690230:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572169.690317:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569469184 00000100:00100000:3.0:1788572169.690330:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569469184 00000100:00100000:3.0:1788572169.690413:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6224 00000100:00100000:3.0:1788572169.690427:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:159105:x1875444569469184:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572169.690507:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00080000:2.0:1788572169.690922:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572169.694893:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:159105:x1875444569469184:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 4457us (4666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572169.694912:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6224 00000100:00100000:0.0:1788572169.767288:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572169.767393:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569469440 00000100:00100000:3.0:1788572169.767404:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569469440 00000100:00100000:3.0:1788572169.767516:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 939 00000100:00100000:3.0:1788572169.767528:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:159112:x1875444569469440:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00010000:3.0:1788572169.767596:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572169.767638:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd482 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb24e expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.767660:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a4b7f00) 00010000:00010000:3.0:1788572169.767670:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572169.768136:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768154:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768164:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768179:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768197:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768205:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768669:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768679:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768687:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768693:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572169.768698:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768707:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768717:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a4b7900) 00010000:00010000:3.0:1788572169.768720:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572169.768724:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.768731:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd489 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572169.769071:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b336513c reply state 000000003cd1ccf8 transno 335007449093 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.769085:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.769092:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a0a4b7200) 00010000:00010000:3.0:1788572169.769095:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572169.769098:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572169.769253:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:159112:x1875444569469440:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 1725us (1980us total) trans 335007449093 rc 0/0 00000100:00100000:3.0:1788572169.769262:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 939 00000100:00100000:2.0:1788572169.799266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572169.799444:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569469568 00000100:00100000:3.0:1788572169.799455:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569469568 00000100:00100000:3.0:1788572169.799533:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 940 00000100:00100000:3.0:1788572169.799545:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:159115:x1875444569469568:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572169.799576:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572169.799599:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd497 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb255 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.799670:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd49e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.799686:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd49e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.799700:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd49e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572169.799931:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1788572169.799936:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572169.799959:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd49e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.799990:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd497 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb255 expref: 14 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.800012:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd49e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb255 expref: 13 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.800021:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a4b7900) 00010000:00010000:3.0:1788572169.800023:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572169.800026:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60de00, rc 0) 00000100:00100000:3.0:1788572169.800099:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:159115:x1875444569469568:12345-192.168.202.57@tcp:101:rm.0 Request processed in 556us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572169.800108:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 940 00000100:00100000:3.0:1788572169.808318:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572169.808906:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569469696 00000100:00100000:1.0:1788572169.808917:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569469696 00000100:00100000:1.0:1788572169.808985:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 941 00000100:00100000:1.0:1788572169.808996:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:159115:x1875444569469696:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572169.809018:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572169.809042:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bd4a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb25c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809106:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809119:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809131:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809139:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809143:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809147:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809257:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd4ba lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809266:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd4ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809272:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd4ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572169.809317:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x2040:0x0]: returning size 0 00000004:00200000:1.0:1788572169.809321:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572169.809346:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd4ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809356:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd4ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809363:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809569:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809576:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809583:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572169.809587:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809594:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809603:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a4b7900) 00010000:00010000:1.0:1788572169.809605:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572169.809609:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809614:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671200/0x265cfe11109bd4ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809624:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809628:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809632:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809634:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572169.809637:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809641:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809644:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a0a4b7200) 00010000:00010000:1.0:1788572169.809645:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572169.809647:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809650:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bd4b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809670:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bd4a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb25c expref: 15 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809679:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd4ba lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb25c expref: 14 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572169.809683:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2040:0x0].0x0 (ffff8e5a36aab200) 00010000:00010000:1.0:1788572169.809684:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572169.809686:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671c00, rc 0) 00000100:00100000:1.0:1788572169.809801:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:159115:x1875444569469696:12345-192.168.202.57@tcp:101:rm.0 Request processed in 806us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572169.809807:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 941 00000100:00100000:2.0:1788572169.817036:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572169.817080:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569469952 00000100:00100000:2.0:1788572169.817090:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569469952 00000100:00100000:2.0:1788572169.817145:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 942 00000100:00100000:2.0:1788572169.817154:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:159115:x1875444569469952:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572169.817222:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788572169.817260:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671c00/0x265cfe11109bd4ba lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb25c expref: 14 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572169.817287:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2040:0x0].0x0 (ffff8e5a36aab200) 00010000:00010000:2.0:1788572169.817309:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60de00/0x265cfe11109bd49e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb255 expref: 13 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572169.817320:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a0a4b7900) 00010000:00010000:2.0:1788572169.817327:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572169.817363:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572169.817635:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572169.817647:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818126:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818137:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818146:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818255:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818264:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818271:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818458:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818465:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818470:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818475:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818508:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818512:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818527:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572169.818542:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818546:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818550:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818553:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572169.818557:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818562:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818572:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2040:0x0].0x0 (ffff8e5a0a4b7b00) 00010000:00010000:3.0:1788572169.818574:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572169.818578:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818582:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d200/0x265cfe11109bd4cf lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818592:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818596:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818599:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818603:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572169.818604:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818607:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818611:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a31dfcd00) 00010000:00010000:3.0:1788572169.818612:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572169.818614:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818617:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bd4c1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572169.818631:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085fe4ba2 reply state 00000000b7ea0d72 transno 335007449094 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818638:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572169.818642:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a0a4b7200) 00010000:00010000:3.0:1788572169.818643:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572169.818646:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572169.818723:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:159115:x1875444569469952:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1568us (1697us total) trans 335007449094 rc 0/0 00000100:00100000:3.0:1788572169.818728:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 942 00010000:00010000:0.0:1788572169.818961:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572169.818969:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572169.818976:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572169.818979:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572169.818985:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572169.818996:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2040:0x0].0x0 (ffff8e5a0a4b7b00) 00010000:00010000:0.0:1788572169.818999:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572169.819002:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572169.819013:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c400/0x265cfe11109bd4d6 lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572169.819028:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572169.819029:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572169.819030:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572170.688335:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572171.137521:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572171.138249:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584259584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572171.138406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572171.138468:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584259584 00000100:00100000:2.0:1788572171.138477:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584259584 00000100:00100000:3.0:1788572171.138542:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572171.138553:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584259712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572171.138581:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572171.138606:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584259712 00000100:00100000:3.0:1788572171.138609:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584259712 00000100:00100000:3.0:1788572171.138637:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6225 00000100:00100000:3.0:1788572171.138646:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584259712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572171.138672:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572171.138681:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6226 00000100:00100000:2.0:1788572171.138691:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584259584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572171.138713:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572171.138714:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584259712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572171.138736:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6225 00000100:00100000:2.0:1788572171.138756:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584259584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572171.138765:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6226 00000100:00100000:3.0:1788572171.138787:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584259712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572171.138822:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584259584:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572171.138870:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572171.138875:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572171.709743:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572172.150981:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572172.151031:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572172.151066:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572172.151088:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572172.151118:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572172.151160:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569470592 00000100:00100000:0.0:1788572172.151169:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569470592 00000100:00100000:0.0:1788572172.151241:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569470464 00000100:00100000:0.0:1788572172.151244:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569470464 00000100:00100000:0.0:1788572172.151273:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7601 00000100:00100000:0.0:1788572172.151287:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569470592:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572172.151462:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569470080 00000100:00100000:1.0:1788572172.151467:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569470080 00000100:00100000:1.0:1788572172.151535:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 86 00000100:00100000:1.0:1788572172.151544:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569470080:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572172.151602:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569470080:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 59us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572172.151609:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 86 00000100:00100000:1.0:1788572172.151645:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569470208 00000100:00100000:1.0:1788572172.151649:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569470208 00000100:00100000:1.0:1788572172.151679:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569470336 00000100:00100000:1.0:1788572172.151682:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569470336 00000100:00100000:1.0:1788572172.151719:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 151 00000100:00100000:1.0:1788572172.151727:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:2397:x1875444569470208:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572172.151749:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36eab100 x1875444569470208/t0(0) o400->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:588/0 lens 224/224 e 0 to 0 dl 1788572183 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572172.151776:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:2397:x1875444569470208:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 51us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572172.151783:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 151 00000100:00100000:1.0:1788572172.151796:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 152 00000100:00100000:1.0:1788572172.151802:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569470336:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572172.151826:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569470336:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572172.151833:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 152 00000100:00100000:0.0:1788572172.153326:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569470592:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 2034us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572172.153349:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7601 00000100:00100000:0.0:1788572172.153380:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7602 00000100:00100000:0.0:1788572172.153390:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569470464:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572172.153423:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569470464:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 36us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572172.153429:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7602 00000100:00080000:0.0:1788572172.153449:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572172.153454:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572172.153457:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572172.153460:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572172.668732:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584259840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572172.668814:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572172.669035:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584259840 00000100:00100000:3.0:1788572172.669044:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584259840 00000100:00100000:3.0:1788572172.669103:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788572172.669113:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584259840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572172.669168:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00010000:00000080:3.0:1788572172.669188:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729c000 x1875444584259840/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:588/0 lens 224/368 e 0 to 0 dl 1788572183 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572172.669234:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584259840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572172.669241:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788572172.669640:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584259968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572172.669694:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572172.669820:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584259968 00000100:00100000:3.0:1788572172.669826:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584259968 00000100:00100000:3.0:1788572172.669883:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6227 00000100:00100000:3.0:1788572172.669890:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584259968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572172.669906:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572172.669942:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584259968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572172.669948:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6227 00000100:00100000:0.0:1788572172.670050:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584259840:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788572172.670193:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572172.670214:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738470 gen 2 00000004:00080000:2.0:1788572172.670220:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5905164e00, transno 34359738470 00000100:00100000:2.0:1788572172.670243:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584259968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572172.675638:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572172.675668:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584260096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572172.675768:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572172.676047:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584260096 00000100:00100000:3.0:1788572172.676059:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584260096 00000100:00100000:3.0:1788572172.676155:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6228 00000100:00100000:3.0:1788572172.676164:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584260096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572172.676193:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572172.676249:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584260096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572172.676256:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6228 00000100:00080000:0.0:1788572172.676318:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572172.676471:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584260096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572172.732957:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572173.693861:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572173.693885:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584260224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572173.693954:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572173.693981:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584260224 00000100:00100000:1.0:1788572173.693991:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584260224 00000100:00100000:0.0:1788572173.693995:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584260608:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.694021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572173.694040:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584261120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572173.694052:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788572173.694063:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572173.694063:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584260224:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572173.694079:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584261632:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.694097:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1788572173.694101:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1788572173.694112:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572173.694117:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584260736:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.694149:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572173.694157:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584260224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572173.694165:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788572173.694166:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584261248:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.694186:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572173.694208:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584261760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572173.694210:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584261120 00000100:00100000:1.0:1788572173.694214:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584261120 00000100:00100000:0.0:1788572173.694229:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572173.694250:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584261632 00000100:00100000:1.0:1788572173.694254:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584261632 00000100:00100000:0.0:1788572173.694264:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584260224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572173.694269:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584261248 00000100:00100000:1.0:1788572173.694270:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584261248 00000100:00100000:1.0:1788572173.694286:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584261760 00000100:00100000:1.0:1788572173.694289:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584261760 00000100:00100000:0.0:1788572173.694290:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584260352:0@lo:400:kworker.0 00000100:00100000:1.0:1788572173.694305:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7603 00000100:00100000:1.0:1788572173.694311:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584261120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572173.694779:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7604 00000100:00100000:3.0:1788572173.694791:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584261632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572173.695840:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584260480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572173.699330:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584261120:12345-0@lo:400:kworker.0 Request processed in 5007us (5252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572173.699347:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7603 00000100:00100000:1.0:1788572173.699392:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7605 00000100:00100000:1.0:1788572173.699407:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584261248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572173.699463:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584261248:12345-0@lo:400:kworker.0 Request processed in 63us (5274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572173.699469:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7605 00000100:00100000:1.0:1788572173.699496:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7606 00000100:00100000:1.0:1788572173.699924:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584261760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572173.699964:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584261760:12345-0@lo:400:kworker.0 Request processed in 461us (5732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572173.699982:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7606 00000100:00100000:1.0:1788572173.700644:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584260608 00000100:00100000:1.0:1788572173.700653:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584260608 00000100:00100000:1.0:1788572173.700699:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584260736 00000100:00100000:1.0:1788572173.700703:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584260736 00000100:00100000:1.0:1788572173.700740:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788572173.700749:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584260608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572173.700864:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584260608:12345-0@lo:400:kworker.0 Request processed in 48us (6772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572173.700871:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788572173.700886:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788572173.700893:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584260736:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572173.700905:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1f8ff480 x1875444584260736/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788572184 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572173.700937:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584260736:12345-0@lo:400:kworker.0 Request processed in 45us (6788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572173.700944:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788572173.703185:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572173.703238:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584260992:0@lo:400:kworker.0 00000100:00100000:2.0:1788572173.703273:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572173.703327:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584261504:0@lo:400:kworker.0 00000100:00100000:2.0:1788572173.703351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572173.703505:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584260992 00000100:00100000:2.0:1788572173.703517:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584260992 00000100:00100000:2.0:1788572173.704025:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584261504 00000100:00100000:2.0:1788572173.704030:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584261504 00000100:00100000:2.0:1788572173.704054:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788572173.704063:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584260992:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572173.704099:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36aafb80 x1875444584260992/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788572184 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572173.704172:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584260992:12345-0@lo:400:kworker.0 Request processed in 109us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572173.704185:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788572173.704205:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788572173.704211:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584261504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572173.704240:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584261504:12345-0@lo:400:kworker.0 Request processed in 31us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572173.704246:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788572173.704296:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584260992:0@lo:400:kworker.0 00000100:00100000:2.0:1788572173.704307:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584261504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572173.704710:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584261632:12345-0@lo:400:kworker.0 Request processed in 9922us (10609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572173.704718:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7604 00000100:00100000:1.0:1788572173.704917:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584260480 00000100:00100000:1.0:1788572173.704923:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584260480 00000100:00100000:1.0:1788572173.704981:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788572173.704990:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584260480:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572173.705013:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36aadf80 x1875444584260480/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788572184 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572173.705059:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584260480:12345-0@lo:400:kworker.0 Request processed in 71us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572173.705065:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1788572173.707236:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572173.707247:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572173.707252:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572173.707256:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572173.710841:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584260480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.711193:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572173.711270:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584260864:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.711347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572173.711381:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584260864 00000100:00100000:0.0:1788572173.711389:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584260864 00000100:00100000:0.0:1788572173.711446:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788572173.711458:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584260864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.711541:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584260864:12345-0@lo:400:kworker.0 Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572173.711548:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788572173.711611:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584260736:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.711628:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584261248:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.711643:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584261760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.711657:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584260608:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.711672:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584261120:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.711687:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584261632:0@lo:400:kworker.0 00000100:00080000:0.0:1788572173.711724:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572173.711965:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584260864:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.711975:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584261376:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.712004:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572173.712027:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584261888:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.712047:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572173.712071:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584261376 00000100:00100000:0.0:1788572173.712075:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584261376 00000100:00100000:0.0:1788572173.712100:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584261888 00000100:00100000:0.0:1788572173.712104:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584261888 00000100:00100000:0.0:1788572173.712120:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788572173.712140:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584261376:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572173.712158:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1f8ffb80 x1875444584261376/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788572184 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572173.712231:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584261376:12345-0@lo:400:kworker.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572173.712237:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788572173.712250:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788572173.712256:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584261888:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572173.712267:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1f8fdc00 x1875444584261888/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788572184 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572173.712290:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584261888:12345-0@lo:400:kworker.0 Request processed in 35us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572173.712296:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788572173.712335:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584261888:0@lo:400:kworker.0 00000100:00100000:0.0:1788572173.712355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584261376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572173.712539:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584260352 00000100:00100000:3.0:1788572173.712544:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584260352 00000100:00100000:3.0:1788572173.712591:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788572173.712598:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584260352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572173.712637:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584260352:12345-0@lo:400:kworker.0 Request processed in 40us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572173.712642:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788572173.712676:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584260352:0@lo:400:kworker.0 00010000:00010000:2.0:1788572173.759787:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572174.791195:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788572175.744473:0:190494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449094 is committed 00010000:00010000:3.0:1788572175.744634:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744648:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744656:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744663:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572175.744668:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744687:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744707:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a0a4b7200) 00010000:00010000:3.0:1788572175.744711:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572175.744716:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744723:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c200/0x265cfe11109bd490 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744742:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744749:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744755:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744761:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572175.744764:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744771:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744781:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a0a4b7200) 00010000:00010000:3.0:1788572175.744784:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572175.744787:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572175.744794:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60c600/0x265cfe11109bd4c8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572175.812867:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572176.253706:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584262016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572176.253793:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572176.253874:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584262016 00000100:00100000:1.0:1788572176.253886:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584262016 00000100:00100000:1.0:1788572176.253970:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6229 00000100:00100000:1.0:1788572176.253979:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584262016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572176.254017:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572176.254075:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584262016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572176.254083:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6229 00000100:00080000:0.0:1788572176.254153:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572176.254199:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584262144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572176.254232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572176.254295:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584262144 00000100:00100000:1.0:1788572176.254300:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584262144 00000100:00100000:1.0:1788572176.254341:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6230 00000100:00100000:1.0:1788572176.254348:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584262144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572176.254366:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572176.254397:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584262144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572176.254404:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6230 00000100:00080000:0.0:1788572176.254450:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572176.254532:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584262144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572176.255179:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584262016:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1788572176.412973:0:191737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:3.0:1788572176.829341:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572177.260631:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572177.260673:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572177.260698:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572177.260739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572177.260779:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572177.260821:0:190500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569470720 00000100:00100000:2.0:1788572177.260834:0:190500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569470720 00000100:00100000:2.0:1788572177.260918:0:190500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 88 00000100:00100000:2.0:1788572177.260932:0:190500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569470720:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572177.261045:0:190500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569470720:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 117us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572177.261054:0:190500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 88 00000100:00100000:2.0:1788572177.261098:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569470976 00000100:00100000:2.0:1788572177.261103:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569470976 00000100:00100000:2.0:1788572177.261148:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569470848 00000100:00100000:2.0:1788572177.261151:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569470848 00000100:00100000:2.0:1788572177.261180:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 159 00000100:00100000:2.0:1788572177.261188:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569470976:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572177.261223:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569470976:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 36us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572177.261230:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 159 00000100:00100000:2.0:1788572177.261247:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 160 00000100:00100000:2.0:1788572177.261254:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+10:2397:x1875444569470848:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:2.0:1788572177.261282:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b0380 x1875444569470848/t0(0) o400->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:593/0 lens 224/224 e 0 to 0 dl 1788572188 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572177.261306:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+10:2397:x1875444569470848:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 52us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572177.261313:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 160 00000100:00100000:2.0:1788572177.261334:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569471232 00000100:00100000:2.0:1788572177.261337:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569471232 00000100:00100000:2.0:1788572177.261365:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569471104 00000100:00100000:2.0:1788572177.261368:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569471104 00000100:00100000:2.0:1788572177.261390:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7607 00000100:00100000:2.0:1788572177.261397:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2397:x1875444569471232:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572177.261423:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2397:x1875444569471232:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 27us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572177.261434:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7607 00000100:00100000:2.0:1788572177.261446:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7608 00000100:00100000:2.0:1788572177.261452:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569471104:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572177.261473:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569471104:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 22us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572177.261517:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7608 00000100:00080000:2.0:1788572177.261698:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572177.261704:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572177.261706:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572177.261708:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572177.788833:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572177.788865:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584262272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572177.788954:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572177.789016:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584262272 00000100:00100000:1.0:1788572177.789025:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584262272 00000100:00100000:1.0:1788572177.789108:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6231 00000100:00100000:1.0:1788572177.789117:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584262272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572177.789145:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572177.789193:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584262272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572177.789199:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6231 00000100:00100000:1.0:1788572177.789250:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584262272:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572177.789324:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572177.789791:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584262400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572177.789826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572177.791541:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584262400 00000100:00100000:2.0:1788572177.791553:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584262400 00000100:00100000:2.0:1788572177.791631:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6232 00000100:00100000:2.0:1788572177.791641:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584262400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572177.791678:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572177.791766:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584262400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572177.791773:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6232 00000100:00100000:2.0:1788572177.791829:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584262400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788572177.796069:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572177.797762:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584262528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572177.797900:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572177.797967:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584262528 00000100:00100000:0.0:1788572177.797978:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584262528 00000100:00100000:0.0:1788572177.798037:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788572177.798046:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584262528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572177.798108:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00010000:00000080:0.0:1788572177.798127:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1095e300 x1875444584262528/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:593/0 lens 224/368 e 0 to 0 dl 1788572188 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572177.798181:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584262528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572177.798188:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788572177.802547:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584262528:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788572177.854640:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572178.812902:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584262912:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.812979:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572178.813012:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584263424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.813037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572178.813066:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584263936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.813094:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572178.813120:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788572178.813125:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584263040:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.813144:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572178.813158:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584263552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.813175:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572178.813199:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584264064:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.813369:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584262656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.813403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572178.813433:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584263168:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.813452:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572178.813463:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584263680:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.813498:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572178.813511:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584264192:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.813527:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572178.813538:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788572178.813543:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584262784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.813564:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572178.813575:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584263296:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.813614:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572178.813632:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584263808:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.813652:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572178.813666:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584264320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572178.813681:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572178.813705:0:190503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584262656 00000100:00100000:1.0:1788572178.813713:0:190503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584262656 00000100:00100000:1.0:1788572178.813762:0:190503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788572178.813772:0:190503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584262656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.813820:0:190503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584262656:12345-0@lo:400:kworker.0 Request processed in 49us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572178.813828:0:190503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788572178.813862:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584263296 00000100:00100000:1.0:1788572178.813866:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584263296 00000100:00100000:1.0:1788572178.813882:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584263808 00000100:00100000:1.0:1788572178.813885:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584263808 00000100:00100000:1.0:1788572178.813894:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584264320 00000100:00100000:1.0:1788572178.813897:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584264320 00000100:00100000:1.0:1788572178.813907:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788572178.813913:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584263296:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572178.813932:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cd2d80 x1875444584263296/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788572189 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572178.813962:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584263296:12345-0@lo:400:kworker.0 Request processed in 48us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572178.813968:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788572178.813981:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788572178.813986:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584263808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.814014:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584263808:12345-0@lo:400:kworker.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572178.814020:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788572178.814031:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788572178.814037:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584264320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572178.814075:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572178.814105:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584264320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572178.814109:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788572178.814141:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584263296:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.814147:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584263808:0@lo:400:kworker.0 00000100:00100000:1.0:1788572178.814155:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584264320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572178.814161:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584262656:0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.814381:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584262912 00000100:00100000:2.0:1788572178.814386:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584262912 00000100:00100000:2.0:1788572178.814425:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584263040 00000100:00100000:2.0:1788572178.814428:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584263040 00000100:00100000:2.0:1788572178.814437:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584263168 00000100:00100000:2.0:1788572178.814439:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584263168 00000100:00100000:2.0:1788572178.814449:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584263680 00000100:00100000:2.0:1788572178.814452:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584263680 00000100:00100000:2.0:1788572178.814459:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584264192 00000100:00100000:2.0:1788572178.814461:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584264192 00000100:00100000:2.0:1788572178.814468:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584262784 00000100:00100000:2.0:1788572178.814469:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584262784 00000100:00100000:2.0:1788572178.814516:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788572178.814523:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584262912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.814563:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584262912:12345-0@lo:400:kworker.0 Request processed in 41us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.814569:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788572178.814585:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788572178.814591:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584263040:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572178.814615:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a52680 x1875444584263040/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788572189 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572178.814646:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584263040:12345-0@lo:400:kworker.0 Request processed in 56us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.814651:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788572178.814661:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788572178.814666:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584263168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.814697:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584263168:12345-0@lo:400:kworker.0 Request processed in 28us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.814703:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788572178.814712:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788572178.814717:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584263680:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572178.814726:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fbb4380 x1875444584263680/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788572189 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572178.814752:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584263680:12345-0@lo:400:kworker.0 Request processed in 35us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.814757:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788572178.814766:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788572178.814771:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584264192:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572178.814780:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fbb4700 x1875444584264192/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788572189 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572178.814801:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584264192:12345-0@lo:400:kworker.0 Request processed in 31us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.814806:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788572178.814814:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788572178.814820:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584262784:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572178.814830:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cd0a80 x1875444584262784/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788572189 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572178.814853:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584262784:12345-0@lo:400:kworker.0 Request processed in 34us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.814858:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788572178.814877:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584263424 00000100:00100000:2.0:1788572178.814881:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584263424 00000100:00100000:2.0:1788572178.814909:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584263936 00000100:00100000:2.0:1788572178.814912:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584263936 00000100:00100000:2.0:1788572178.814928:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584263552 00000100:00100000:2.0:1788572178.814931:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584263552 00000100:00100000:2.0:1788572178.814958:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7609 00000100:00100000:2.0:1788572178.814965:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584263424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.814995:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584263424:12345-0@lo:400:kworker.0 Request processed in 31us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.814999:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7609 00000100:00100000:2.0:1788572178.815006:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7610 00000100:00100000:2.0:1788572178.815009:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584263936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.815025:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584263936:12345-0@lo:400:kworker.0 Request processed in 16us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.815028:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7610 00000100:00100000:2.0:1788572178.815033:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7611 00000100:00100000:2.0:1788572178.815036:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584263552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.815067:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584263552:12345-0@lo:400:kworker.0 Request processed in 29us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.815073:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7611 00000100:00100000:2.0:1788572178.815168:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584262784:0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.815319:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584263168:0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.815335:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584263680:0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.815347:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584264192:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.815462:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572178.815520:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584262912:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.815532:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584263424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.815544:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584263936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.815568:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584263040:0@lo:400:kworker.0 00000100:00100000:0.0:1788572178.815580:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584263552:0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.815717:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584264064 00000100:00100000:2.0:1788572178.815722:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584264064 00000100:00100000:2.0:1788572178.815748:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7612 00000100:00100000:2.0:1788572178.815754:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584264064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572178.815798:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584264064:12345-0@lo:400:kworker.0 Request processed in 43us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572178.815807:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7612 00000100:00100000:2.0:1788572178.815832:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584264064:0@lo:400:kworker.0 00000100:00080000:1.0:1788572178.816260:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572178.816266:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572178.816270:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572178.816273:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788572178.880375:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788572179.180803:0:191883:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788572179.180861:0:191883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.180876:0:191883:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.180884:0:191883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.180892:0:191883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.180925:0:191883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788572179.180930:0:191883:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788572179.180960:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572179.180964:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788572179.180971:0:191883:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788572179.180998:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e59019de000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788572179.181108:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572179.181117:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.181125:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5800 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572179.181129:0:10396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.181139:0:10396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572179.181147:0:10396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572179.181153:0:10396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572179.181155:0:10396:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788572179.181157:0:10396:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788572179.181194:0:10396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.181201:0:10396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572179.181228:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.181236:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5800/0x265cfe11109bd0ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd0b5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.181250:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572179.181252:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572179.181253:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572179.181261:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572179.181279:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584264576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572179.181355:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572179.181415:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584264576 00000100:00100000:2.0:1788572179.181422:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584264576 00000100:00100000:2.0:1788572179.181475:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4639 00000100:00100000:2.0:1788572179.181518:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584264576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572179.181531:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572179.181545:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bd0b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd0ae expref: 24 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.181558:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572179.181595:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3644:x1875444584264576:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572179.181671:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4639 00000100:00100000:2.0:1788572179.181716:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584264576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572179.181845:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584264448:0@lo:39:umount.0 00000100:00100000:1.0:1788572179.181883:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572179.182031:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584264448 00000100:00100000:2.0:1788572179.182036:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584264448 00000100:00100000:2.0:1788572179.182090:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1788572179.182099:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584264448:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788572179.182129:0:188833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd1cd 00000100:00080000:2.0:1788572179.182150:0:188833:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f316800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1788572179.182236:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cd2a00 x1875444584264448/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:595/0 lens 224/224 e 0 to 0 dl 1788572190 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572179.182282:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875444584264448:12345-0@lo:39:umount.0 Request processed in 184us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572179.182288:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000020:00000080:2.0:1788572179.182295:0:188833:0:(genops.c:885:class_export_put()) final put ffff8e5a0f310000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788572179.182357:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019de000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788572179.182366:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584264448:0@lo:39:umount.0 00000020:00000080:2.0:1788572179.182391:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f310000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572179.182436:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f316800 for lustre-MDT0000 00000100:00080000:3.0:1788572179.182515:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572179.182519:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788572179.182524:0:191883:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788572179.183514:0:191883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.183533:0:191883:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.183540:0:191883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.183549:0:191883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.183578:0:191883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572179.183586:0:191883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.183592:0:191883:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.183719:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572179.183726:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.183733:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3000 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572179.183737:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.183745:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572179.183751:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572179.183757:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572179.183760:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788572179.183793:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.183799:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572179.183827:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.183834:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3000/0x265cfe11109bcfce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcfd5 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.183850:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572179.183852:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572179.183854:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572179.183863:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572179.183880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584264704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572179.183947:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572179.184006:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584264704 00000100:00100000:2.0:1788572179.184013:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584264704 00000100:00100000:2.0:1788572179.184074:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4640 00000100:00100000:2.0:1788572179.184084:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3643:x1875444584264704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572179.184097:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572179.184113:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd3e00/0x265cfe11109bcfd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bcfce expref: 23 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.184128:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572179.184167:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3643:x1875444584264704:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572179.184174:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4640 00000100:00100000:2.0:1788572179.184245:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584264704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572179.184454:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572179.184865:0:191883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.184874:0:191883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.184927:0:191883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572179.184937:0:191883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.184944:0:191883:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.184950:0:191883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.184956:0:191883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185010:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572179.185016:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185023:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:1.0:1788572179.185027:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185035:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572179.185052:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572179.185058:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788572179.185060:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788572179.185063:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788572179.185091:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185097:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572179.185130:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185137:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bd0d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd0d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185150:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572179.185153:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185158:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:1.0:1788572179.185160:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185167:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572179.185173:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572179.185178:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788572179.185180:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788572179.185192:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185198:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572179.185204:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185211:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572179.185212:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572179.185214:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572179.185260:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584264960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572179.185314:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572179.185360:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572179.185366:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584264832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572179.185389:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572179.185421:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584264960 00000100:00100000:0.0:1788572179.185426:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584264960 00000100:00100000:0.0:1788572179.185461:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584264832 00000100:00100000:0.0:1788572179.185464:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584264832 00000100:00100000:0.0:1788572179.185509:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4641 00000100:00100000:0.0:1788572179.185517:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3642:x1875444584264960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572179.185528:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572179.185541:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd0a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd099 expref: 23 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572179.185553:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572179.185586:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3642:x1875444584264960:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572179.185592:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4641 00000100:00100000:1.0:1788572179.185717:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4642 00000100:00100000:1.0:1788572179.185727:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3642:x1875444584264832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572179.185736:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572179.185745:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd2400/0x265cfe11109bd0d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd0d1 expref: 22 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572179.185755:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572179.185780:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3642:x1875444584264832:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572179.185786:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4642 00000100:00100000:0.0:1788572179.185854:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584264832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572179.185862:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584264960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572179.186006:0:191883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572179.186013:0:191883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0000/0x265cfe11109bd099 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd0a0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572179.186024:0:191883:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788572179.186032:0:191883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.186038:0:191883:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.186055:0:191883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.186061:0:191883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.186089:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572179.186096:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.186109:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031a00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572179.186112:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.186119:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572179.186126:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572179.186132:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572179.186134:0:10395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1788572179.186154:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.186160:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572179.186190:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.186199:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572179.186201:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572179.186203:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572179.186239:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572179.186251:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584265088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572179.186283:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572179.186355:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584265088 00000100:00100000:2.0:1788572179.186361:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584265088 00000100:00100000:2.0:1788572179.186404:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4643 00000100:00100000:2.0:1788572179.186411:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:3644:x1875444584265088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572179.186419:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572179.186428:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1e00/0x265cfe11109bcfc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bcfb9 expref: 20 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.186442:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572179.186472:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3644:x1875444584265088:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572179.186501:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4643 00000100:00100000:2.0:1788572179.186532:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584265088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572179.186772:0:191883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572179.186778:0:191883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a00031a00/0x265cfe11109bcfb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bcfc0 expref: -99 pid: 190493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572179.186793:0:191883:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1788572179.186796:0:191883:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788572179.186801:0:191883:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788572179.186844:0:191883:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788572179.186848:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788572179.186853:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788572179.186860:0:191883:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1788572179.187676:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1788572179.189159:0:191883:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1788572179.189450:0:191883:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788572179.189463:0:191883:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a0f312800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572179.189471:0:191883:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e59019df800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572179.189475:0:191883:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e59019df000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572179.189738:0:191883:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e590b8ca800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 326417519069 stale:0 00000020:00080000:3.0:1788572179.189746:0:191883:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e590b8c9800 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 192.168.202.57@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 335007449094 stale:0 00000020:00080000:3.0:1788572179.189751:0:191883:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8e5905f5b380) has exports, disconnecting them 00000020:00080000:3.0:1788572179.189757:0:191883:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a0f312800), last request at 1788572132 00000020:00000080:3.0:1788572179.189765:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd1c6 00000100:00080000:3.0:1788572179.189774:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f317000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572179.189799:0:191883:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a0f312800): rc 0 00000020:00000080:3.0:1788572179.189802:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a0f312800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788572179.189815:0:191883:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e59019df800), last request at 1788572178 00000020:00000080:3.0:1788572179.189818:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd1bf 00000100:00080000:3.0:1788572179.189823:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f314800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572179.189835:0:191883:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e59019df800): rc 0 00000020:00000080:3.0:1788572179.189837:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e59019df800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788572179.189841:0:191883:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e59019df000), last request at 1788572178 00000020:00000080:3.0:1788572179.189844:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd1b8 00000100:00080000:3.0:1788572179.189852:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e59019dc000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572179.189861:0:191883:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e59019df000): rc 0 00000020:00000080:3.0:1788572179.189863:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e59019df000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788572179.189867:0:191883:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e590b8ca800), last request at 1788572127 00000020:00000080:3.0:1788572179.189875:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd022 00000100:00080000:3.0:1788572179.189884:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f317800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572179.189930:0:191883:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e590b8ca800): rc 0 00000020:00000080:3.0:1788572179.189932:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e590b8ca800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1788572179.189937:0:191883:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.57@tcp (ffff8e590b8c9800), last request at 1788572177 00000020:00000080:3.0:1788572179.189940:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd01b 00000020:00010000:3.0:1788572179.189946:0:191883:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e590b8c9800: total 4 00000100:00080000:3.0:1788572179.189949:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e5a40dde800 : changing import state from FULL to CLOSED 00000004:00080000:3.0:1788572179.190025:0:191883:0:(mdd_object.c:3895:mdd_close()) Object [0x20001a9e3:0x203f:0x0] is retained in orphan list 00000020:00080000:3.0:1788572179.190033:0:191883:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e590b8c9800): rc 0 00000004:00000080:3.0:1788572179.190052:0:191883:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaac781743ae0 00000100:00080000:3.0:1788572179.190076:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788572179.190080:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837472 gen 3 00000020:00000080:2.0:1788572179.190728:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f312800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572179.190799:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59019df800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572179.190823:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59019df000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572179.190842:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b8ca800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572179.190875:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f317000 for lustre-MDT0000 00000020:00000080:2.0:1788572179.190881:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f314800 for lustre-MDT0000 00000020:00000080:2.0:1788572179.190884:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59019dc000 for lustre-MDT0000 00000020:00000080:2.0:1788572179.190888:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f317800 for lustre-MDT0000 00000020:00010000:2.0:1788572179.190905:0:10395:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e590b8c9800: total 0 00010000:00010000:2.0:1788572179.190978:0:10395:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e590b8c9800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788572179.191083:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bd404 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb22b expref: 5 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.191111:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4e00/0x265cfe11109bd213 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 4 pid: 190526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.191126:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bd21a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aecaa expref: 3 pid: 190526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.191151:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bd3f6 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x203d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb224 expref: 2 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572179.191169:0:10395:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e590b8c9800, canceled 4 locks, left on hash table 0. 00000100:00080000:3.0:1788572179.193088:0:191883:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788572179.193129:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e5902898800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788572179.193793:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584265216:0@lo:39:umount.0 00000100:00100000:0.0:1788572179.193889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572179.194537:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572179.194544:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572179.194724:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584265216 00000100:00100000:1.0:1788572179.194732:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584265216 00000100:00100000:1.0:1788572179.194978:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788572179.194989:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584265216:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572179.195171:0:189111:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd061 00000100:00080000:1.0:1788572179.195267:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e5a41266000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572179.195294:0:189111:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474837472 00000100:00100000:1.0:1788572179.195569:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1875444584265216:12345-0@lo:39:umount.0 Request processed in 580us (1678us total) trans 21474837473 rc 0/0 00000100:00100000:1.0:1788572179.195577:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:0.0:1788572179.195658:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572179.196650:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572179.196658:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572179.199634:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5902898800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572179.199662:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584265216:0@lo:39:umount.0 00000100:00080000:0.0:1788572179.202877:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788572179.202886:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738470 gen 3 00000004:00080000:0.0:1788572179.202905:0:191883:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788572179.202965:0:191883:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788572179.202994:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e5a41267000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788572179.203026:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788572179.203028:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975674 gen 3 00000004:00080000:0.0:1788572179.203037:0:191883:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788572179.203102:0:191883:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788572179.203112:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788572179.203153:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e5905f5b380) has no exports 00000100:00100000:1.0:1788572179.203270:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584265344:0@lo:9:umount.0 00000100:00100000:1.0:1788572179.203340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572179.203377:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584265472:0@lo:9:umount.0 00000100:00100000:1.0:1788572179.203399:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572179.203439:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584265344 00000100:00100000:1.0:1788572179.203446:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584265344 00000100:00100000:1.0:1788572179.203532:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584265472 00000100:00100000:1.0:1788572179.203535:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584265472 00000100:00100000:1.0:1788572179.203562:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22602 00000100:00100000:1.0:1788572179.203572:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584265344:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788572179.203674:0:43931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd07d 00000100:00080000:1.0:1788572179.203683:0:43931:0:(import.c:65:import_set_state_nolock()) ffff8e590bb64800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572179.203728:0:43931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738470 00000100:00100000:1.0:1788572179.203885:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3640:x1875444584265344:12345-0@lo:9:umount.0 Request processed in 313us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572179.203892:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22602 00000100:00100000:1.0:1788572179.203911:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22603 00000100:00100000:1.0:1788572179.203918:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584265472:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788572179.203931:0:43931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd0a7 00000100:00080000:1.0:1788572179.203937:0:43931:0:(import.c:65:import_set_state_nolock()) ffff8e590bb66000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572179.203960:0:43931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975674 00000100:00100000:1.0:1788572179.204034:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3640:x1875444584265472:12345-0@lo:9:umount.0 Request processed in 117us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572179.204051:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22603 00000100:00080000:1.0:1788572179.204075:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572179.204078:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572179.204091:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572179.204097:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572179.204127:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a41267000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788572179.204133:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788572179.204135:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572179.204138:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584265344:0@lo:9:umount.0 00000100:00080000:1.0:1788572179.204148:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788572179.204155:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788572179.204157:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572179.204159:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584265472:0@lo:9:umount.0 00000020:00080000:0.0:1788572179.212778:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e5905f5b380) has no exports 00000020:00000080:2.0:1788572179.225267:0:10395:0:(genops.c:885:class_export_put()) final put ffff8e590b8c9800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00010000:00010000:2.0:1788572179.225967:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572179.225972:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572179.225974:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788572179.228986:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b8c9800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d for lustre-MDT0000 00000020:00000080:1.0:1788572179.234779:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a40dde800 for lustre-MDT0000 00000020:00000080:0.0:1788572179.255093:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd037 00000020:00000080:0.0:1788572179.255112:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a08d26800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788572179.255186:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788572179.255197:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572179.255211:0:191883:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788572179.255216:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8e5a401499c0) has no exports 00000020:00000080:0.0:1788572179.255665:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd030 00000020:00000080:0.0:1788572179.255672:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5903351800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572179.255916:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a08d26800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788572179.256009:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903351800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572179.256086:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572179.256100:0:191883:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788572179.256103:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5902899800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788572179.256105:0:191883:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5902899800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788572179.256115:0:191883:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1788572179.256277:0:191883:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a369760c0 - data ffff8e5a08850000/ffff8e5904dc0800 00000020:01000000:0.0:1788572179.256429:0:191883:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e59059875a0 - data ffff8e5a08ab6af8/ffff8e5a40dacc00 00000100:00080000:3.0:1788572179.303959:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788572179.303969:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837472 gen 4 00000100:00100000:3.0:1788572179.303985:0:191883:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e5a1095c000 x1875444584265216/t21474837473(21474837473) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572189 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572179.304014:0:191883:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788572179.313555:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788572179.313566:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738470 gen 4 00000004:00080000:0.0:1788572179.313586:0:191883:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572179.313589:0:191883:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788572179.315246:0:190511:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788572179.315255:0:190511:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x138:0x0] index 2 count 1 00000040:00080000:1.0:1788572179.315268:0:190511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 78 count 2 00000100:00080000:0.0:1788572179.316359:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788572179.316366:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975674 gen 4 00000004:00080000:0.0:1788572179.316394:0:191883:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572179.316397:0:191883:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788572179.316941:0:190513:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788572179.316946:0:190513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13a:0x0] index 1 count 1 00000040:00080000:0.0:1788572179.316954:0:190513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 78 count 2 00000020:00000080:0.0:1788572179.319167:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bcff1 00000020:00000080:0.0:1788572179.319180:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a3191b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572179.320371:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd006 00000020:00000080:0.0:1788572179.320946:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a31918000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572179.321143:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3191b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788572179.321197:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788572179.321203:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572179.321214:0:191883:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788572179.321219:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8e5a413fcd40) has no exports 00000004:01000000:0.0:1788572179.321407:0:191883:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788572179.321416:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd084 00000020:00000080:0.0:1788572179.321422:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a071d2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788572179.321427:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788572179.321430:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572179.321439:0:191883:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788572179.321441:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8e5a4014b380) has no exports 00000020:00000080:0.0:1788572179.321446:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd076 00000020:00000080:0.0:1788572179.321449:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a071d0000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788572179.322122:0:191883:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788572179.322127:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788572179.322132:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975674 gen 5 00000004:00080000:0.0:1788572179.322140:0:191883:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572179.322143:0:191883:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788572179.322175:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572179.322186:0:191883:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572179.322192:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd068 00000020:00000080:0.0:1788572179.322197:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e590289d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788572179.322201:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788572179.322206:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572179.322210:0:191883:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788572179.322213:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8e5901bfb380) has no exports 00000020:00000080:0.0:1788572179.322217:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd05a 00000020:00000080:0.0:1788572179.322220:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a41260000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788572179.323047:0:191883:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788572179.323053:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788572179.323056:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738470 gen 5 00000004:00080000:0.0:1788572179.323061:0:191883:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572179.323063:0:191883:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788572179.323099:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572179.323109:0:191883:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788572179.323124:0:191883:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788572179.323131:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd04c 00000020:00000080:0.0:1788572179.323138:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5901977000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788572179.323142:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788572179.323147:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572179.323151:0:191883:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788572179.323154:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8e5a109f8000) has no exports 00000020:00000080:0.0:1788572179.323159:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd045 00000020:00000080:0.0:1788572179.323162:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e590289d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572179.323345:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a31918000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788572179.323952:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a071d2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788572179.323959:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a071d0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572179.323966:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a071d4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788572179.323975:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5903a24800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572179.323977:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a24800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788572179.323982:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572179.324094:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590289d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788572179.324101:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a41260000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572179.324104:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a41267000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788572179.324108:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5901971800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572179.324110:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5901971800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788572179.324116:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572179.324144:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5901977000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788572179.324151:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590289d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788572179.326635:0:191883:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788572179.326649:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788572179.326654:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474837472 gen 5 00000100:00100000:1.0:1788572179.326665:0:191883:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572179.326739:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572179.326754:0:191883:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572179.326790:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572179.326795:0:191883:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572179.326800:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e590bb60000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572179.326805:0:191883:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590bb60000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788572179.326814:0:191883:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572179.326929:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd00d 00000020:00000080:1.0:1788572179.326938:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a3191a800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788572179.326944:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788572179.326948:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572179.326955:0:191883:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572179.326959:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8e5a37203380) has no exports 00000020:00000080:1.0:1788572179.326989:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572179.326994:0:191883:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788572179.326998:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd014 00000020:00000080:1.0:1788572179.327002:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a3191a000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788572179.327010:0:191883:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e59059d0000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788572179.327013:0:191883:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e59059d0000 3 00000020:01000004:1.0:1788572179.327015:0:191883:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e59059d0000 from lustre-MDT0000 00000020:00000080:1.0:1788572179.327047:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572179.327051:0:191883:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788572179.327054:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5a3191c800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788572179.327056:0:191883:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3191c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788572179.327067:0:191883:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788572179.327101:0:191883:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788572179.327105:0:191883:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788572179.327109:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788572179.327112:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572179.327115:0:191883:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788572179.327124:0:191883:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e5a0f058800 712ceec8-7c82-4602-bd77-3db1811a6b63 192.168.202.57@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572179.327130:0:191883:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e5a0f02b000 e87131b0-4a60-4def-a26d-6e23dcfe5daa 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572179.327135:0:191883:0:(genops.c:1553:class_disconnect_exports()) OBD device 4 (ffff8e5a109f99c0) has exports, disconnecting them 00000020:00080000:1.0:1788572179.327139:0:191883:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.57@tcp (ffff8e5a0f058800), last request at 1788572131 00000020:00000080:1.0:1788572179.327165:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd195 00000020:00010000:1.0:1788572179.327170:0:191883:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a0f058800: total 2 00000100:00080000:1.0:1788572179.327174:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f059000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788572179.327187:0:191883:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e5a0f058800): rc 0 00000020:00080000:1.0:1788572179.327191:0:191883:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e5a0f02b000), last request at 1788572127 00000020:00000080:3.0:1788572179.327319:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5902898800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788572179.327328:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5901972000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572179.327330:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5901972000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788572179.327342:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572179.327433:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3191a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788572179.327438:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5a31918800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788572179.327439:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a31918800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788572179.327445:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788572179.327471:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3191a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572179.327698:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bcfb2 00000020:00010000:1.0:1788572179.327713:0:191883:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a0f02b000: total 0 00000100:00080000:1.0:1788572179.327717:0:191883:0:(import.c:65:import_set_state_nolock()) ffff8e5904e06800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788572179.327735:0:191883:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a0f02b000): rc 0 00000020:00080000:1.0:1788572179.327740:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8e5a109f99c0) has no exports 00000100:00100000:1.0:1788572179.327805:0:190503:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8e59068e5000:190503] 3 exiting: rc = 0 00000100:00100000:1.0:1788572179.327924:0:190499:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e5902039200:190499] 0 exiting: rc = 1 00000020:00010000:3.0:1788572179.328011:0:82817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a0f058800: total 0 00010000:00010000:3.0:1788572179.328052:0:82817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a0f058800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788572179.328089:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb4200/0x265cfe11109bd1aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb20f expref: 5 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328110:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5200/0x265cfe11109bd1b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb216 expref: 4 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328123:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5400/0x265cfe11109bd1a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb208 expref: 3 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328134:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1200/0x265cfe11109bd19c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb201 expref: 2 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328142:0:82817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a0f058800, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1788572179.328162:0:82817:0:(genops.c:885:class_export_put()) final put ffff8e5a0f058800/712ceec8-7c82-4602-bd77-3db1811a6b63 00000020:00010000:3.0:1788572179.328179:0:82817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a0f02b000: total 1 00010000:00010000:3.0:1788572179.328199:0:82817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a0f02b000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788572179.328216:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5c00/0x265cfe11109bd172 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd16b expref: 14 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328247:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe0c00/0x265cfe11109bd102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd0fb expref: 13 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328256:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb4c00/0x265cfe11109bd180 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd179 expref: 12 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328269:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a00030600/0x265cfe11109bd110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd109 expref: 11 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328284:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd2000/0x265cfe11109bd11e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd117 expref: 10 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328295:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a00031200/0x265cfe11109bd12c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd125 expref: 9 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328307:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe0200/0x265cfe11109bd18e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd187 expref: 8 pid: 190500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328316:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd148 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd141 expref: 7 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328328:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bd13a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd133 expref: 6 pid: 190500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328337:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a00030400/0x265cfe11109bd0f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd0ed expref: 5 pid: 190503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328347:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590a60dc00/0x265cfe11109bd156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd14f expref: 4 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328363:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe0400/0x265cfe11109bd0e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd0df expref: 3 pid: 190501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328372:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd2c00/0x265cfe11109bd164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd15d expref: 2 pid: 190499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572179.328383:0:82817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a0f02b000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788572179.328396:0:82817:0:(genops.c:885:class_export_put()) final put ffff8e5a0f02b000/e87131b0-4a60-4def-a26d-6e23dcfe5daa 00010000:00010000:3.0:1788572179.328403:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572179.328406:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572179.328408:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788572179.328687:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f058800/712ceec8-7c82-4602-bd77-3db1811a6b63 for MGS 00000020:00000080:1.0:1788572179.328737:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f02b000/e87131b0-4a60-4def-a26d-6e23dcfe5daa for MGS 00000020:00000080:1.0:1788572179.328754:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f059000 for MGS 00000020:00000080:1.0:1788572179.328759:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5904e06800 for MGS 00000100:00100000:2.0:1788572179.329101:0:190500:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e5a37290400:190500] 1 exiting: rc = 0 00000100:00100000:2.0:1788572179.329197:0:190501:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e5902039e00:190501] 2 exiting: rc = 0 00000100:00100000:1.0:1788572179.329951:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.329962:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.329968:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.329974:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.329979:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.329985:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.329992:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.329998:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330003:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330010:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330018:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330024:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330031:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330036:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330053:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330059:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330063:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330068:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330073:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330078:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330083:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330088:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330095:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330101:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330107:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330114:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330120:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330125:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330131:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330137:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330144:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330151:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330159:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330164:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330170:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330175:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330182:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330188:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330193:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330199:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330205:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330210:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330216:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330231:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330237:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330243:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330249:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330255:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330260:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330266:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330271:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330276:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330282:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330288:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330293:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330298:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330305:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330310:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330316:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330321:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330327:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330334:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330341:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572179.330347:0:191883:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788572179.332949:0:191883:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a36ca2d80 - data ffff8e5a089eaaf8/ffff8e5905d21c00 00000020:01000000:1.0:1788572179.333109:0:191883:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5904d0bd20 - data ffff8e5a089dcd80/ffff8e5a1243bc00 00000020:00000080:1.0:1788572179.333962:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bcfab 00000020:00000080:1.0:1788572179.333974:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5904e01800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788572179.334171:0:191883:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e59059d0000 from MGS, refs=2 00000020:01000004:1.0:1788572179.334177:0:191883:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e59059d0000 2 00000020:01000004:1.0:1788572179.334182:0:191883:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e59059d0000 from MGS 00000020:00000080:1.0:1788572179.334211:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572179.334233:0:191883:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788572179.334237:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5904e04800/MGS 00000020:00000080:1.0:1788572179.334241:0:191883:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e04800/MGS for MGS 00000020:01000000:1.0:1788572179.334251:0:191883:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788572179.334354:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788572179.334359:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572179.334374:0:191883:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788572179.334392:0:191883:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e590bb62800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572179.334400:0:191883:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8e5a37200000) has exports, disconnecting them 00000020:00080000:1.0:1788572179.334406:0:191883:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e590bb62800), last request at 1788572127 00000020:00000080:1.0:1788572179.334412:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd0c3 00000020:00080000:1.0:1788572179.334425:0:191883:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e590bb62800): rc 0 00000020:00000080:1.0:1788572179.334431:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e590bb62800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788572179.335077:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e01800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788572179.335501:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590bb62800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:00010000:3.0:1788572179.336877:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:0.0:1788572179.362364:0:191883:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788572179.362446:0:191883:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788572179.362454:0:191883:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788572179.362464:0:191883:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788572179.362947:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572179.362962:0:191883:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788572179.362972:0:191883:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e59059d0000 1 00000020:00000080:0.0:1788572179.362980:0:191883:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bcf9d 00000020:00000080:0.0:1788572179.362990:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e5904e06000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788572179.363550:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59019de000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788572179.363560:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5a3f8c6800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788572179.363564:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f8c6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788572179.363577:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1788572179.363939:0:191883:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788572179.364033:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572179.364050:0:191883:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788572179.364055:0:191883:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8e5905f5cd40) has no exports 00000020:00000080:3.0:1788572179.364316:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e06000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788572179.390359:0:191883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572179.390752:0:191883:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788572179.390760:0:191883:0:(genops.c:885:class_export_put()) final put ffff8e59022d7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788572179.390765:0:191883:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59022d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788572179.390774:0:191883:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788572179.390924:0:191883:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e5a372df800 00000020:02000400:3.0:1788572179.390995:0:191883:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788572179.901016:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572180.924706:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572181.373312:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572181.373345:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584265600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572181.373511:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572181.373746:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584265600 00000100:00100000:3.0:1788572181.373756:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584265600 00000100:00100000:3.0:1788572181.373816:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6233 00000100:00100000:3.0:1788572181.373826:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584265600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572181.373935:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572181.373999:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584265600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572181.374018:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6233 00000100:00080000:3.0:1788572181.374047:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572181.374095:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584265600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572181.374826:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584265728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572181.374881:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572181.374923:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584265728 00000100:00100000:2.0:1788572181.374928:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584265728 00000100:00100000:2.0:1788572181.374965:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6234 00000100:00100000:2.0:1788572181.374973:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584265728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572181.374994:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572181.375045:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584265728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572181.375052:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6234 00000100:00100000:2.0:1788572181.375087:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584265728:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572181.376987:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572181.949248:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572182.388444:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:0.0:1788572182.388580:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569471360 offset 0 length 224: 4 00000100:00100000:0.0:1788572182.388601:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572182.388648:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572182.388687:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572182.388718:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569471744 00000100:00100000:0.0:1788572182.388727:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569471744 00000100:00100000:0.0:1788572182.388818:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569471872 00000100:00100000:0.0:1788572182.388821:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569471872 00000100:00100000:0.0:1788572182.388845:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7613 00000100:00100000:0.0:1788572182.388855:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569471744:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572182.388922:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569471744:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 68us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572182.388929:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7613 00000100:00100000:0.0:1788572182.388959:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7614 00000100:00100000:0.0:1788572182.388965:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2400:x1875444569471872:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572182.389008:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2400:x1875444569471872:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 42us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572182.389015:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7614 00000100:00100000:2.0:1788572182.389135:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569471488 00000100:00100000:2.0:1788572182.389141:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569471488 00000100:00100000:2.0:1788572182.389185:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569471616 00000100:00100000:2.0:1788572182.389188:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569471616 00000100:00100000:2.0:1788572182.389225:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 167 00000100:00100000:2.0:1788572182.389234:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2400:x1875444569471616:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572182.389291:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2400:x1875444569471616:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 59us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572182.389298:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 167 00000100:00100000:2.0:1788572182.389312:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 944 00000100:00100000:2.0:1788572182.389317:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875444569471488:12345-192.168.202.57@tcp:400:kworker.0 00000020:00080000:2.0:1788572182.389324:0:188049:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.57@tcp 00000100:00100000:2.0:1788572182.389343:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875444569471488:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 24us (908us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572182.389349:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 944 00000100:00080000:3.0:1788572182.390366:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572182.390375:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572182.390377:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572182.397051:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572182.397168:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569472000 00000100:00100000:0.0:1788572182.397182:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569472000 00000100:00100000:0.0:1788572182.397244:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 945 00000100:00100000:0.0:1788572182.397253:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569472000:12345-192.168.202.57@tcp:38:ptlrpcd_01_00.0 00010000:00020000:0.0:1788572182.397287:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572182.397377:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569472000:12345-192.168.202.57@tcp:38:ptlrpcd_01_00.0 Request processed in 122us (336us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572182.397385:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 945 00000100:00100000:2.0:1788572182.909604:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572182.909634:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584265856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572182.909722:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572182.911090:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584265856 00000100:00100000:0.0:1788572182.911106:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584265856 00000100:00100000:0.0:1788572182.911195:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788572182.911205:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875444584265856:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788572182.911215:0:188054:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788572182.911307:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875444584265856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (1584us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788572182.911315:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:02020000:2.0:1788572182.911440:0:3641:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788572182.911446:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572182.911452:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572182.911456:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572182.911463:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572182.911468:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8885 00000100:00080000:2.0:1788572182.911474:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572182.911558:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffac000 x1875444584265984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572182.911686:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584265984:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788572182.911731:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572182.911824:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584265984 00000100:00100000:2.0:1788572182.911829:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584265984 00000100:00100000:2.0:1788572182.911857:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788572182.911862:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584265984:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788572182.911883:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572182.911922:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584265984:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 58us (191us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572182.911929:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:1.0:1788572182.912007:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572182.912011:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572182.912015:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584265984:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788572182.975068:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572183.939364:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572183.939373:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572183.939377:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572183.939385:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8935 00000100:00080000:1.0:1788572183.939391:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572183.939398:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572183.939422:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36947800 x1875444584266752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572183.939501:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584266496:0@lo:400:kworker.0 00000100:00100000:1.0:1788572183.939577:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572183.939689:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584267136:0@lo:400:kworker.0 00000100:00100000:2.0:1788572183.939695:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584266240:0@lo:400:kworker.0 00000100:00100000:1.0:1788572183.939715:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572183.939738:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572183.939747:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572183.939753:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584266368:0@lo:400:kworker.0 00000100:00100000:2.0:1788572183.939753:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584266880:0@lo:400:kworker.0 00000100:00100000:1.0:1788572183.939775:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572183.939776:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572183.939790:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584267008:0@lo:400:kworker.0 00000100:00100000:2.0:1788572183.939792:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572183.939796:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584266112:0@lo:400:kworker.0 00000100:00100000:1.0:1788572183.939809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:2.0:1788572183.939812:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584266112 offset 0 length 224: 4 00000100:00100000:2.0:1788572183.939831:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584266624:0@lo:400:kworker.0 00000100:00100000:2.0:1788572183.939853:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572183.939884:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584266496 00000100:00100000:2.0:1788572183.939889:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584267136 00000100:00100000:0.0:1788572183.939893:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584266496 00000100:00100000:2.0:1788572183.939893:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584267136 00000100:00100000:2.0:1788572183.939925:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584266240 00000100:00100000:2.0:1788572183.939927:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584266240 00000100:00100000:3.0:1788572183.940000:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584266880 00000100:00100000:3.0:1788572183.940004:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584266880 00000100:00100000:3.0:1788572183.940042:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584267008 00000100:00100000:3.0:1788572183.940045:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584267008 00000100:00100000:3.0:1788572183.940069:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7615 00000100:00100000:3.0:1788572183.940077:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584266880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572183.940132:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584266880:12345-0@lo:400:kworker.0 Request processed in 55us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572183.940139:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7615 00000100:00100000:3.0:1788572183.940155:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7616 00000100:00100000:3.0:1788572183.940161:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584267008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572183.940190:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584267008:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572183.940196:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7616 00000100:00080000:3.0:1788572183.940214:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572183.940218:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572183.940245:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584266880:0@lo:400:kworker.0 00000100:00100000:3.0:1788572183.940278:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584266368 00000100:00100000:3.0:1788572183.940281:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584266368 00000100:00100000:0.0:1788572183.944335:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584266624 00000100:00100000:0.0:1788572183.944353:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584266624 00000100:00100000:0.0:1788572183.944405:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788572183.944417:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584266624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572183.944545:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584266624:12345-0@lo:400:kworker.0 Request processed in 130us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572183.944553:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788572183.944574:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:1.0:1788572183.945847:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584267008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572183.945938:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584266624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572183.945997:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584266752:0@lo:38:kworker.0 00000100:00100000:1.0:1788572183.946060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572183.946178:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875444584267136:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788572183.946187:0:188049:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788572183.946233:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875444584267136:12345-0@lo:400:kworker.0 Request processed in 55us (6516us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572183.952743:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1788572183.952762:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875444584266496:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788572183.952776:0:188833:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572183.952900:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875444584266496:12345-0@lo:400:kworker.0 Request processed in 141us (13322us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572183.952909:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00080000:1.0:1788572183.952978:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572183.953053:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572183.953059:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572183.953064:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572183.953069:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572183.953075:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8885 00000100:00080000:1.0:1788572183.953084:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572183.953123:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36946300 x1875444584267264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572183.953155:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584266496:0@lo:400:kworker.0 00000100:00080000:1.0:1788572183.953173:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572183.953176:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572183.953179:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572183.953182:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572183.953185:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8885 00000100:00080000:1.0:1788572183.953189:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572183.953202:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36944e00 x1875444584267392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572183.953211:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584267136:0@lo:400:kworker.0 00000100:00100000:1.0:1788572183.953250:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584267264:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788572183.953288:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572183.953314:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584267392:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788572183.953445:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1788572183.953469:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584267264 00000100:00100000:0.0:1788572183.953475:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584267264 00000100:00100000:0.0:1788572183.953511:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:0.0:1788572183.953517:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584267264:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788572183.953775:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572183.953816:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584267264:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 297us (527us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572183.953823:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:0.0:1788572183.953884:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584266752 00000100:00100000:0.0:1788572183.953889:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584266752 00000100:00100000:0.0:1788572183.953918:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788572183.953923:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584266752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572183.953932:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572183.953960:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584266752:12345-0@lo:38:kworker.0 Request processed in 36us (7900us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572183.953979:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788572183.955333:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572183.955465:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572183.955473:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572183.955490:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584266752:0@lo:38:kworker.0 00000100:00080000:0.0:1788572183.955534:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572183.955539:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572183.955542:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584267264:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788572183.955561:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584267392 00000100:00100000:1.0:1788572183.955569:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584267392 00000100:00100000:0.0:1788572183.955626:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1788572183.955632:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584267392:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788572183.955651:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572183.955707:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584267392:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 74us (2371us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572183.955715:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00080000:1.0:1788572183.955724:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572183.955728:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572183.955731:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584267392:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788572183.961173:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1788572183.961185:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875444584266240:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788572183.961197:0:188050:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788572183.961312:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875444584266240:12345-0@lo:400:kworker.0 Request processed in 126us (21572us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572183.961321:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00080000:0.0:1788572183.964368:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788572183.964378:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788572183.964384:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788572183.964391:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572183.964396:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8885 00000100:00080000:0.0:1788572183.964407:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572183.964466:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905a50e00 x1875444584267520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572183.964548:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584266240:0@lo:400:kworker.0 00000100:00100000:1.0:1788572183.964679:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584267520:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788572183.964751:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572183.964863:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584267520 00000100:00100000:0.0:1788572183.964870:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584267520 00000100:00100000:0.0:1788572183.964921:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1788572183.964929:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584267520:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788572183.964950:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572183.964951:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788572183.964962:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584266368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572183.965009:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584267520:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 79us (258us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572183.965017:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1788572183.965020:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584266368:12345-0@lo:400:kworker.0 Request processed in 63us (25245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572183.965025:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1788572183.965110:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572183.965115:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572183.965119:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584267520:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788572183.972744:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584266368:0@lo:400:kworker.0 00010000:00010000:3.0:1788572183.997209:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788572184.962061:0:184840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572184.962075:0:184840:0:(genops.c:885:class_export_put()) final put ffff8e590bb67000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572184.962179:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590bb67000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788572184.962246:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590bb64800 for lustre-OST0000 00000001:00100000:0.0:1788572184.962427:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572184.962433:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e590bb63800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572184.962519:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590bb63800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788572184.962546:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590bb66000 for lustre-OST0001 00000001:00100000:3.0:1788572184.962834:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788572184.962845:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837473 is committed 00000020:00000080:3.0:1788572184.962849:0:188042:0:(genops.c:885:class_export_put()) final put ffff8e5a41262000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572184.963317:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a41262000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788572184.963362:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a41266000 for lustre-MDT0001 00010000:00010000:1.0:1788572185.024135:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572186.044667:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572186.492749:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584267648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572186.492849:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572186.492911:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584267776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572186.492973:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584267648 00000100:00100000:2.0:1788572186.492977:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572186.492982:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584267648 00000100:00080000:3.0:1788572186.496014:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572186.496164:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584267776 00000100:00100000:0.0:1788572186.496183:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584267776 00000100:00100000:0.0:1788572186.496279:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6235 00000100:00100000:0.0:1788572186.496294:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584267648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572186.496341:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572186.496708:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584267648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 418us (3858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572186.496716:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6235 00000100:00100000:0.0:1788572186.496733:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6236 00000100:00100000:0.0:1788572186.496740:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584267776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572186.496760:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00080000:3.0:1788572186.496777:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572186.496794:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584267776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (3815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572186.496801:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6236 00000100:00100000:3.0:1788572186.496867:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584267648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572186.496924:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584267776:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572187.068974:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572187.500033:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572187.500129:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569472256 00000100:00100000:0.0:1788572187.500140:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569472256 00000100:00100000:0.0:1788572187.500196:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 952 00000100:00100000:0.0:1788572187.500205:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569472256:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:0.0:1788572187.500230:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572187.500301:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569472256:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 95us (277us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572187.500309:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 952 00000400:00000100:3.0:1788572187.500397:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569472128 offset 0 length 224: 4 00000100:00100000:3.0:1788572187.500469:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572187.500540:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572187.500553:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569472512 00000100:00100000:0.0:1788572187.500559:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569472512 00000100:00100000:3.0:1788572187.500572:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572187.500605:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569472640 00000100:00100000:0.0:1788572187.500609:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569472640 00000100:00100000:3.0:1788572187.500620:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7617 00000100:00100000:3.0:1788572187.500631:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569472512:12345-192.168.202.57@tcp:400:kworker.0 00000100:00080000:1.0:1788572187.500669:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572187.500674:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572187.500676:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569472512:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 47us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572187.500722:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569472384 00000100:00100000:2.0:1788572187.500726:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569472384 00000100:00100000:2.0:1788572187.500762:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 170 00000100:00100000:2.0:1788572187.500771:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569472384:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572187.500801:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569472384:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572187.500807:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 170 00000100:00080000:1.0:1788572187.500951:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572187.504458:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7618 00000100:00100000:0.0:1788572187.504584:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569472640:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572187.504684:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569472640:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 113us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572187.504693:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7618 00000100:00100000:3.0:1788572187.505901:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7617 00010000:00010000:3.0:1788572188.092799:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572189.052901:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572189.052909:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572189.052913:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572189.052923:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8936 00000100:00080000:1.0:1788572189.052929:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572189.052937:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572189.052960:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36945c00 x1875444584268032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572189.052987:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572189.052990:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572189.052992:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572189.052996:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8936 00000100:00080000:1.0:1788572189.052998:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572189.053002:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572189.053012:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf4000 x1875444584268288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572189.053038:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572189.053041:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572189.053043:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572189.053046:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8936 00000100:00080000:1.0:1788572189.053049:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572189.053053:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572189.053064:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf5f80 x1875444584268544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572189.053084:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572189.053087:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572189.053089:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572189.053092:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8936 00000100:00080000:1.0:1788572189.053094:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572189.053097:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572189.053108:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf4a80 x1875444584268928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572189.053144:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584268672:0@lo:400:kworker.0 00000100:00100000:1.0:1788572189.053215:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572189.053279:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572189.053285:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584268416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572189.053312:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572189.053340:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584268672 00000100:00100000:1.0:1788572189.053346:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584268672 00000100:00100000:3.0:1788572189.053465:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584268160:0@lo:400:kworker.0 00000100:00100000:3.0:1788572189.053510:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572189.053535:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788572189.053540:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584267904:0@lo:400:kworker.0 00000400:00000100:3.0:1788572189.053556:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584267904 offset 0 length 224: 4 00000100:00100000:3.0:1788572189.053569:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584268800:0@lo:400:kworker.0 00000100:00100000:3.0:1788572189.053585:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572189.053607:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584268416 00000100:00100000:3.0:1788572189.053610:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584268416 00000100:00100000:3.0:1788572189.053659:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584268160 00000100:00100000:3.0:1788572189.053661:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584268160 00000100:00100000:3.0:1788572189.053684:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788572189.053692:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584268416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572189.053747:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584268416:12345-0@lo:400:kworker.0 Request processed in 55us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572189.053754:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788572189.053770:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788572189.053776:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584268160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572189.053803:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584268160:12345-0@lo:400:kworker.0 Request processed in 27us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572189.053809:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788572189.053823:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584268800 00000100:00100000:3.0:1788572189.053825:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584268800 00000100:00100000:3.0:1788572189.053849:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7619 00000100:00100000:3.0:1788572189.053854:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584268800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572189.053878:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584268800:12345-0@lo:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572189.053883:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7619 00000100:00080000:3.0:1788572189.053909:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572189.053914:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572189.053948:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584268416:0@lo:400:kworker.0 00000100:00100000:3.0:1788572189.053973:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584268800:0@lo:400:kworker.0 00000100:00100000:3.0:1788572189.053981:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584268160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572189.054118:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584268032:0@lo:38:kworker.0 00000100:00100000:0.0:1788572189.054151:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572189.054177:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584268288:0@lo:38:kworker.0 00000100:00100000:0.0:1788572189.054198:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572189.054221:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584268544:0@lo:38:kworker.0 00000100:00100000:0.0:1788572189.054243:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572189.054258:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584268928:0@lo:38:kworker.0 00000100:00100000:0.0:1788572189.054274:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572189.054298:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584268544 00000100:00100000:0.0:1788572189.054302:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584268544 00000100:00100000:0.0:1788572189.054324:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788572189.054328:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584268544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572189.054358:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572189.054393:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584268544:12345-0@lo:38:kworker.0 Request processed in 63us (148us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572189.054399:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00080000:0.0:1788572189.054437:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572189.054442:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572189.054445:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584268544:0@lo:38:kworker.0 00000100:00100000:0.0:1788572189.054460:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584268032 00000100:00100000:0.0:1788572189.054463:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584268032 00000100:00100000:0.0:1788572189.054476:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584268288 00000100:00100000:0.0:1788572189.054496:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584268288 00000100:00100000:0.0:1788572189.054505:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584268928 00000100:00100000:0.0:1788572189.054508:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584268928 00000100:00100000:0.0:1788572189.054517:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1788572189.054520:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584268032:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572189.054532:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572189.054561:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584268032:12345-0@lo:38:kworker.0 Request processed in 39us (409us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572189.054567:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1788572189.054579:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1788572189.054583:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584268288:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572189.054592:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572189.054614:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584268288:12345-0@lo:38:kworker.0 Request processed in 30us (415us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572189.054619:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1788572189.054631:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1788572189.054635:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584268928:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572189.054644:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572189.054665:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584268928:12345-0@lo:38:kworker.0 Request processed in 29us (390us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572189.054671:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00080000:0.0:1788572189.054694:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572189.054697:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572189.054700:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584268032:0@lo:38:kworker.0 00000100:00080000:0.0:1788572189.054708:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572189.054711:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572189.054713:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584268288:0@lo:38:kworker.0 00000100:00080000:0.0:1788572189.054720:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572189.054724:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572189.054726:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584268928:0@lo:38:kworker.0 00000100:00100000:1.0:1788572189.054964:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7620 00000100:00100000:1.0:1788572189.054972:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584268672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572189.055017:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584268672:12345-0@lo:400:kworker.0 Request processed in 46us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572189.055023:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7620 00000100:00080000:2.0:1788572189.055080:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572189.055161:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584268672:0@lo:400:kworker.0 00010000:00010000:3.0:1788572189.120798:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572190.141096:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572191.164664:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572191.612899:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584269056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572191.612997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572191.613207:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584269056 00000100:00100000:2.0:1788572191.613219:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584269056 00000100:00100000:0.0:1788572191.613303:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584269184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572191.613307:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6237 00000100:00100000:2.0:1788572191.613331:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584269056:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572191.613334:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572191.613390:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572191.613404:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584269184 00002000:00000024:2.0:1788572191.613500:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572191.613554:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584269056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 226us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572191.613562:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6237 00000100:00100000:2.0:1788572191.613619:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584269056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572191.613909:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584269184 00000100:00100000:3.0:1788572191.613961:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6238 00000100:00100000:3.0:1788572191.613967:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584269184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572191.613984:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00080000:2.0:1788572191.614040:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572191.621298:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584269184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7314us (7946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572191.621499:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6238 00000100:00100000:0.0:1788572191.625560:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584269184:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572192.190957:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572192.619583:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:3.0:1788572192.619630:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569472768 offset 0 length 224: 4 00000100:00100000:3.0:1788572192.619657:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572192.619683:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572192.619708:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572192.619749:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569473152 00000100:00100000:3.0:1788572192.619759:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569473152 00000100:00100000:1.0:1788572192.619774:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569473024 00000100:00100000:1.0:1788572192.619782:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569473024 00000100:00100000:3.0:1788572192.619824:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569473280 00000100:00100000:3.0:1788572192.619829:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569473280 00000100:00100000:1.0:1788572192.619831:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569472896 00000100:00100000:1.0:1788572192.619845:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569472896 00000100:00100000:1.0:1788572192.619880:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 173 00000100:00100000:3.0:1788572192.619885:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7621 00000100:00100000:1.0:1788572192.619896:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569473024:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572192.619900:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569473152:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572192.619971:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569473152:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 77us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572192.619978:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7621 00000100:00100000:3.0:1788572192.619997:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22604 00000100:00100000:3.0:1788572192.620003:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2396:x1875444569473280:12345-192.168.202.57@tcp:9:kworker.0 00000020:00000080:3.0:1788572192.620021:0:177561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd22f 00000100:00080000:3.0:1788572192.620043:0:177561:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f05e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572192.620087:0:177561:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975674 00000100:00080000:2.0:1788572192.620697:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572192.620703:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572192.620706:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572192.620725:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 956 00000100:00100000:2.0:1788572192.620733:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569472896:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572192.620753:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572192.623053:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569473024:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 3148us (3467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572192.623068:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 173 00010000:00010000:1.0:1788572192.625073:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572192.629353:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+2:2396:x1875444569473280:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 9338us (9632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572192.629368:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22604 00000100:00100000:2.0:1788572192.635604:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569472896:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 14855us (15904us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572192.635725:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 956 00010000:00010000:0.0:1788572193.212732:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572194.176194:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572194.176202:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572194.176205:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572194.176215:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8942 00000100:00080000:1.0:1788572194.176221:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572194.176229:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572194.176250:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf7100 x1875444584269440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572194.176276:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572194.176278:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572194.176280:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572194.176283:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8942 00000100:00080000:1.0:1788572194.176285:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572194.176289:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572194.176299:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf6d80 x1875444584269696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572194.176311:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572194.176313:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572194.176315:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572194.176317:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8942 00000100:00080000:1.0:1788572194.176319:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572194.176322:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572194.176331:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf4000 x1875444584269952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572194.176349:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572194.176352:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572194.176353:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572194.176356:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8942 00000100:00080000:1.0:1788572194.176358:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572194.176360:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572194.176367:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf4e00 x1875444584270336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572194.176395:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584270080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572194.176462:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572194.176531:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788572194.176537:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584269312:0@lo:400:kworker.0 00000400:00000100:1.0:1788572194.176555:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584269312 offset 0 length 224: 4 00000100:00100000:1.0:1788572194.176571:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584270208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572194.176589:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572194.176612:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584269440:0@lo:38:kworker.0 00000100:00100000:1.0:1788572194.176635:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572194.176649:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584269696:0@lo:38:kworker.0 00000100:00100000:1.0:1788572194.176665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572194.176678:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584269952:0@lo:38:kworker.0 00000100:00100000:1.0:1788572194.176697:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572194.176711:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584270336:0@lo:38:kworker.0 00000100:00100000:1.0:1788572194.176728:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572194.176761:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584270080 00000100:00100000:1.0:1788572194.176768:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584270080 00000100:00100000:1.0:1788572194.176825:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584270208 00000100:00100000:1.0:1788572194.176828:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584270208 00000100:00100000:1.0:1788572194.176849:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7622 00000100:00100000:1.0:1788572194.176857:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584270080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572194.176907:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584270080:12345-0@lo:400:kworker.0 Request processed in 51us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572194.176914:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7622 00000100:00100000:1.0:1788572194.176932:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7623 00000100:00100000:1.0:1788572194.176938:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584270208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572194.176968:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584270208:12345-0@lo:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572194.176974:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7623 00000100:00100000:1.0:1788572194.176993:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584269440 00000100:00100000:1.0:1788572194.176997:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584269440 00000100:00100000:1.0:1788572194.177012:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584269696 00000100:00100000:1.0:1788572194.177015:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584269696 00000100:00100000:1.0:1788572194.177020:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584270336 00000100:00100000:1.0:1788572194.177022:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584270336 00000100:00100000:1.0:1788572194.177029:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:1.0:1788572194.177035:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584269440:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572194.177055:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572194.177087:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584269440:12345-0@lo:38:kworker.0 Request processed in 51us (451us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572194.177092:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:1.0:1788572194.177102:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:1.0:1788572194.177106:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584269696:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572194.177114:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572194.177135:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584269696:12345-0@lo:38:kworker.0 Request processed in 28us (469us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572194.177139:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:1.0:1788572194.177148:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1788572194.177151:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584270336:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572194.177158:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572194.177176:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584270336:12345-0@lo:38:kworker.0 Request processed in 24us (447us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572194.177181:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1788572194.177198:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584269952 00000100:00100000:1.0:1788572194.177201:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584269952 00000100:00100000:1.0:1788572194.177219:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788572194.177223:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584269952:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572194.177231:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572194.177252:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584269952:12345-0@lo:38:kworker.0 Request processed in 28us (554us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572194.177257:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00080000:1.0:1788572194.177304:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572194.177309:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572194.177312:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584269440:0@lo:38:kworker.0 00000100:00080000:1.0:1788572194.177320:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572194.177323:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572194.177326:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584269696:0@lo:38:kworker.0 00000100:00080000:1.0:1788572194.177333:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572194.177336:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572194.177339:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584269952:0@lo:38:kworker.0 00000100:00080000:1.0:1788572194.177345:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572194.177348:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572194.177350:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584270336:0@lo:38:kworker.0 00000100:00100000:1.0:1788572194.177401:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584270208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572194.177412:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584270080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572194.178007:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584269568:0@lo:400:kworker.0 00000100:00100000:2.0:1788572194.178050:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572194.178072:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572194.178077:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584269824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572194.178096:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572194.178140:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572194.178145:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572194.178154:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584269568 00000100:00100000:2.0:1788572194.178159:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584269568 00000100:00100000:2.0:1788572194.178193:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584269824 00000100:00100000:2.0:1788572194.178195:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584269824 00000100:00100000:2.0:1788572194.178209:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788572194.178215:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584269568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572194.178254:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584269568:12345-0@lo:400:kworker.0 Request processed in 40us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572194.178260:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788572194.178272:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788572194.178277:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584269824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572194.178297:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584269824:12345-0@lo:400:kworker.0 Request processed in 21us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572194.178303:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1788572194.178315:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572194.178331:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584269824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572194.178340:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584269568:0@lo:400:kworker.0 00010000:00010000:2.0:1788572194.240263:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572195.260584:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572196.294183:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572196.732797:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584270464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572196.732897:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572196.733210:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584270464 00000100:00100000:2.0:1788572196.733232:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584270464 00000100:00100000:2.0:1788572196.733300:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6239 00000100:00100000:2.0:1788572196.733310:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584270464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572196.733340:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00080000:0.0:1788572196.733574:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572196.733640:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584270464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572196.733712:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584270464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 403us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572196.733720:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6239 00000100:00100000:0.0:1788572196.733977:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572196.733988:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584270592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572196.734026:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572196.734171:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584270592 00000100:00100000:1.0:1788572196.734177:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584270592 00000100:00100000:1.0:1788572196.734307:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6240 00000100:00100000:1.0:1788572196.734318:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584270592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572196.734342:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572196.734471:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584270592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572196.734511:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6240 00000100:00100000:1.0:1788572196.734564:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584270592:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572196.736081:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572197.309631:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788572197.745048:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569473408 offset 0 length 224: 4 00000100:00100000:1.0:1788572197.745094:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572197.745198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572197.745671:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569473664 00000100:00100000:2.0:1788572197.745683:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569473664 00000100:00100000:2.0:1788572197.745772:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 176 00000100:00100000:2.0:1788572197.745783:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569473664:12345-192.168.202.57@tcp:400:kworker.0 00000100:00080000:1.0:1788572197.745843:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572197.745875:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569473664:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 93us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572197.745882:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 176 00000100:00100000:1.0:1788572197.746080:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572197.746245:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569473536 00000100:00100000:2.0:1788572197.746249:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569473536 00000100:00100000:2.0:1788572197.746282:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 960 00000100:00100000:2.0:1788572197.746287:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569473536:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572197.746319:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572197.746377:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569473536:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 88us (298us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572197.746384:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 960 00000100:00100000:0.0:1788572197.748255:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569473792 00000100:00100000:0.0:1788572197.748270:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569473792 00000100:00100000:0.0:1788572197.748506:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7624 00000100:00100000:0.0:1788572197.748518:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569473792:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572197.748615:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569473792:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 100us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572197.748623:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7624 00000100:00080000:1.0:1788572197.748691:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788572197.761061:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:1.0:1788572197.761074:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5a0f05d800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:0.0:1788572197.761177:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f05d800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d for lustre-OST0001 00000020:00000080:0.0:1788572197.761247:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f05e000 for lustre-OST0001 00010000:00010000:2.0:1788572198.333641:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572198.763614:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:3.0:1788572198.763648:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569473920 offset 0 length 520: 4 00000100:00100000:3.0:1788572198.763672:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572198.763714:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569474176 00000100:00100000:3.0:1788572198.763714:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569474048 00000100:00100000:1.0:1788572198.763723:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569474176 00000100:00100000:3.0:1788572198.763723:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569474048 00000100:00100000:3.0:1788572198.763775:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 177 00000100:00100000:3.0:1788572198.763792:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569474176:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572198.763830:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 961 00000100:00100000:1.0:1788572198.763836:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569474048:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:1.0:1788572198.763855:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572198.763859:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569474176:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572198.763866:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 177 00000100:00100000:1.0:1788572198.763878:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569474048:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 42us (206us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572198.763884:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 961 00000100:00100000:3.0:1788572198.768570:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572198.768628:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569474304 00000100:00100000:0.0:1788572198.768639:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569474304 00000100:00100000:0.0:1788572198.768701:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7625 00000100:00100000:0.0:1788572198.768712:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569474304:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572198.768807:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569474304:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572198.768815:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7625 00000100:00000400:1.0:1788572199.229907:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572183/real 1788572183] req@ffff8e5a31cd3100 x1875444584266112/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572199 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572199.229938:0:3644:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8e5a31cd3100 x1875444584266112/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572199 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572199.229947:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788572199.229951:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788572199.229955:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.157@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788572199.229957:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788572199.229961:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a31cd3100 x1875444584266112/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572199 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572199.229969:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a36947800 x1875444584267904/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572205 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572199.229987:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a1fdf7480 x1875444584269312/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572210 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788572199.230007:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788572199.230010:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788572199.230012:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788572199.230015:0:3644:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788572199.230050:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584266112:0@lo:400:kworker.0 00000100:00080000:1.0:1788572199.230094:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572199.230099:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788572199.230101:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572199.230106:0:177620:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 8880 00000100:00080000:1.0:1788572199.230117:0:177620:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572199.230147:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf4a80 x1875444584270720/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572199.230170:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572199.230173:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572199.230175:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572199.230178:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8947 00000100:00080000:1.0:1788572199.230182:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572199.230185:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572199.230197:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf5f80 x1875444584270848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572199.230214:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572199.230217:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572199.230218:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572199.230221:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8947 00000100:00080000:1.0:1788572199.230223:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572199.230226:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572199.230234:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf4e00 x1875444584271104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572199.230247:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572199.230250:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572199.230252:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572199.230255:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8947 00000100:00080000:1.0:1788572199.230257:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572199.230259:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572199.230267:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf6d80 x1875444584271360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572199.230290:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572199.230292:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572199.230294:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572199.230297:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8947 00000100:00080000:1.0:1788572199.230299:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572199.230302:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572199.230314:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590542fb80 x1875444584271744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572199.230339:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584270720:0@lo:250:kworker.0 00000400:00000100:1.0:1788572199.230394:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584270720 offset 0 length 520: 4 00000100:00100000:1.0:1788572199.230444:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584270848:0@lo:38:kworker.0 00000100:00100000:1.0:1788572199.230501:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572199.230523:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584271104:0@lo:38:kworker.0 00000100:00100000:1.0:1788572199.230546:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572199.230587:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584271360:0@lo:38:kworker.0 00000100:00100000:1.0:1788572199.230630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572199.230653:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584271744:0@lo:38:kworker.0 00000100:00100000:1.0:1788572199.230676:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572199.230729:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584271488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.230771:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572199.230797:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572199.230803:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584271616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.230841:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572199.230874:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584271360 00000100:00100000:1.0:1788572199.230882:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584271360 00000100:00100000:1.0:1788572199.230918:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788572199.230926:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584271360:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572199.230948:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572199.230993:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584271360:12345-0@lo:38:kworker.0 Request processed in 67us (362us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572199.231001:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788572199.231026:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584270848 00000100:00100000:1.0:1788572199.231030:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584270848 00000100:00100000:1.0:1788572199.231051:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584271104 00000100:00100000:1.0:1788572199.231053:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584271104 00000100:00100000:1.0:1788572199.231063:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584271744 00000100:00100000:1.0:1788572199.231065:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584271744 00000100:00100000:1.0:1788572199.231076:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1788572199.231082:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584270848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572199.231093:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572199.231122:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584270848:12345-0@lo:38:kworker.0 Request processed in 39us (646us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572199.231130:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1788572199.231142:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1788572199.231147:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584271104:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572199.231155:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572199.231180:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584271104:12345-0@lo:38:kworker.0 Request processed in 32us (633us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572199.231187:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1788572199.231198:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1788572199.231203:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584271744:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572199.231212:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572199.231236:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584271744:12345-0@lo:38:kworker.0 Request processed in 31us (559us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572199.231242:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1788572199.231263:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584271488 00000100:00100000:1.0:1788572199.231266:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584271488 00000100:00100000:1.0:1788572199.231309:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584271616 00000100:00100000:1.0:1788572199.231313:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584271616 00000100:00100000:1.0:1788572199.231331:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7626 00000100:00100000:1.0:1788572199.231337:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584271488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.231389:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584271488:12345-0@lo:400:kworker.0 Request processed in 52us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572199.231396:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7626 00000100:00100000:1.0:1788572199.231408:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7627 00000100:00100000:1.0:1788572199.231415:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584271616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.231448:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584271616:12345-0@lo:400:kworker.0 Request processed in 34us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572199.231454:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7627 00000100:00080000:1.0:1788572199.231511:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572199.231516:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572199.231529:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584271232:0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.231561:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572199.231586:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572199.231594:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584270976:0@lo:400:kworker.0 00000100:00100000:3.0:1788572199.231610:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584269312:0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.231620:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572199.231652:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584271232 00000100:00100000:1.0:1788572199.231653:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584270976 00000100:00100000:3.0:1788572199.231658:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584271232 00000100:00100000:1.0:1788572199.231659:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584270976 00000100:00100000:3.0:1788572199.231701:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788572199.231712:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584271232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572199.231768:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584271232:12345-0@lo:400:kworker.0 Request processed in 60us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572199.231775:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788572199.232264:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584267904:0@lo:400:kworker.0 00000100:00100000:2.0:1788572199.232594:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584271232:0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.232880:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788572199.232890:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584270976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.232952:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584270976:12345-0@lo:400:kworker.0 Request processed in 65us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572199.232959:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788572199.232994:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584271616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.233010:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584271488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572199.233035:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584270976:0@lo:400:kworker.0 00000100:00080000:1.0:1788572199.233065:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572199.233070:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572199.233073:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584270848:0@lo:38:kworker.0 00000100:00080000:1.0:1788572199.233083:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572199.233086:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572199.233089:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584271104:0@lo:38:kworker.0 00000100:00080000:1.0:1788572199.233099:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572199.233102:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572199.233105:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584271360:0@lo:38:kworker.0 00000100:00080000:1.0:1788572199.233115:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572199.233118:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572199.233121:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584271744:0@lo:38:kworker.0 00000100:00080000:3.0:1788572199.243052:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788572199.359921:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572200.382688:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572201.405544:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572201.853729:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584271872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572201.853899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572201.854049:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584271872 00000100:00100000:1.0:1788572201.854057:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584271872 00000100:00100000:1.0:1788572201.854121:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6241 00000100:00100000:1.0:1788572201.854131:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584271872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572201.854163:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572201.854215:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584271872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572201.854223:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6241 00000100:00100000:1.0:1788572201.854287:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584271872:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572201.854457:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572201.858657:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584272000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572201.858808:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572201.858908:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584272000 00000100:00100000:1.0:1788572201.858917:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584272000 00000100:00100000:1.0:1788572201.858988:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6242 00000100:00100000:1.0:1788572201.858999:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584272000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572201.859034:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00080000:0.0:1788572201.860805:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572201.865032:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584272000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6021us (6210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572201.865049:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6242 00000100:00100000:2.0:1788572201.866588:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584272000:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572202.437585:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788572202.732379:0:192501:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788572202.732385:0:192501:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788572202.732387:0:192501:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788572202.732581:0:192501:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e5a3f8c3000 00000020:01000004:0.0:1788572202.732599:0:192501:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788572202.732614:0:192501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788572202.732628:0:192501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e5a413f8000) 00000020:00000080:0.0:1788572202.732647:0:192501:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788572202.806704:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788572202.808443:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788572202.816433:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.816673:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.816884:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.817154:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.817349:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.817650:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.818095:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.818427:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.818708:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.818938:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.819174:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.819406:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.819665:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.819933:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.820182:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.820425:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.820763:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.821022:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.821307:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.821572:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788572202.821830:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.822121:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788572202.822369:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788572202.822763:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788572202.823112:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788572202.823336:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788572202.823552:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788572202.823771:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788572202.824107:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788572202.824350:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788572202.824578:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788572202.824822:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788572202.825377:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.825815:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788572202.826301:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788572202.826614:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.826890:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788572202.827186:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788572202.827472:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.827777:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.827989:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788572202.828196:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788572202.828447:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.828808:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.829843:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.830749:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.831393:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.831620:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.832128:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.832344:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788572202.832621:0:192501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1788572202.833250:0:192501:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788572202.833540:0:192501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788572202.833558:0:192501:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788572202.833572:0:192501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd4e4 00000020:01000004:3.0:1788572202.833579:0:192501:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788572202.833592:0:192501:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788572202.833598:0:192501:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a3f8c3000 from MGS 00000020:01000004:3.0:1788572202.833601:0:192501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788572202.833611:0:192501:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e5901bf99c0) 00000020:00000080:3.0:1788572202.833623:0:192501:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1788572202.833699:0:192501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a3f8c3000 from MGS, refs=2 00080000:01000000:3.0:1788572202.833705:0:192501:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788572202.833711:0:192501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd4f2 00010000:00010000:3.0:1788572202.833887:0:192501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788572202.838512:0:192501:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788572202.843288:0:192505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788572202.844194:0:192501:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788572202.844434:0:192501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788572202.846732:0:192501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788572202.847046:0:192501:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788572202.847231:0:192501:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788572202.847250:0:192501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788572202.852754:0:192501:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788572202.852767:0:192501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788572202.853223:0:192501:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788572202.853230:0:192501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788572202.853982:0:192501:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788572202.854007:0:192501:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788572202.854009:0:192501:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.157@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788572202.854013:0:192501:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.157@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1788572202.854019:0:192501:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 256, was 0): CONNECTING 00000100:00100000:3.0:1788572202.854025:0:192501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:2.0:1788572203.452784:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572203.886259:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572203.886344:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572203.886423:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569474688 00000100:00100000:2.0:1788572203.886447:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569474688 00000100:00100000:1.0:1788572203.886500:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569474560 00000100:00100000:1.0:1788572203.886504:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569474560 00000100:00100000:1.0:1788572203.886543:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 180 00000100:00100000:2.0:1788572203.886543:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7628 00000100:00100000:1.0:1788572203.886553:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569474560:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572203.886553:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569474688:12345-192.168.202.57@tcp:400:kworker.0 00000100:00080000:0.0:1788572203.886638:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572203.886644:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572203.886709:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569474560:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 158us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572203.886718:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 180 00000100:00100000:2.0:1788572203.893424:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569474688:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 6857us (7064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572203.893454:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7628 00000100:00100000:3.0:1788572203.907563:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572203.907674:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569474432 00000100:00100000:1.0:1788572203.907688:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569474432 00000100:00100000:1.0:1788572203.907756:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 965 00000100:00100000:1.0:1788572203.907765:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569474432:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:1.0:1788572203.907795:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572203.907892:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569474432:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 126us (346us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572203.907901:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 965 00000100:00080000:3.0:1788572204.412640:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572204.412664:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788572204.412667:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572204.412671:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572204.412676:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572204.412685:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8952 00000100:00080000:3.0:1788572204.412691:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572204.412699:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572204.412756:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fea5500 x1875444584272128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572204.413024:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572204.413027:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584272128:0@lo:38:kworker.0 00000100:00100000:1.0:1788572204.413217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572204.413465:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584272128 00000100:00100000:2.0:1788572204.413476:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584272128 00000100:00100000:2.0:1788572204.413557:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1788572204.413566:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584272128:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572204.413596:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572204.413663:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584272128:12345-0@lo:38:kworker.0 Request processed in 86us (436us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572204.413672:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00080000:1.0:1788572204.413768:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572204.413774:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572204.413777:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584272128:0@lo:38:kworker.0 00000100:00080000:3.0:1788572204.415762:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572204.415774:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572204.415778:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572204.415788:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8952 00000100:00080000:3.0:1788572204.415794:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572204.415801:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572204.415853:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fea5500 x1875444584272384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572204.416008:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584272384:0@lo:38:kworker.0 00000100:00100000:1.0:1788572204.416098:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572204.416163:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584272384 00000100:00100000:1.0:1788572204.416171:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584272384 00000100:00100000:1.0:1788572204.416206:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1788572204.416214:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584272384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572204.416235:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572204.416278:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584272384:12345-0@lo:38:kworker.0 Request processed in 63us (180us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572204.416284:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00080000:1.0:1788572204.416324:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572204.416329:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572204.416332:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584272384:0@lo:38:kworker.0 00000100:00100000:2.0:1788572204.417506:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788572204.417559:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572204.417565:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572204.417568:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572204.417575:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8952 00000100:00080000:3.0:1788572204.417581:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572204.417589:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572204.417627:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fea5500 x1875444584272640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572204.417696:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572204.417700:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572204.417701:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572204.417705:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8952 00000100:00080000:3.0:1788572204.417708:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572204.417711:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572204.417722:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf5f80 x1875444584273024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572204.417773:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584272768:0@lo:400:kworker.0 00000100:00100000:3.0:1788572204.417842:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572204.417891:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572204.417897:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584272896:0@lo:400:kworker.0 00000100:00100000:3.0:1788572204.417920:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572204.417959:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584272768 00000100:00100000:3.0:1788572204.417968:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584272768 00000100:00100000:3.0:1788572204.418033:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584272896 00000100:00100000:3.0:1788572204.418036:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584272896 00000100:00100000:3.0:1788572204.418062:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7629 00000100:00100000:3.0:1788572204.418071:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584272768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572204.418130:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584272768:12345-0@lo:400:kworker.0 Request processed in 60us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572204.418136:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7629 00000100:00100000:3.0:1788572204.418153:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7630 00000100:00100000:3.0:1788572204.418159:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584272896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572204.418188:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584272896:12345-0@lo:400:kworker.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572204.418194:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7630 00000100:00100000:1.0:1788572204.418341:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584272640:0@lo:38:kworker.0 00000100:00100000:1.0:1788572204.418374:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572204.418400:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584273024:0@lo:38:kworker.0 00000100:00100000:1.0:1788572204.418429:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572204.418466:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584272640 00000100:00100000:1.0:1788572204.418470:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584272640 00000100:00100000:1.0:1788572204.418514:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788572204.418520:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584272640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572204.418544:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572204.418577:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584272640:12345-0@lo:38:kworker.0 Request processed in 56us (202us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572204.418583:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1788572204.418619:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572204.418624:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572204.418628:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584272640:0@lo:38:kworker.0 00000100:00100000:1.0:1788572204.418702:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584273024 00000100:00100000:1.0:1788572204.418707:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584273024 00000100:00100000:1.0:1788572204.418729:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1788572204.418735:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584273024:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572204.418746:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572204.418777:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584273024:12345-0@lo:38:kworker.0 Request processed in 41us (348us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572204.418784:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00080000:1.0:1788572204.418810:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572204.418814:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572204.418817:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584273024:0@lo:38:kworker.0 00000100:00100000:1.0:1788572204.418858:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584272896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572204.418870:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584272768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572204.419255:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584272256:0@lo:400:kworker.0 00000100:00100000:0.0:1788572204.419305:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572204.419584:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572204.419589:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572204.421598:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584272256 00000100:00100000:1.0:1788572204.421613:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584272256 00000100:00100000:1.0:1788572204.421718:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788572204.421734:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584272256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572204.421870:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584272256:12345-0@lo:400:kworker.0 Request processed in 141us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572204.421878:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788572204.422291:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584272256:0@lo:400:kworker.0 00000100:00080000:3.0:1788572204.424795:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572204.425720:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584272512:0@lo:400:kworker.0 00000100:00100000:2.0:1788572204.426133:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572204.426427:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584272512 00000100:00100000:1.0:1788572204.426435:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584272512 00000100:00080000:3.0:1788572204.426504:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572204.426542:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788572204.426551:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584272512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572204.426614:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584272512:12345-0@lo:400:kworker.0 Request processed in 64us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572204.426623:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788572204.427074:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584272512:0@lo:400:kworker.0 00010000:00010000:2.0:1788572204.476864:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572205.500698:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572206.525420:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572206.974321:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584273152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572206.974426:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572206.974760:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584273152 00000100:00100000:1.0:1788572206.974770:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584273152 00000100:00080000:3.0:1788572206.974893:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572206.975007:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6243 00000100:00100000:1.0:1788572206.975017:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584273152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572206.975048:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572206.976085:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584273152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1064us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572206.976096:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6243 00000100:00100000:2.0:1788572206.976505:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584273280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572206.976594:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572206.977468:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584273280 00000100:00100000:1.0:1788572206.977511:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584273280 00000100:00100000:1.0:1788572206.977589:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6244 00000100:00100000:1.0:1788572206.977599:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584273280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572206.977650:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00080000:2.0:1788572206.977684:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572206.977741:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584273280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572206.977750:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6244 00000100:00100000:2.0:1788572206.977812:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584273280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572206.988434:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584273152:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572207.550005:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572208.572838:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572209.005941:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572209.006080:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569474816 00000100:00100000:2.0:1788572209.006096:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569474816 00000100:00100000:2.0:1788572209.006229:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 0 00000100:00100000:2.0:1788572209.006241:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2396:x1875444569474816:12345-192.168.202.57@tcp:250:kworker.0 00010000:00080000:2.0:1788572209.006287:0:192507:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 712ceec8-7c82-4602-bd77-3db1811a6b63@192.168.202.57@tcp t0 exp 0000000000000000 cur 8961 last 0 00000020:00000080:2.0:1788572209.006334:0:192507:0:(genops.c:1385:class_connect()) connect: client 712ceec8-7c82-4602-bd77-3db1811a6b63, cookie 0x265cfe11109bd4f9 00000100:00080000:2.0:1788572209.006635:0:192507:0:(import.c:65:import_set_state_nolock()) ffff8e5903351800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572209.006746:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+5:2396:x1875444569474816:12345-192.168.202.57@tcp:250:kworker.0 Request processed in 504us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.006755:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 0 00000100:00100000:3.0:1788572209.008322:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572209.008724:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569474944 00000100:00100000:1.0:1788572209.008739:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569474944 00000100:00100000:0.0:1788572209.009176:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 969 00000100:00100000:0.0:1788572209.009190:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569474944:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:0.0:1788572209.009222:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572209.009317:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569474944:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 127us (1007us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572209.009325:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 969 00000100:00100000:3.0:1788572209.011280:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572209.011376:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572209.012752:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569475200 00000100:00100000:0.0:1788572209.012774:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569475200 00000100:00100000:0.0:1788572209.012907:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7631 00000100:00100000:0.0:1788572209.012922:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569475200:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572209.013053:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569475200:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 133us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572209.013061:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7631 00000100:00080000:2.0:1788572209.013899:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572209.014273:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569475072 00000100:00100000:1.0:1788572209.014285:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569475072 00000100:00100000:1.0:1788572209.014415:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 183 00000100:00100000:1.0:1788572209.014426:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569475072:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572209.014540:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569475072:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 115us (3272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572209.014548:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 183 00000100:00080000:2.0:1788572209.015198:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572209.532616:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572209.532629:0:105698:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788572209.532631:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572199/real 1788572199] req@ffff8e5a1fdf4a80 x1875444584270720/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572209.532633:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572209.532637:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572209.532642:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572209.532650:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8957 00000100:00080000:3.0:1788572209.532655:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572209.532664:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572209.532684:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e5a1fdf4a80 x1875444584270720/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572209.532707:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788572209.532722:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf4e00 x1875444584273408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572209.532730:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788572209.532749:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584270720:0@lo:250:kworker.0 00000100:00080000:3.0:1788572209.532779:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1788572209.532781:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584273408:0@lo:38:kworker.0 00000100:00080000:3.0:1788572209.532783:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572209.532785:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572209.532788:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8957 00000100:00080000:3.0:1788572209.532791:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572209.532795:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572209.532808:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf4a80 x1875444584273664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572209.532828:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572209.532831:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572209.532832:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572209.532835:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8957 00000100:00080000:3.0:1788572209.532839:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572209.532842:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572209.532855:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eac000 x1875444584273920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572209.532886:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572209.532890:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572209.532892:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572209.532896:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8957 00000100:00080000:3.0:1788572209.532898:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572209.532902:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572209.532913:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eaf480 x1875444584274304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572209.532928:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572209.532932:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788572209.532935:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572209.532938:0:105698:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 8952 00000100:00080000:3.0:1788572209.532941:0:105698:0:(import.c:630:import_select_connection()) MGC192.168.202.157@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572209.532945:0:105698:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572209.532957:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eadc00 x1875444584274432/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1788572209.532995:0:192501:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:3.0:1788572209.532999:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584273792:0@lo:400:kworker.0 00000100:00100000:1.0:1788572209.533016:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572209.533021:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd180 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533036:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd180 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533047:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788572209.533087:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:0.0:1788572209.533157:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584273536:0@lo:400:kworker.0 00010000:00010000:2.0:1788572209.533179:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109bd179 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd180 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533281:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd0e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533291:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd0e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533297:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572209.533303:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1788572209.533307:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584273664:0@lo:38:kworker.0 00010000:00010000:2.0:1788572209.533310:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4000/0x265cfe11109bd0df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd0e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533328:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd102 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533336:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd102 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533342:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572209.533346:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533349:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109bd0fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd102 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533357:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd12c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533368:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd12c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533373:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572209.533376:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533379:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a00030c00/0x265cfe11109bd125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd12c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533391:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd13a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533397:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd13a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533401:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572209.533405:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533408:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd3400/0x265cfe11109bd133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd13a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533417:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd156 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533424:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd156 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533429:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572209.533433:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533435:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590a60d400/0x265cfe11109bd14f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd156 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533448:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd164 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533455:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd164 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533460:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572209.533462:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533465:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590a60ca00/0x265cfe11109bd15d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd164 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533474:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd18e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533523:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd18e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533529:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572209.533532:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533535:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bd187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd18e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533547:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd0f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533554:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd0f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533560:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572209.533563:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533567:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0800/0x265cfe11109bd0ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd0f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533591:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd110 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533598:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd110 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533604:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572209.533607:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533610:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5a00/0x265cfe11109bd109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd110 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533620:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd11e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533626:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd11e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533632:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572209.533642:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533645:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4a00/0x265cfe11109bd117 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd11e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533655:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd148 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533662:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd148 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533677:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572209.533680:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533683:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2600/0x265cfe11109bd141 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd148 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.533692:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd172 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572209.533699:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd172 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572209.533703:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572209.533706:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572209.533709:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590a60d000/0x265cfe11109bd16b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd172 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572209.533727:0:192501:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 257, was 0): CONNECTING 00000100:00080000:2.0:1788572209.533732:0:192501:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1788572209.533754:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584274176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572209.535202:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.535307:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584273408 00000100:00100000:0.0:1788572209.535320:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584273408 00000100:00100000:0.0:1788572209.535363:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584273536 00000100:00100000:0.0:1788572209.535366:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584273536 00000100:00100000:0.0:1788572209.535436:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788572209.535447:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584273536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572209.535541:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584273536:12345-0@lo:400:kworker.0 Request processed in 96us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572209.535550:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788572209.535582:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:0.0:1788572209.535587:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584273408:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572209.535613:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572209.535657:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584273408:12345-0@lo:38:kworker.0 Request processed in 69us (2660us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572209.535668:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00080000:0.0:1788572209.535686:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572209.535736:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584273536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572209.535832:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584274048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572209.535871:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.535917:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584274048 00000100:00100000:0.0:1788572209.535921:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584274048 00000100:00100000:0.0:1788572209.535954:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7632 00000100:00100000:0.0:1788572209.535960:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584274048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572209.536000:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584274048:12345-0@lo:400:kworker.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572209.536010:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7632 00000100:00080000:0.0:1788572209.536029:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572209.536046:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584274048:0@lo:400:kworker.0 00000100:00100000:3.0:1788572209.537863:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.538066:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.538077:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584273792 00000100:00100000:0.0:1788572209.538090:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584273792 00000100:00100000:1.0:1788572209.538159:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584273920:0@lo:38:kworker.0 00000100:00100000:0.0:1788572209.538176:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584273664 00000100:00100000:0.0:1788572209.538182:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584273664 00000100:00100000:0.0:1788572209.538211:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788572209.538221:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.538228:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584273792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572209.538279:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584273920 00000100:00100000:1.0:1788572209.538290:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584273920 00000100:00100000:0.0:1788572209.538323:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584273792:12345-0@lo:400:kworker.0 Request processed in 102us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572209.538339:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788572209.538341:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788572209.538355:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584273920:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572209.538374:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1788572209.538381:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584273664:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572209.538385:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572209.538452:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584273920:12345-0@lo:38:kworker.0 Request processed in 97us (231us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572209.538460:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:1.0:1788572209.538569:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572209.538584:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572209.538588:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584273920:0@lo:38:kworker.0 00000100:00100000:1.0:1788572209.538597:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584274304:0@lo:38:kworker.0 00000100:00100000:1.0:1788572209.538623:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.538636:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584274432:0@lo:250:kworker.0 00000100:00100000:1.0:1788572209.538663:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572209.538695:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572209.538700:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572209.538703:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584273408:0@lo:38:kworker.0 00000100:00100000:1.0:1788572209.538756:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584274304 00000100:00100000:1.0:1788572209.538760:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584274304 00000100:00100000:1.0:1788572209.538779:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1788572209.538786:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584274304:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572209.538797:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572209.538828:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584274304:12345-0@lo:38:kworker.0 Request processed in 42us (205us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572209.538835:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00080000:1.0:1788572209.538850:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572209.538868:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572209.538871:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572209.538875:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584274304:0@lo:38:kworker.0 00000100:00100000:1.0:1788572209.538911:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584274432 00000100:00100000:1.0:1788572209.538915:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584274432 00000100:00100000:1.0:1788572209.538938:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788572209.538943:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3640:x1875444584274432:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1788572209.538962:0:192509:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e87131b0-4a60-4def-a26d-6e23dcfe5daa@0@lo t0 exp 0000000000000000 cur 8962 last 0 00000020:00000080:1.0:1788572209.539001:0:192509:0:(genops.c:1385:class_connect()) connect: client e87131b0-4a60-4def-a26d-6e23dcfe5daa, cookie 0x265cfe11109bd500 00000100:00080000:1.0:1788572209.539157:0:192509:0:(import.c:65:import_set_state_nolock()) ffff8e5a4106a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572209.539207:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+5:3640:x1875444584274432:12345-0@lo:250:kworker.0 Request processed in 263us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572209.539215:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788572209.539244:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.157@tcp: connect to target with instance 0 10000000:01000000:1.0:1788572209.539255:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1788572209.539258:0:3640:0:(import.c:1328:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x265cfe11109bd500 00000100:00100000:3.0:1788572209.541118:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584273792:0@lo:400:kworker.0 00010000:00020000:0.0:1788572209.541387:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572209.541501:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584273664:12345-0@lo:38:kworker.0 Request processed in 3118us (3442us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572209.541512:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1788572209.542293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.542512:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584274176 00000100:00100000:3.0:1788572209.542523:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584274176 00000100:00100000:3.0:1788572209.542609:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7633 00000100:00100000:3.0:1788572209.542620:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584274176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572209.542694:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584274176:12345-0@lo:400:kworker.0 Request processed in 76us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.542701:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7633 00000100:00100000:2.0:1788572209.542808:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584274176:0@lo:400:kworker.0 00000100:00080000:0.0:1788572209.542921:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572209.553736:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1788572209.553752:0:3640:0:(import.c:1718:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:3.0:1788572209.557873:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584274432:0@lo:250:kworker.0 00000100:00080000:3.0:1788572209.557963:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572209.557970:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572209.557974:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584273664:0@lo:38:kworker.0 00000100:00080000:0.0:1788572209.558361:0:192501:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:0.0:1788572209.558380:0:192501:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788572209.558455:0:192501:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788572209.558462:0:192501:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788572209.558666:0:192501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.157@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788572209.558722:0:192501:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.157@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788572209.558726:0:192501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788572209.558728:0:192501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572209.558731:0:192501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572209.558732:0:192501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572209.558734:0:192501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572209.558735:0:192501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572209.558737:0:192501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572209.558739:0:192501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572209.558741:0:192501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572209.558742:0:192501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788572209.558745:0:192501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788572209.558747:0:192501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572209.558748:0:192501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572209.558750:0:192501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572209.558751:0:192501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572209.558752:0:192501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572209.558754:0:192501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572209.558755:0:192501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572209.558756:0:192501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572209.558757:0:192501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572209.558758:0:192501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788572209.558797:0:192501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788572209.558821:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220300 going to sleep for 0 seconds 00000100:00100000:0.0:1788572209.558828:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584274560:0@lo:253:mount.lustre.0 00000020:00080000:0.0:1788572209.558845:0:192501:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:0.0:1788572209.558867:0:192501:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a3f8c3000 from lustre-MDT0000 10000000:01000000:0.0:1788572209.558893:0:192501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788572209.558897:0:192501:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788572209.558908:0:192501:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5a3f8c3000 10000000:01000000:0.0:1788572209.558914:0:192501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788572209.558919:0:192501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e5a3f8c3000 10000000:01000000:0.0:1788572209.558923:0:192501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788572209.558927:0:192501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a3f8c3000 from 1 10000000:01000000:0.0:1788572209.558931:0:192501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788572209.558970:0:192501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.558984:0:192501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.558997:0:192501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572209.559008:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220b40 going to sleep for 0 seconds 00000100:00100000:0.0:1788572209.559012:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584274688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572209.559024:0:192501:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.559032:0:192501:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.559039:0:192501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.559048:0:192501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.559057:0:192501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.559064:0:192501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572209.559068:0:192501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.559078:0:192501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572209.559086:0:192501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572209.559094:0:192501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572209.559098:0:192501:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572209.559105:0:192501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.559112:0:192501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572209.559133:0:192501:0:(mgc_request.c:1817:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:0.0:1788572209.559136:0:192501:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:3.0:1788572209.559269:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572209.559274:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:1.0:1788572209.559460:0:192511:0:(import.c:1642:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.202.157@tcp to MGS@0@lo 00000100:00100000:1.0:1788572209.559466:0:192511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788572209.559470:0:192511:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:1.0:1788572209.559519:0:192511:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1788572209.559525:0:192511:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1788572209.559528:0:192511:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788572209.559559:0:192511:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1788572209.559563:0:192511:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) MGC192.168.202.157@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:2.0:1788572209.559721:0:177620:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.202.157@tcp 10000000:01000000:2.0:1788572209.559740:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788572209.559743:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788572209.559745:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788572209.559747:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572209.559748:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572209.559749:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572209.559750:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572209.559753:0:177620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572209.559754:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572209.559756:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788572209.559803:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788572209.559810:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788572209.559812:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788572209.559814:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788572209.559815:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572209.559816:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572209.559818:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572209.559819:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572209.559820:0:177620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572209.559822:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572209.559823:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788572209.559836:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788572209.559840:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788572209.559842:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788572209.559843:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788572209.559844:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572209.559845:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572209.559846:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572209.559847:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572209.559849:0:177620:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572209.559850:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572209.559851:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788572209.559872:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788572209.559894:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572209.559911:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584275072:0@lo:253:kworker.0 00000100:00100000:2.0:1788572209.560008:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572209.560064:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584274944:0@lo:253:kworker.0 00000100:00100000:2.0:1788572209.560099:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572209.560121:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572209.560127:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584274816:0@lo:253:kworker.0 00000100:00100000:2.0:1788572209.560155:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572209.560186:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584275072 00000100:00100000:2.0:1788572209.560194:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584275072 00000100:00100000:2.0:1788572209.560230:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584274944 00000100:00100000:2.0:1788572209.560232:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584274944 00000100:00100000:2.0:1788572209.560240:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584274816 00000100:00100000:2.0:1788572209.560242:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584274816 00000100:00100000:2.0:1788572209.560253:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788572209.560262:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:3642:x1875444584275072:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788572209.560295:0:192507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1788572209.560455:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788572209.560463:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:3644:x1875444584274944:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788572209.560512:0:192508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:2.0:1788572209.560547:0:192512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788572209.560681:0:192507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 327 10000000:01000000:0.0:1788572209.561866:0:192501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a3f8c3000 from 1 10000000:01000000:0.0:1788572209.561874:0:192501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788572209.561922:0:192501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.561936:0:192501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.561948:0:192501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572209.561978:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584275200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572209.562056:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.562097:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572209.562231:0:192509:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788572209.562241:0:192509:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1788572209.562516:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584275200 00000100:00100000:3.0:1788572209.562524:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584275200 00000100:00100000:2.0:1788572209.562680:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788572209.562692:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3644:x1875444584274816:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788572209.562731:0:192514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788572209.564865:0:192513:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788572209.564878:0:192513:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788572209.564881:0:192513:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788572209.564884:0:192513:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788572209.565064:0:192513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788572209.565650:0:192507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788572209.565725:0:192508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788572209.572079:0:192508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788572209.572103:0:192508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788572209.572468:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3644:x1875444584274944:12345-0@lo:253:kworker.0 Request processed in 11997us (12358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.572509:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572209.572602:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572209.572617:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:192501:x1875444584275200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572209.572636:0:192508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572209.572669:0:192508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590a60dc00/0x265cfe11109bd515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd50e expref: -99 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.572708:0:192508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590a60dc00/0x265cfe11109bd515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd50e expref: 8 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.572721:0:192508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590a60dc00/0x265cfe11109bd515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd50e expref: 8 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.572733:0:192508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60dc00, rc 0) 00000100:00100000:3.0:1788572209.572767:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:192501:x1875444584275200:12345-0@lo:101:mount.lustre.0 Request processed in 156us (10711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.572774:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:1.0:1788572209.572914:0:192512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788572209.572921:0:192512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788572209.572939:0:192512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.572950:0:192512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788572209.572961:0:192512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000040790s 00010000:00010000:1.0:1788572209.572967:0:192512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.572975:0:192512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.572983:0:192512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.572991:0:192512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.572998:0:192512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572209.573004:0:192512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.573014:0:192512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.573026:0:192512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.573036:0:192512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.573042:0:192512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd51c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788572209.573177:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788572209.573181:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788572209.573182:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572209.573184:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572209.573185:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572209.573187:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572209.573189:0:3644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572209.573191:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572209.573193:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788572209.573197:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584274944:0@lo:253:kworker.0 20000000:01000000:2.0:1788572209.573247:0:192514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788572209.573763:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584275200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572209.573785:0:192501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.573796:0:192501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572209.573814:0:192501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788572209.573824:0:192501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.573831:0:192501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572209.573840:0:192501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788572209.573846:0:192501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572209.573853:0:192501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e5a3f8c3000 10000000:01000000:0.0:1788572209.573856:0:192501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788572209.573861:0:192501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788572209.573864:0:192501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788572209.573896:0:192501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.573904:0:192501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.573913:0:192501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572209.573938:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584275328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572209.573997:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.574034:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572209.574432:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584275328 00000100:00100000:2.0:1788572209.574441:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584275328 00000100:00100000:2.0:1788572209.574529:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788572209.574539:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:192501:x1875444584275328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572209.574555:0:192509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572209.574582:0:192509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254c00/0x265cfe11109bd52a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd523 expref: -99 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.574605:0:192509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254c00/0x265cfe11109bd52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd523 expref: 9 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.574615:0:192509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254c00/0x265cfe11109bd52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd523 expref: 9 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.574624:0:192509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254c00, rc 0) 00000100:00100000:2.0:1788572209.574672:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:192501:x1875444584275328:12345-0@lo:101:mount.lustre.0 Request processed in 134us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.574679:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788572209.574996:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584275328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572209.575012:0:192501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.575022:0:192501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572209.575107:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584275456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572209.575215:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.575241:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572209.575362:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584275456 00000100:00100000:2.0:1788572209.575367:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584275456 00000100:00100000:2.0:1788572209.575408:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788572209.575416:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a01326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:192501:x1875444584275456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572209.575614:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a01326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584275456:12345-0@lo:501:mount.lustre.0 Request processed in 198us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.575623:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788572209.576101:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584275456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572209.576156:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584275584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572209.576223:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.576246:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572209.576354:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584275584 00000100:00100000:2.0:1788572209.576361:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584275584 00000100:00100000:2.0:1788572209.576406:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788572209.576414:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a01325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584275584:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572209.582521:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a01325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584275584:12345-0@lo:503:mount.lustre.0 Request processed in 6054us (6244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.582544:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 20000000:01000000:2.0:1788572209.584371:0:192514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572209.584521:0:192514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788572209.584960:0:192507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788572209.585673:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:3644:x1875444584274816:12345-0@lo:253:kworker.0 Request processed in 22974us (25507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.585688:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1788572209.585851:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788572209.585854:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788572209.585856:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572209.585857:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572209.585858:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572209.585860:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572209.585861:0:3644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572209.585863:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572209.585865:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788572209.585868:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584274816:0@lo:253:kworker.0 00000100:00100000:3.0:1788572209.586263:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584275584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572209.587819:0:192515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192515:1875444584275712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572209.587922:0:192515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.587977:0:192515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5902232840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572209.588076:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584275712 00000100:00100000:2.0:1788572209.588086:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584275712 00000100:00100000:2.0:1788572209.588155:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572209.588167:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:192515:x1875444584275712:12345-0@lo:502:llog_process_th.0 20000000:01000000:0.0:1788572209.589940:0:192507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788572209.591863:0:192512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 2 10000000:01000000:1.0:1788572209.591888:0:192512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788572209.591930:0:192512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.591951:0:192512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788572209.591963:0:192512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000077030s 00010000:00010000:1.0:1788572209.591969:0:192512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.591977:0:192512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.591991:0:192512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.591999:0:192512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.592006:0:192512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572209.592011:0:192512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.592021:0:192512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.592038:0:192512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.592047:0:192512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572209.592053:0:192512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd531 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572209.592659:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:192515:x1875444584275712:12345-0@lo:502:llog_process_th.0 Request processed in 4486us (4728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.592673:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788572209.592825:0:192515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192515:1875444584275712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572209.592878:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572209.592894:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.592896:0:192515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788572209.592904:0:192515:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788572209.592907:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572209.592928:0:192515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e5901bf8000) 00000020:00000080:3.0:1788572209.592961:0:192515:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1788572209.592968:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788572209.593089:0:192515:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788572209.593098:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd53f 00000020:00000080:3.0:1788572209.593653:0:192515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788572209.593664:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572209.593671:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.593673:0:192515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788572209.593676:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572209.593681:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.593683:0:192515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788572209.593687:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572209.593700:0:192515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e5901bfcd40) 00000020:00000080:3.0:1788572209.593724:0:192515:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1788572209.593728:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788572209.593730:0:192515:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788572209.593733:0:192515:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788572209.593739:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788572209.593806:0:192515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a3f8c3000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788572209.593816:0:192515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e5901bfb380) 00000020:00000080:3.0:1788572209.593824:0:192515:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1788572209.593871:0:192515:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788572209.593877:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd554 00000020:00000080:3.0:1788572209.594005:0:192515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788572209.594011:0:192515:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788572209.594016:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x265cfe11109bd55b 00080000:01000000:3.0:1788572209.594021:0:192515:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788572209.594025:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd562 00010000:00010000:2.0:1788572209.599268:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788572209.599562:0:192507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788572209.600068:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3642:x1875444584275072:12345-0@lo:253:kworker.0 Request processed in 39800us (40054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572209.600088:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1788572209.607760:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788572209.607767:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788572209.607768:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572209.607769:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572209.607771:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572209.607774:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572209.607775:0:3642:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572209.607777:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572209.607778:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788572209.607785:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584275072:0@lo:253:kworker.0 00010000:00010000:0.0:1788572209.714311:0:192515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1788572209.717637:0:192515:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d idx: 0 lr: 330712481934 srv lr: 335007449088 lx: 0 gen 18 00000001:00080000:0.0:1788572209.717685:0:192515:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 326417519069 srv lr: 335007449088 lx: 0 gen 22 00000001:00000004:0.0:1788572209.717718:0:192515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 79, last_transno is 335007449088 00000001:00080000:0.0:1788572209.718006:0:192515:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788572209.718069:0:192515:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5905220c00: xid 1875444569468032, transno 335007449091, client gen 18, slot idx 0 00000001:00080000:0.0:1788572209.718079:0:192515:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e59052203c0: xid 1875444569468544, transno 335007449092, client gen 18, slot idx 1 00000001:00080000:0.0:1788572209.718085:0:192515:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5905220f00: xid 1875444581057152, transno 326417519069, client gen 22, slot idx 2 00000001:00080000:0.0:1788572209.718089:0:192515:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5905220180: xid 1875444569452160, transno 330712481931, client gen 18, slot idx 3 00000001:00080000:0.0:1788572209.718093:0:192515:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e59052206c0: xid 1875444567597824, transno 326417519807, client gen 18, slot idx 4 00000001:00080000:0.0:1788572209.718097:0:192515:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5905220480: xid 1875444562639360, transno 322122556265, client gen 18, slot idx 5 00000020:00000080:0.0:1788572209.718607:0:192515:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e5a413fb380) 00000020:00000080:0.0:1788572209.718632:0:192515:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1788572209.718700:0:192515:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788572209.718709:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd57e 00000020:00000080:2.0:1788572209.721028:0:192515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788572209.732299:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x265cfe11109bd585 00000020:00000080:3.0:1788572209.735073:0:192515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788572209.735090:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572209.735100:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.735102:0:192515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788572209.735106:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572209.735109:0:192515:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788572209.735110:0:192515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572209.735112:0:192515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572209.735113:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572209.735116:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.735117:0:192515:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572209.735120:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572209.735125:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.735126:0:192515:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788572209.735142:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788572209.735198:0:192515:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788572209.735213:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572209.735217:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.735218:0:192515:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788572209.735220:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572209.735223:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.735224:0:192515:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788572209.735227:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572209.735232:0:192515:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:00000080:3.0:1788572209.735254:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572209.735269:0:192515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e5a109f99c0) 00000020:00000080:3.0:1788572209.735289:0:192515:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788572209.735293:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572209.735353:0:192515:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788572209.735358:0:192515:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788572209.735364:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd593 00010000:00080000:3.0:1788572209.735607:0:192515:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a109bf000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572209.739536:0:192515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788572209.741466:0:192515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572209.741519:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788572209.741557:0:192515:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788572209.741591:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd59a 00000100:00080000:2.0:1788572209.741600:0:192515:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788572209.741606:0:192515:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e5a109bf000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572209.741640:0:192515:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40523b80 x1875444584275840/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572209.741666:0:192515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788572209.741718:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572209.741722:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572209.741724:0:192515:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788572209.741727:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788572209.741730:0:192515:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788572209.741732:0:192515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572209.741733:0:192515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572209.741735:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788572209.741737:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572209.741738:0:192515:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788572209.741741:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788572209.741745:0:192515:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788572209.741748:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572209.741749:0:192515:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788572209.741751:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788572209.741755:0:192515:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:2.0:1788572209.741777:0:192515:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788572209.741779:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788572209.741790:0:192515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e5a4014b380) 00000020:00000080:2.0:1788572209.741803:0:192515:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788572209.741806:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788572209.741876:0:192515:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788572209.742093:0:192515:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788572209.742102:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd5a8 00010000:00080000:2.0:1788572209.742130:0:192515:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a109b8000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.157@tcp at head 00000100:00100000:0.0:1788572209.742428:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572209.742440:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584275968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572209.742533:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572209.742679:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584275968 00000100:00100000:2.0:1788572209.742688:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584275968 00000100:00100000:2.0:1788572209.742738:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788572209.742748:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3641:x1875444584275968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572209.742807:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3641:x1875444584275968:12345-0@lo:400:kworker.0 Request processed in 61us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.742814:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788572209.742887:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584275968:0@lo:400:kworker.0 00000100:00100000:1.0:1788572209.742993:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584275840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572209.743031:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572209.743127:0:192515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1788572209.743215:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584275840 00000100:00100000:3.0:1788572209.743220:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584275840 00000100:00100000:3.0:1788572209.743251:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788572209.743256:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584275840:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788572209.743278:0:188053:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8962 last 0 00000020:00000080:3.0:1788572209.743312:0:188053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd5af 00000004:00100000:3.0:1788572209.743328:0:188053:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572209.743439:0:188053:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1a9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572209.743515:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584275840:12345-0@lo:38:llog_process_th.0 Request processed in 257us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.743522:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788572209.743585:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788572209.743594:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 5 00000100:00080000:0.0:1788572209.743601:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788572209.743606:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788572209.743610:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a109bf000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788572209.743629:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584275840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572209.743765:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572209.743774:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584276096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572209.744059:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.744122:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584276096 00000100:00100000:1.0:1788572209.744136:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584276096 00000100:00100000:1.0:1788572209.744168:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788572209.744175:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584276096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572209.744197:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572209.744245:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584276096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572209.744251:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788572209.745027:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584276096:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1788572209.746270:0:192515:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788572209.746310:0:192515:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788572209.746744:0:192515:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 77, last_idx 78 00000040:00080000:2.0:1788572209.747710:0:192515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572209.747743:0:192515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].79, 64 off13248 00000040:00080000:2.0:1788572209.748303:0:192515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13c:0x0].1, 64 off8256 00000040:00080000:2.0:1788572209.752001:0:192521:0:(llog.c:805:llog_process_thread()) index: 78, lh_last_idx: 79 synced_idx: 0 lgh_last_idx: 79 00000040:00080000:2.0:1788572209.752014:0:192521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x138:0x0] at index 78 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788572209.755912:0:192515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572209.756043:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788572209.756097:0:192515:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788572209.756123:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd5b6 00000100:00080000:3.0:1788572209.756134:0:192515:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572209.756140:0:192515:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5a109b8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572209.756179:0:192515:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eaf800 x1875444584276224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572209.756208:0:192515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788572209.756273:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572209.756278:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.756280:0:192515:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788572209.756284:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572209.756287:0:192515:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788572209.756288:0:192515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572209.756290:0:192515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572209.756291:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572209.756294:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.756295:0:192515:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572209.756298:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788572209.756302:0:192515:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788572209.756305:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.756306:0:192515:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788572209.756310:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572209.756314:0:192515:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:3.0:1788572209.756337:0:192515:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788572209.756340:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572209.756352:0:192515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e5a109f8000) 00000020:00000080:3.0:1788572209.756367:0:192515:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788572209.756372:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572209.757053:0:192515:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788572209.757061:0:192515:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788572209.757068:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd5c4 00010000:00080000:3.0:1788572209.757101:0:192515:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5906853800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572209.757333:0:192515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:0.0:1788572209.758018:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584276224:0@lo:8:llog_process_th.0 00000040:01000000:3.0:1788572209.758043:0:192515:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788572209.758058:0:192515:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788572209.758090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.758180:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584276224 00000100:00100000:1.0:1788572209.758188:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584276224 00000100:00100000:1.0:1788572209.758233:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22605 00000100:00100000:1.0:1788572209.758240:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3640:x1875444584276224:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788572209.758270:0:43921:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8962 last 0 00000020:00000080:1.0:1788572209.758294:0:43921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd5cb 00002000:00100000:1.0:1788572209.758306:0:43921:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e5a4106b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788572209.758310:0:43921:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788572209.758312:0:43921:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788572209.758384:0:43921:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788572209.758407:0:43921:0:(import.c:65:import_set_state_nolock()) ffff8e5a4106f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572209.758466:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584276224:12345-0@lo:8:llog_process_th.0 Request processed in 224us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572209.758473:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22605 00000100:00100000:0.0:1788572209.758823:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788572209.758831:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 8 00000100:00080000:0.0:1788572209.758838:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788572209.758843:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788572209.758846:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a109b8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788572209.758856:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788572209.758861:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584276224:0@lo:8:llog_process_th.0 00000040:00080000:2.0:1788572209.759040:0:192521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x138:0x0] index 3 count 2 00000040:00080000:2.0:1788572209.759068:0:192521:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 79 synced_idx: 79 lgh_last_idx: 79 00000040:00080000:2.0:1788572209.759071:0:192521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13c:0x0] at index 79 of catalog [0x1:0x2:0x0] 00000004:00080000:2.0:1788572209.759088:0:192521:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788572209.759128:0:192521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8962753648449ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788572209.759135:0:192521:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788572209.759156:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572209.759167:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584276352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572209.759204:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572209.759407:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584276352 00000100:00100000:2.0:1788572209.759413:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584276352 00000100:00100000:2.0:1788572209.759452:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22606 00000100:00100000:2.0:1788572209.759460:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584276352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572209.759510:0:43919:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6594 count 1 00000100:00100000:2.0:1788572209.759594:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584276352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 135us (389us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572209.759602:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22606 00000100:00080000:2.0:1788572209.759619:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788572209.760207:0:192515:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 77, last_idx 78 00000004:00080000:2.0:1788572209.760603:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a40522300, transno 0 00000004:00080000:2.0:1788572209.760610:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a40522300/1, rc -2, transno 0 00000100:00100000:2.0:1788572209.760621:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584276352:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1788572209.760779:0:192521:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 78, last_idx 79 00000040:00080000:2.0:1788572209.760797:0:192521:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x138:0x0] at index 78 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788572209.761044:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584276480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572209.761094:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.761144:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584276480 00000100:00100000:1.0:1788572209.761149:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584276480 00000100:00100000:1.0:1788572209.761187:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6245 00000100:00100000:1.0:1788572209.761195:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584276480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572209.761218:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572209.761253:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584276480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572209.761263:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6245 00000100:00100000:1.0:1788572209.761301:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584276480:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788572209.761315:0:192515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572209.761342:0:192515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].79, 64 off13248 00000040:00080000:3.0:1788572209.762016:0:192515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13e:0x0].1, 64 off8256 00000040:00080000:3.0:1788572209.763418:0:192523:0:(llog.c:805:llog_process_thread()) index: 78, lh_last_idx: 79 synced_idx: 0 lgh_last_idx: 79 00000040:00080000:3.0:1788572209.763425:0:192523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13a:0x0] at index 78 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788572209.763612:0:192523:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 78, last_idx 79 00000040:00080000:3.0:1788572209.763632:0:192523:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x13a:0x0] at index 78 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788572209.763753:0:192523:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 79 synced_idx: 79 lgh_last_idx: 79 00000040:00080000:3.0:1788572209.763756:0:192523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13e:0x0] at index 79 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788572209.764674:0:192502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:3.0:1788572209.765337:0:192515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572209.765350:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788572209.765409:0:192515:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788572209.765434:0:192515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd5d2 00000100:00080000:3.0:1788572209.765444:0:192515:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572209.765450:0:192515:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5906853800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572209.765514:0:192515:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eae300 x1875444584276608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572209.765544:0:192515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788572209.765591:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584276608:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788572209.765605:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572209.765608:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.765610:0:192515:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788572209.765613:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572209.765617:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.765618:0:192515:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788572209.765621:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788572209.765622:0:192515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788572209.765625:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572209.765627:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.765628:0:192515:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788572209.765630:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572209.765631:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572209.765633:0:192515:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788572209.765636:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788572209.765663:0:192515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192515:1875444584276736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572209.765670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.765705:0:192515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.765719:0:192515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572209.765724:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584276608 00000100:00100000:1.0:1788572209.765730:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584276608 00000100:00100000:1.0:1788572209.765768:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22607 00000100:00100000:1.0:1788572209.765776:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3640:x1875444584276608:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788572209.765800:0:43917:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8962 last 0 00000020:00000080:1.0:1788572209.765827:0:43917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd5d9 00002000:00100000:1.0:1788572209.765840:0:43917:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e5a4106f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788572209.765845:0:43917:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788572209.765847:0:43917:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788572209.765928:0:43917:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788572209.765950:0:43917:0:(import.c:65:import_set_state_nolock()) ffff8e5a4106e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572209.766005:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584276608:12345-0@lo:8:llog_process_th.0 Request processed in 228us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572209.766012:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22607 00000100:00100000:2.0:1788572209.766110:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584276736 00000100:00100000:2.0:1788572209.766116:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584276736 00000100:00100000:2.0:1788572209.766155:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572209.766163:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:192515:x1875444584276736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572209.766266:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:192515:x1875444584276736:12345-0@lo:502:llog_process_th.0 Request processed in 103us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.766273:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572209.766329:0:192515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192515:1875444584276736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572209.766352:0:192515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572209.766356:0:192515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572209.766358:0:192515:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788572209.766362:0:192515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788572209.766595:0:192501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788572209.766620:0:192501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788572209.766637:0:192501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572209.766699:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572209.766708:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788572209.766714:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788572209.766719:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788572209.766722:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5906853800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788572209.766745:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788572209.766751:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584276608:0@lo:8:llog_process_th.0 00010000:00010000:0.0:1788572209.766752:0:192501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572209.766760:0:192501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a3f8c3000 from 1 10000000:01000000:0.0:1788572209.766764:0:192501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788572209.766792:0:192501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.766803:0:192501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.766816:0:192501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572209.766831:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584276864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572209.766862:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572209.766957:0:192523:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788572209.767015:0:192523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8962761535028ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788572209.767022:0:192523:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788572209.767273:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584276864 00000100:00100000:0.0:1788572209.767276:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.767278:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584276864 00000100:00100000:3.0:1788572209.767311:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788572209.767319:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:192501:x1875444584276864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572209.767330:0:192514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572209.767344:0:192514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd5e0 expref: -99 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572209.767356:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584276992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572209.767365:0:192514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd5e0 expref: 9 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.767375:0:192514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd5e0 expref: 9 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572209.767387:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572209.767399:0:192514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60c800, rc 0) 00000100:00100000:3.0:1788572209.767442:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:192501:x1875444584276864:12345-0@lo:101:mount.lustre.0 Request processed in 124us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.767448:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572209.767985:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584276864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572209.767999:0:192501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.768008:0:192501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572209.768593:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277120:0@lo:256:mount.lustre.0 00000004:00080000:3.0:1788572209.771535:0:192502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788572209.773630:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572209.774220:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584276992 00000100:00100000:2.0:1788572209.774231:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584276992 00000100:00100000:2.0:1788572209.774301:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6246 00000100:00100000:2.0:1788572209.774311:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584276992:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788572209.774345:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788572209.774350:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572209.774449:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584276992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (7060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.774461:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6246 00000100:00100000:2.0:1788572209.774534:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.774637:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584277120 00000100:00100000:3.0:1788572209.774642:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584277120 00000100:00100000:3.0:1788572209.774681:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788572209.774689:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:192501:x1875444584277120:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788572209.774704:0:192508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788572209.774728:0:192508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788572209.774731:0:192508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788572209.774735:0:192508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788572209.774737:0:192508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 330 00000100:00100000:3.0:1788572209.774848:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:192501:x1875444584277120:12345-0@lo:256:mount.lustre.0 Request processed in 159us (6204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.774854:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788572209.774904:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277120:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788572209.775581:0:192501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572209.775598:0:192501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.775609:0:192501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572209.775618:0:192501:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a3f8c3000 from 1 10000000:01000000:3.0:1788572209.775621:0:192501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572209.775652:0:192501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.775661:0:192501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.775670:0:192501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572209.775694:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572209.775732:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.775765:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584277248 00000100:00100000:3.0:1788572209.775769:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584277248 00000100:00100000:3.0:1788572209.775793:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788572209.775799:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a244fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:192501:x1875444584277248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572209.775808:0:192509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572209.775821:0:192509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590a60c000/0x265cfe11109bd5f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd5ee expref: -99 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.775841:0:192509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590a60c000/0x265cfe11109bd5f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd5ee expref: 10 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.775851:0:192509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590a60c000/0x265cfe11109bd5f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd5ee expref: 10 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.775859:0:192509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60c000, rc 0) 00000100:00100000:3.0:1788572209.775884:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a244fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584277248:12345-0@lo:101:mount.lustre.0 Request processed in 84us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.775890:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788572209.775925:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.775941:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572209.775955:0:192501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.775964:0:192501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572209.776021:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572209.776045:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.776065:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584277376 00000100:00100000:3.0:1788572209.776068:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584277376 00000100:00100000:3.0:1788572209.776087:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788572209.776094:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584277376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572209.776216:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584277376:12345-0@lo:501:mount.lustre.0 Request processed in 122us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.776224:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788572209.776251:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.776263:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572209.776287:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572209.776324:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.776342:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584277504 00000100:00100000:3.0:1788572209.776345:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584277504 00000100:00100000:3.0:1788572209.776364:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788572209.776369:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590581a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584277504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572209.776442:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590581a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584277504:12345-0@lo:503:mount.lustre.0 Request processed in 72us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.776449:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788572209.776520:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.776534:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572209.778188:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584276992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572209.786317:0:192525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192525:1875444584277632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572209.786992:0:192525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.787045:0:192525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a10db2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572209.787435:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584277632 00000100:00100000:0.0:1788572209.787444:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584277632 00000100:00100000:0.0:1788572209.787524:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788572209.787535:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192525:x1875444584277632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572209.789044:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192525:x1875444584277632:12345-0@lo:502:llog_process_th.0 Request processed in 1504us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572209.789056:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788572209.794628:0:192525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192525:1875444584277632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572209.794694:0:192525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572209.794708:0:192525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572209.794711:0:192525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788572209.794718:0:192525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a3f8c3000 00000020:00000080:1.0:1788572209.794720:0:192525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572209.794729:0:192525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572209.794731:0:192525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572209.794733:0:192525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788572209.794735:0:192525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572209.794737:0:192525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572209.794738:0:192525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788572209.794741:0:192525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a3f8c3000 00000020:00000080:1.0:1788572209.794743:0:192525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788572209.796114:0:192525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192525:1875444584277760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572209.796213:0:192525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.796250:0:192525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0a3080c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572209.796335:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584277760 00000100:00100000:0.0:1788572209.796344:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584277760 00000100:00100000:0.0:1788572209.796400:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788572209.796410:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192525:x1875444584277760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572209.796557:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192525:x1875444584277760:12345-0@lo:502:llog_process_th.0 Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572209.796565:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788572209.797735:0:192525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192525:1875444584277760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572209.797781:0:192525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572209.797801:0:192525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572209.797804:0:192525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788572209.797809:0:192525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788572209.798171:0:192501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788572209.798195:0:192501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572209.798218:0:192501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.798230:0:192501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572209.798288:0:192501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788572209.798291:0:192501:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5a3f8c3000 10000000:01000000:0.0:1788572209.798294:0:192501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5a3f8c3000 10000000:01000000:0.0:1788572209.798298:0:192501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572209.798304:0:192501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a3f8c3000 from 1 10000000:01000000:0.0:1788572209.798308:0:192501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572209.798342:0:192501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.798351:0:192501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.798361:0:192501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572209.798397:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572209.798458:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.798518:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.799138:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584277888 00000100:00100000:3.0:1788572209.799145:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584277888 00000100:00100000:3.0:1788572209.799199:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788572209.799211:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590581b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584277888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572209.799226:0:192514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572209.799241:0:192514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590a60c200/0x265cfe11109bd603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd5fc expref: -99 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.799265:0:192514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590a60c200/0x265cfe11109bd603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd5fc expref: 11 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.799274:0:192514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590a60c200/0x265cfe11109bd603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd5fc expref: 11 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.799283:0:192514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60c200, rc 0) 00000100:00100000:3.0:1788572209.799332:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590581b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192501:x1875444584277888:12345-0@lo:101:mount.lustre.0 Request processed in 123us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.799338:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572209.800272:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584277888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572209.800295:0:192501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.800306:0:192501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572209.801526:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584278016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572209.801620:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.801674:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.802557:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584278016 00000100:00100000:3.0:1788572209.802567:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584278016 00000100:00100000:3.0:1788572209.802631:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788572209.802641:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192501:x1875444584278016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572209.802820:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192501:x1875444584278016:12345-0@lo:501:mount.lustre.0 Request processed in 179us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.802829:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788572209.802891:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584278016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572209.802942:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584278144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572209.802992:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.803018:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584278144 00000100:00100000:3.0:1788572209.803022:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584278144 00000100:00100000:3.0:1788572209.803046:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788572209.803053:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192501:x1875444584278144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572209.803128:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192501:x1875444584278144:12345-0@lo:503:mount.lustre.0 Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.803135:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788572209.803177:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.803190:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584278144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572209.813252:0:192527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192527:1875444584278272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572209.813335:0:192527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572209.813395:0:192527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904f413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.813720:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584278272 00000100:00100000:3.0:1788572209.813729:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584278272 00000100:00100000:3.0:1788572209.813786:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788572209.813798:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192527:x1875444584278272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572209.813948:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192527:x1875444584278272:12345-0@lo:502:llog_process_th.0 Request processed in 151us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.813956:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788572209.814027:0:192527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192527:1875444584278272:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788572209.814092:0:192527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788572209.814107:0:192527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e5a401499c0) 00000020:00000080:2.0:1788572209.814142:0:192527:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788572209.814227:0:192527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a3f8c3000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788572209.814233:0:192527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a3f8c3000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788572209.814235:0:192527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a3f8c3000 4 00010000:00080000:2.0:1788572209.814266:0:192527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a37118000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572209.818857:0:192527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1788572209.819106:0:192527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788572209.819162:0:192527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788572209.819178:0:192527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x265cfe11109bd611 00000100:00080000:3.0:1788572209.819188:0:192527:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572209.819194:0:192527:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e5a37118000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572209.819232:0:192527:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ead180 x1875444584278400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572209.819321:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584278400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788572209.819417:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572209.819633:0:192527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788572209.820054:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584278400 00000100:00100000:0.0:1788572209.820063:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584278400 00000100:00100000:0.0:1788572209.820093:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1788572209.820101:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584278400:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788572209.820167:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584278400:12345-0@lo:38:llog_process_th.0 Request processed in 65us (750us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572209.820175:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1788572209.820651:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572209.820660:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a37118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572209.820664:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572209.820668:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584278400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572209.820788:0:192527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192527:1875444584278528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572209.820843:0:192527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.820873:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584278528 00000100:00100000:3.0:1788572209.820877:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584278528 00000100:00100000:3.0:1788572209.820907:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572209.820913:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192527:x1875444584278528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572209.821010:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192527:x1875444584278528:12345-0@lo:502:llog_process_th.0 Request processed in 97us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.821017:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572209.821061:0:192527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59033cb300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.821075:0:192527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192527:1875444584278528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572209.821111:0:192527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192527:1875444584278656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572209.821141:0:192527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.821162:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584278656 00000100:00100000:3.0:1788572209.821165:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584278656 00000100:00100000:3.0:1788572209.821187:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788572209.821192:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192527:x1875444584278656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572209.821246:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192527:x1875444584278656:12345-0@lo:502:llog_process_th.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.821253:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788572209.821283:0:192527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59033cb300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.821294:0:192527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192527:1875444584278656:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788572209.821311:0:192527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788572209.827674:0:192501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788572209.827720:0:192501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572209.827744:0:192501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572209.827757:0:192501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788572209.827829:0:192501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788572209.827831:0:192501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572209.827832:0:192501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572209.827834:0:192501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572209.827835:0:192501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572209.827836:0:192501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572209.827838:0:192501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572209.827840:0:192501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572209.827841:0:192501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572209.827842:0:192501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572209.827846:0:192501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788572209.827848:0:192501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572209.827849:0:192501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572209.827850:0:192501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572209.827851:0:192501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572209.827852:0:192501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572209.827853:0:192501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572209.827854:0:192501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572209.827855:0:192501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572209.827857:0:192501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572209.827858:0:192501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572209.827884:0:192501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788572209.827901:0:192501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584278784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572209.827962:0:192501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572209.828001:0:192501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905220300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.828221:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584278784 00000100:00100000:3.0:1788572209.828228:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584278784 00000100:00100000:3.0:1788572209.828278:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788572209.828287:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:192501:x1875444584278784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788572209.828312:0:192509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788572209.828333:0:192509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788572209.837992:0:192509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788572209.838019:0:192509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788572209.838222:0:192512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572209.838229:0:192512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572209.838255:0:192512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.838284:0:192512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd5e0 expref: 11 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.838294:0:192512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.838356:0:192512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bd5e0 expref: 11 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572209.838373:0:192512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109bd5e0 expref: 11 pid: 192514 timeout: 9062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572209.838394:0:192512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:192512:1875444584278912:0@lo:104: 00000100:00100000:2.0:1788572209.838475:0:192512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572209.838712:0:192512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904f41000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.838918:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584278912 00000100:00100000:3.0:1788572209.838926:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584278912 00000100:00100000:3.0:1788572209.838977:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5392 00000100:00100000:3.0:1788572209.838988:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:192512:x1875444584278912:12345-0@lo:104: 00010000:00010000:3.0:1788572209.839003:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839065:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572209.839072:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:192512:x1875444584278912:12345-0@lo:104: Request processed in 85us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.839078:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5392 00010000:00010000:3.0:1788572209.839100:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572209.839107:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839119:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2a00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572209.839124:0:10396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839144:0:10396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572209.839151:0:10396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572209.839157:0:10396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572209.839188:0:10396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839195:0:10396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572209.839215:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839222:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd5e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bd5e7 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839236:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572209.839238:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572209.839239:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572209.839252:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584279040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572209.839280:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572209.839322:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584279040 00000100:00100000:3.0:1788572209.839339:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584279040 00010000:00010000:3.0:1788572209.839356:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bd5e0 expref: 12 pid: 192514 timeout: 9062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572209.839379:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12894 00000100:00100000:3.0:1788572209.839387:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:3643:x1875444584279040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572209.839397:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572209.839402:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bd5e0 expref: 12 pid: 192514 timeout: 9062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839412:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109bd5e0 expref: 12 pid: 192514 timeout: 9062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839427:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839434:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788572209.839446:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001218547s 00010000:00010000:3.0:1788572209.839450:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839456:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839463:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839468:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839473:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572209.839872:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839883:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839892:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.839902:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572209.840594:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:3643:x1875444584279040:12345-0@lo:103:ldlm_bl.0 Request processed in 1204us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.840603:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12894 00010000:00010000:3.0:1788572209.841273:0:192512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd5e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bd5e0 expref: 11 pid: 192514 timeout: 9062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572209.841287:0:192512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:192512:1875444584278912:0@lo:104: 00010000:00010000:3.0:1788572209.841309:0:192512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.841319:0:192512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.841326:0:192512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572209.841333:0:192512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bd618 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572209.841735:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:192501:x1875444584278784:12345-0@lo:253:mount.lustre.0 Request processed in 13445us (13769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572209.841746:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788572209.842729:0:192501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:192501:1875444584278784:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788572209.842751:0:192501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788572209.842755:0:192501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788572209.842757:0:192501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788572209.842758:0:192501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572209.842759:0:192501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572209.842761:0:192501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572209.842762:0:192501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572209.842764:0:192501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788572209.842765:0:192501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788572209.842767:0:192501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572209.842769:0:192501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788572209.842795:0:192501:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788572209.846765:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584279040:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788572209.868288:0:192501:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 326417522199 00000040:01000000:2.0:1788572209.868774:0:192501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788572209.873507:0:192534:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788572209.873853:0:192501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788572209.875535:0:192535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192535:1875444584279168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572209.875652:0:192535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.875693:0:192535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a10d4f780 going to sleep for 11 seconds 00000040:01000000:2.0:1788572209.876095:0:192501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788572209.876149:0:192501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788572209.876807:0:192501:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788572209.876818:0:192501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788572209.876866:0:192501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788572209.877317:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584279168 00000100:00100000:3.0:1788572209.877327:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584279168 00000100:00100000:3.0:1788572209.877379:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788572209.877389:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a72850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:192535:x1875444584279168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572209.877535:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a72850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:192535:x1875444584279168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 148us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.877543:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000040:00080000:2.0:1788572209.879065:0:192501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:0.0:1788572209.879268:0:192533:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 326417522199 00000020:00080000:0.0:1788572209.879274:0:192533:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522199 00000100:00100000:1.0:1788572209.880808:0:192535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192535:1875444584279168:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788572209.880855:0:192535:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788572209.880903:0:192535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192535:1875444584279296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572209.880986:0:192535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.881022:0:192535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a10d4f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572209.881150:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584279296 00000100:00100000:3.0:1788572209.881157:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584279296 00000100:00100000:3.0:1788572209.881210:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788572209.881219:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:192535:x1875444584279296:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572209.881352:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:192535:x1875444584279296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 134us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572209.881359:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788572209.881365:0:192535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192535:1875444584279296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572209.881437:0:192535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192535:1875444584279424:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572209.881462:0:192535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.881504:0:192535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a10d4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572209.881823:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584279424 00000100:00100000:0.0:1788572209.881828:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584279424 00000100:00100000:0.0:1788572209.881854:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788572209.881861:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:192535:x1875444584279424:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572209.881917:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:192535:x1875444584279424:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 57us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572209.881924:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000040:00080000:2.0:1788572209.882110:0:192501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788572209.882218:0:192501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788572209.882306:0:192501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788572209.882931:0:192501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x82:0x0] (8/32) registered 00000040:00080000:1.0:1788572209.883845:0:192534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788572209.883913:0:192534:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788572209.884058:0:192535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192535:1875444584279424:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572209.884155:0:192535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192535:1875444584279552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572209.884241:0:192535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572209.884277:0:192535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a12a56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572209.884302:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584279552 00000100:00100000:0.0:1788572209.884309:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584279552 00000100:00100000:0.0:1788572209.884359:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788572209.884368:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:192535:x1875444584279552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572209.884603:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:192535:x1875444584279552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 236us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572209.884611:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788572209.884611:0:192535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192535:1875444584279552:0@lo:1000:lod0000_rec0001.0 00010000:00080000:2.0:1788572209.887296:0:192501:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 335007449092 00010000:00080000:3.0:1788572209.888351:0:192536:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 192536 00010000:02000000:3.0:1788572209.888369:0:192536:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788572209.888372:0:192536:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788572209.888377:0:192536:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788572209.888895:0:192501:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788572209.888918:0:192501:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788572209.888960:0:192501:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788572209.889014:0:192501:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000040:00080000:1.0:1788572209.889355:0:192535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000020:00000004:2.0:1788572209.890468:0:192501:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000004:00080000:1.0:1788572209.890549:0:192535:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788572209.890555:0:192535:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1788572209.890941:0:192501:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:1.0:1788572209.919231:0:192536:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788572210.624073:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572210.989433:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572210.990125:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569475328 00000100:00100000:2.0:1788572210.990136:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569475328 00000100:00100000:2.0:1788572210.990201:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 26 00000100:00100000:2.0:1788572210.990214:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+5:15203:x1875444569475328:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572210.990233:0:192508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572210.990253:0:192508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254e00/0x265cfe11109bd61f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb263 expref: -99 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572210.990277:0:192508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254e00/0x265cfe11109bd61f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb263 expref: 6 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572210.990286:0:192508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254e00/0x265cfe11109bd61f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb263 expref: 6 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572210.990292:0:192508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254e00, rc 0) 00000100:00100000:2.0:1788572210.990341:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+6:15203:x1875444569475328:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 130us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572210.990348:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 26 00000100:00100000:0.0:1788572211.003422:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572211.003496:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569475456 00000100:00100000:1.0:1788572211.003506:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569475456 00000100:00100000:1.0:1788572211.003573:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 27 00000100:00100000:1.0:1788572211.003585:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+6:15203:x1875444569475456:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788572211.003613:0:192514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1788572211.003629:0:192514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788572211.003633:0:192514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788572211.003636:0:192514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788572211.003639:0:192514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788572211.003642:0:192514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 331 00000100:00100000:1.0:1788572211.006076:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+6:15203:x1875444569475456:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 Request processed in 2478us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.006096:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 27 00000100:00100000:0.0:1788572211.011623:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572211.011787:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572211.011860:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569475712 00000100:00100000:0.0:1788572211.011872:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569475712 00000100:00100000:0.0:1788572211.011927:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 28 00000100:00100000:0.0:1788572211.011939:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+6:15203:x1875444569475712:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572211.011960:0:192507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572211.011983:0:192507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a370b2400/0x265cfe11109bd626 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb26a expref: -99 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.012025:0:192507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a370b2400/0x265cfe11109bd626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb26a expref: 7 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.012037:0:192507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a370b2400/0x265cfe11109bd626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb26a expref: 7 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.012047:0:192507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2400, rc 0) 00000100:00100000:0.0:1788572211.012101:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+7:15203:x1875444569475712:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 165us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.012109:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 28 00000100:00100000:2.0:1788572211.020298:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569475584 00000100:00100000:2.0:1788572211.020315:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569475584 00000100:00100000:0.0:1788572211.020346:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572211.020364:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 974 00000100:00100000:0.0:1788572211.020372:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569475840 00000100:00100000:2.0:1788572211.020372:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569475584:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.020375:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569475840 00010000:00080000:2.0:1788572211.020402:0:188833:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '700c1fe3-c9bd-4b4d-876e-3774b25f2a3d' at ffff8e5a0f05e800, cookie 0x265cfe11109bd569 00000100:00100000:0.0:1788572211.020405:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 29 00010000:00080000:2.0:1788572211.020408:0:188833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp recovering/t326417519807 exp ffff8e5a0f05e800 cur 8964 last 1788572209 00000100:00100000:0.0:1788572211.020411:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+7:15203:x1875444569475840:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00010000:02000400:2.0:1788572211.020417:0:188833:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788572211.020423:0:188833:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788572211.020450:0:188833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788572211.020590:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+8:15203:x1875444569475840:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 178us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.020598:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 29 00000100:00080000:2.0:1788572211.020634:0:188833:0:(import.c:65:import_set_state_nolock()) ffff8e59059d2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572211.020667:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569475584:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 Request processed in 294us (9114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572211.020674:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 974 00000100:00100000:0.0:1788572211.028381:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572211.028421:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572211.028451:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444567597824 00000100:00100000:0.0:1788572211.028461:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444567597824 00000100:00100000:0.0:1788572211.028922:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 975 00000100:00100000:0.0:1788572211.028935:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444567597824:12345-192.168.202.57@tcp:101:lfs.0 00010000:00080000:0.0:1788572211.028957:0:188048:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449093, current: 326417519807, replaying 00010000:00010000:0.0:1788572211.028968:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572211.028994:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bd62d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25aed8a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.029089:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569475968 00000100:00100000:0.0:1788572211.029094:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569475968 00000100:00100000:0.0:1788572211.029134:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 30 00000100:00100000:0.0:1788572211.029142:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+8:15203:x1875444569475968:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.030410:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+8:15203:x1875444569475968:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 Request processed in 1258us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.030422:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 30 00000004:00080000:3.0:1788572211.034767:0:188048:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5707us 00000100:00100000:3.0:1788572211.074836:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572211.074901:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569476096 00000100:00100000:3.0:1788572211.074910:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569476096 00000100:00100000:3.0:1788572211.074976:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 31 00000100:00100000:3.0:1788572211.074988:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59022cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+8:15203:x1875444569476096:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572211.075021:0:192509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572211.075043:0:192509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd634 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb271 expref: -99 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.075077:0:192509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb271 expref: 9 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.075089:0:192509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb271 expref: 9 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.075100:0:192509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60c800, rc 0) 00000100:00100000:3.0:1788572211.075394:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59022cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569476096:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 407us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572211.075402:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 31 00000004:00200000:1.0:1788572211.090963:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00000004:00080000:1.0:1788572211.090996:0:188048:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x1b8b:0x0], cookie = 0x265cfe1110980399 00000004:00080000:1.0:1788572211.091009:0:188048:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x265cfe1110980399 in new mfd 00010000:00010000:1.0:1788572211.091399:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bd62d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.091420:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590bffc700) 00010000:00010000:1.0:1788572211.091423:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572211.091430:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bd62d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.091452:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3200, rc 0) 00010000:02000000:1.0:1788572211.091459:0:188048:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=157, val=2147483648*** 00000100:00100000:3.0:1788572211.093732:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572211.093783:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569476224 00000100:00100000:3.0:1788572211.093794:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569476224 00000100:00100000:3.0:1788572211.093852:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 32 00000100:00100000:3.0:1788572211.093863:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59022ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569476224:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.096338:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59022ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569476224:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 1642us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572211.096354:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 32 00010000:00020000:1.0:1788572211.102140:0:188048:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8e5a1ff86680 x1875444567597824/t326417519807(326417519807) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:627/0 lens 520/664 e 0 to 0 dl 1788572222 ref 1 fl Interpret:/604/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788572211.110576:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572211.110824:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569476352 00000100:00100000:0.0:1788572211.110835:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569476352 00000100:00100000:0.0:1788572211.110894:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 33 00000100:00100000:0.0:1788572211.110904:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59022c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569476352:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.111073:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59022c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569476352:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 Request processed in 169us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.111082:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 33 00000100:00100000:0.0:1788572211.127942:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572211.127978:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569476480 00000100:00100000:0.0:1788572211.127988:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569476480 00000100:00100000:0.0:1788572211.128046:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 34 00000100:00100000:0.0:1788572211.128057:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+9:15203:x1875444569476480:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572211.128077:0:192507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572211.128095:0:192507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a370b3600/0x265cfe11109bd642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb278 expref: -99 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.128125:0:192507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a370b3600/0x265cfe11109bd642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb278 expref: 10 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.128136:0:192507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a370b3600/0x265cfe11109bd642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb278 expref: 10 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.128145:0:192507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3600, rc 0) 00000100:00100000:0.0:1788572211.128205:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712ceec8-7c82-4602-bd77-3db1811a6b63+10:15203:x1875444569476480:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 149us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.128212:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 34 00000100:00100000:2.0:1788572211.136266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572211.136310:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569476608 00000100:00100000:2.0:1788572211.136319:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569476608 00000100:00100000:2.0:1788572211.136377:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 35 00000100:00100000:2.0:1788572211.136389:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:15203:x1875444569476608:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.136709:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:15203:x1875444569476608:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 322us (515us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572211.136718:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 35 00000100:00100000:1.0:1788572211.149108:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2396:x1875444567597824:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 120163us (120673us total) trans 326417519807 rc 301/0 00000100:00100000:1.0:1788572211.149123:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 975 10000000:01000000:3.0:1788572211.585507:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572211.585519:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a3f8c3000 from 331 10000000:01000000:3.0:1788572211.585525:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572211.585602:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.585617:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.585631:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572211.585663:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584279680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.585746:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572211.585804:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c537900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.585988:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584279680 00000100:00100000:0.0:1788572211.585997:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584279680 00000100:00100000:0.0:1788572211.586059:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788572211.586070:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:6515:x1875444584279680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572211.586087:0:192507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572211.586113:0:192507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a370b2800/0x265cfe11109bd650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd649 expref: -99 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.586149:0:192507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a370b2800/0x265cfe11109bd650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd649 expref: 11 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.586164:0:192507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a370b2800/0x265cfe11109bd650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd649 expref: 11 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.586175:0:192507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2800, rc 0) 00000100:00100000:0.0:1788572211.586233:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584279680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.586239:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788572211.586668:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584279680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.586687:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.586703:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572211.586805:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584279808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.586852:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572211.586886:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572211.587044:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584279808 00000100:00100000:2.0:1788572211.587050:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584279808 00000100:00100000:2.0:1788572211.587084:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788572211.587092:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584279808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788572211.587123:0:192514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788572211.587143:0:192514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788572211.587147:0:192514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 331 00000100:00100000:2.0:1788572211.587250:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584279808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572211.587257:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788572211.587391:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584279808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788572211.587447:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788572211.587456:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.587467:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572211.587603:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788572211.587606:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a412c6800 from 52 10000000:01000000:1.0:1788572211.587610:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788572211.587636:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.587645:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.587655:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572211.587671:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584279936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.587704:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572211.587916:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.587985:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584279936 00000100:00100000:0.0:1788572211.587991:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584279936 00000100:00100000:0.0:1788572211.588028:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788572211.588036:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584279936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572211.588045:0:192509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572211.588058:0:192509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a370b3800/0x265cfe11109bd65e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd657 expref: -99 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.588084:0:192509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a370b3800/0x265cfe11109bd65e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd657 expref: 12 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.588094:0:192509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a370b3800/0x265cfe11109bd65e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd657 expref: 12 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.588114:0:192509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3800, rc 0) 00000100:00100000:0.0:1788572211.588151:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584279936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.588158:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788572211.588196:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584279936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572211.588209:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd65e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.588217:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd65e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.588274:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.588302:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.588317:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a10d4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.588329:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584280064 00000100:00100000:0.0:1788572211.588333:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584280064 00000100:00100000:0.0:1788572211.588350:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788572211.588355:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584280064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.588465:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584280064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.588475:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788572211.588581:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.588613:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.588657:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.588671:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a10d4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.588684:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584280192 00000100:00100000:0.0:1788572211.588687:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584280192 00000100:00100000:0.0:1788572211.588705:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788572211.588710:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584280192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.589286:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584280192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 573us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.589294:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788572211.589719:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572211.598400:0:192604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788572211.599990:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788572211.600028:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788572211.600040:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd65e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.600053:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd65e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572211.600068:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788572211.600071:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a412c6800 from 328 10000000:01000000:2.0:1788572211.600074:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788572211.600112:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.600121:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.600132:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572211.600159:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.600246:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572211.600292:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904f413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.600349:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584280320 00000100:00100000:1.0:1788572211.600356:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584280320 00000100:00100000:1.0:1788572211.600415:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788572211.600425:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584280320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.600439:0:192514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572211.600452:0:192514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01670400/0x265cfe11109bd66c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd665 expref: -99 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.600522:0:192514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01670400/0x265cfe11109bd66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd665 expref: 13 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.600534:0:192514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01670400/0x265cfe11109bd66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd665 expref: 13 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.600553:0:192514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670400, rc 0) 00000100:00100000:1.0:1788572211.600597:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584280320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.600602:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788572211.600892:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572211.600906:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd66c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.600916:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd66c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572211.600983:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.601024:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572211.601062:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904f413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.601106:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584280448 00000100:00100000:1.0:1788572211.601112:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584280448 00000100:00100000:1.0:1788572211.601176:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788572211.601184:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584280448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788572211.601201:0:192509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788572211.601220:0:192509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788572211.601225:0:192509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788572211.601228:0:192509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788572211.601231:0:192509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788572211.601233:0:192509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 331 00000100:00100000:1.0:1788572211.601327:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584280448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.601335:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788572211.602262:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788572211.602363:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572211.602372:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd66c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.602382:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd66c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572211.602390:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788572211.602393:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1788572211.602396:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788572211.602424:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.602433:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.602442:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572211.602458:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.602522:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572211.602994:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c537900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572211.603066:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584280576 00000100:00100000:2.0:1788572211.603073:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584280576 00000100:00100000:2.0:1788572211.603127:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572211.603136:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584280576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572211.603152:0:192507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572211.603168:0:192507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254800/0x265cfe11109bd67a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd673 expref: -99 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.603199:0:192507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254800/0x265cfe11109bd67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd673 expref: 14 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.603212:0:192507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254800/0x265cfe11109bd67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd673 expref: 14 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.603222:0:192507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254800, rc 0) 00000100:00100000:2.0:1788572211.603266:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584280576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572211.603273:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788572211.603570:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572211.603586:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd67a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.603597:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd67a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572211.603665:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.603694:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572211.603712:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c537900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572211.603906:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584280704 00000100:00100000:2.0:1788572211.603911:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584280704 00000100:00100000:2.0:1788572211.603942:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788572211.603950:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584280704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.604090:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584280704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572211.604098:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788572211.604369:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.604400:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.604447:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572211.604473:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c537900 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.604638:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584280832 00000100:00100000:1.0:1788572211.604644:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584280832 00000100:00100000:0.0:1788572211.606458:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788572211.606471:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584280832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.607863:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584280832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1386us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.607876:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788572211.607990:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572211.608979:0:192605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1788572211.609375:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1788572211.609408:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788572211.609421:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd67a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.609433:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd67a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572211.609448:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788572211.609451:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a412c6800 from 1 10000000:01000000:0.0:1788572211.609454:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788572211.609520:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.609528:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.609538:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.609573:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.609635:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.609679:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.609948:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584280960 00000100:00100000:1.0:1788572211.609956:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584280960 00000100:00100000:1.0:1788572211.610005:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788572211.610015:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584280960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.610028:0:192507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572211.610043:0:192507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01671800/0x265cfe11109bd688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd681 expref: -99 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.610065:0:192507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01671800/0x265cfe11109bd688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd681 expref: 15 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.610076:0:192507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01671800/0x265cfe11109bd688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd681 expref: 15 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.610083:0:192507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671800, rc 0) 00000100:00100000:3.0:1788572211.610297:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584280960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 282us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572211.610305:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788572211.610421:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584280960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.610436:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.610447:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572211.610464:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788572211.610468:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.610474:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572211.610623:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572211.610625:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a412c6800 from 7 10000000:01000000:1.0:1788572211.610629:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572211.610650:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.610658:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.610666:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572211.610683:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.610714:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572211.610834:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584281088 00000100:00100000:3.0:1788572211.610839:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584281088 00000100:00100000:3.0:1788572211.612278:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788572211.612293:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584281088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572211.612310:0:192508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572211.612327:0:192508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590a60ce00/0x265cfe11109bd696 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd68f expref: -99 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.612354:0:192508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590a60ce00/0x265cfe11109bd696 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd68f expref: 16 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.612365:0:192508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590a60ce00/0x265cfe11109bd696 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd68f expref: 16 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.612373:0:192508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60ce00, rc 0) 00000100:00100000:3.0:1788572211.612429:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584281088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572211.612436:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788572211.613639:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.613674:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.613695:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.613712:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572211.613808:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.613865:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572211.613897:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.613926:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584281216 00000100:00100000:1.0:1788572211.613931:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584281216 00000100:00100000:1.0:1788572211.613973:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788572211.613981:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584281216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.614117:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584281216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.614124:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788572211.614162:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.614189:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.614229:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572211.614244:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.614257:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584281344 00000100:00100000:1.0:1788572211.614261:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584281344 00000100:00100000:1.0:1788572211.614285:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788572211.614291:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584281344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.614370:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584281344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.614377:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788572211.614423:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572211.623870:0:192607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788572211.624030:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788572211.624065:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572211.624080:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.624092:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572211.624172:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788572211.624175:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a40f56000 from 52 10000000:01000000:0.0:1788572211.624179:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572211.624219:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.624233:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.624244:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.624270:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.624339:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.624417:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.624748:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584281472 00000100:00100000:1.0:1788572211.624756:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584281472 00000100:00100000:1.0:1788572211.624811:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788572211.624820:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584281472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.624834:0:192507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572211.624849:0:192507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01670e00/0x265cfe11109bd6a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd69d expref: -99 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.624874:0:192507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01670e00/0x265cfe11109bd6a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd69d expref: 17 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.624883:0:192507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01670e00/0x265cfe11109bd6a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd69d expref: 17 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.624892:0:192507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670e00, rc 0) 00000100:00100000:1.0:1788572211.624944:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584281472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.624950:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788572211.625091:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572211.625116:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.625126:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.625182:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.625210:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.625237:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572211.625333:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584281600 00000100:00100000:2.0:1788572211.625338:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584281600 00000100:00100000:2.0:1788572211.625374:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788572211.625382:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584281600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.625531:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584281600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572211.625540:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788572211.625801:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.625835:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.625882:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.625911:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.625948:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584281728 00000100:00100000:1.0:1788572211.625952:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584281728 00000100:00100000:1.0:1788572211.625984:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788572211.625991:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584281728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.626083:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584281728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.626090:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788572211.626215:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572211.627255:0:192608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788572211.627453:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788572211.627474:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788572211.627639:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.627651:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572211.627706:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788572211.627710:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788572211.627713:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788572211.627826:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.627835:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.627844:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572211.627867:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.627927:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572211.627972:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d30b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.628020:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584281856 00000100:00100000:1.0:1788572211.628028:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584281856 00000100:00100000:1.0:1788572211.628072:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788572211.628080:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584281856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.628094:0:192509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572211.628183:0:192509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01671600/0x265cfe11109bd6b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd6ab expref: -99 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.628210:0:192509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01671600/0x265cfe11109bd6b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd6ab expref: 18 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.628222:0:192509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01671600/0x265cfe11109bd6b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd6ab expref: 18 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.628231:0:192509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671600, rc 0) 00000100:00100000:1.0:1788572211.628282:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584281856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.628289:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788572211.628367:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572211.628384:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.628394:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572211.628460:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.628692:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572211.628724:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d30b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.628858:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584281984 00000100:00100000:1.0:1788572211.628863:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584281984 00000100:00100000:1.0:1788572211.628894:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788572211.628902:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584281984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.629070:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584281984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.629077:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788572211.629727:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584281984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.629968:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.630022:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.630056:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.630185:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584282112 00000100:00100000:1.0:1788572211.630191:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584282112 00000100:00100000:1.0:1788572211.630230:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788572211.630239:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584282112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.632386:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584282112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2140us (2354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.632399:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788572211.637850:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572211.643915:0:192610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00010000:00010000:1.0:1788572211.648313:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788572211.648328:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788572211.648369:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788572211.648380:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.648393:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572211.648403:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572211.648406:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a40f56000 from 7 10000000:01000000:1.0:1788572211.648409:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572211.648442:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.648450:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.648461:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572211.648511:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.648587:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572211.648621:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590639bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.648643:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584282240 00000100:00100000:1.0:1788572211.648649:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584282240 00000100:00100000:1.0:1788572211.648693:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788572211.648702:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584282240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.648716:0:192507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572211.649171:0:192507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01671400/0x265cfe11109bd6c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd6b9 expref: -99 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.649202:0:192507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01671400/0x265cfe11109bd6c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd6b9 expref: 19 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.649214:0:192507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01671400/0x265cfe11109bd6c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd6b9 expref: 19 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.649222:0:192507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671400, rc 0) 00000100:00100000:1.0:1788572211.649264:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584282240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 563us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.649272:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788572211.649321:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.649336:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.649345:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572211.649404:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572211.649432:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572211.649450:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590639bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.649612:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584282368 00000100:00100000:0.0:1788572211.649618:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584282368 00000100:00100000:0.0:1788572211.649648:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788572211.649655:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584282368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.649779:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584282368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.649786:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788572211.649822:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.649852:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.649893:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.649914:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a373a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.649927:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584282496 00000100:00100000:0.0:1788572211.649931:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584282496 00000100:00100000:0.0:1788572211.649954:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788572211.649960:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584282496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.650036:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584282496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.650043:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788572211.650084:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572211.651322:0:192612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788572211.651405:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788572211.651424:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572211.651434:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.651444:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572211.651453:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788572211.651456:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e59028fe800 from 52 10000000:01000000:0.0:1788572211.651459:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572211.652618:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.652632:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.652643:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.652667:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.652727:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.654710:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a373a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.656002:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584282624 00000100:00100000:1.0:1788572211.656014:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584282624 00000100:00100000:1.0:1788572211.656779:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788572211.656793:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584282624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.656812:0:192514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572211.656832:0:192514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01671200/0x265cfe11109bd6ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd6c7 expref: -99 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.656862:0:192514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01671200/0x265cfe11109bd6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd6c7 expref: 20 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.656875:0:192514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01671200/0x265cfe11109bd6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd6c7 expref: 20 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.656884:0:192514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671200, rc 0) 00000100:00100000:1.0:1788572211.656971:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584282624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (4243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.656978:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788572211.657063:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572211.657083:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.657093:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572211.657179:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.657214:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572211.662132:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.666192:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584282752 00000100:00100000:0.0:1788572211.666207:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584282752 00000100:00100000:0.0:1788572211.666282:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572211.666293:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584282752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.666508:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584282752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (9292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.666518:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572211.667773:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.667829:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.667884:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.667915:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a373a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.667987:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584282880 00000100:00100000:0.0:1788572211.667991:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584282880 00000100:00100000:0.0:1788572211.668092:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788572211.668100:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a373adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584282880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.668624:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a373adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584282880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 523us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.668632:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788572211.668831:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584282880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572211.670178:0:192614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788572211.670468:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788572211.670534:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572211.670554:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.670567:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572211.670577:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788572211.670580:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788572211.670583:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788572211.670619:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.670626:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.670636:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.670662:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.670721:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.670904:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572211.670997:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584283008 00000100:00100000:1.0:1788572211.671005:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584283008 00000100:00100000:1.0:1788572211.671055:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788572211.671066:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5903931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584283008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572211.671080:0:192507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572211.671094:0:192507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd6dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd6d5 expref: -99 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.671128:0:192507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd6d5 expref: 21 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.671139:0:192507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd6d5 expref: 21 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572211.671148:0:192507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670600, rc 0) 00000100:00100000:1.0:1788572211.671198:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5903931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584283008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572211.671205:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788572211.671339:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572211.671354:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6dc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.671364:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6dc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572211.671441:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.671471:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572211.671527:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.671663:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584283136 00000100:00100000:0.0:1788572211.671668:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584283136 00000100:00100000:0.0:1788572211.671705:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788572211.671713:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1febec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584283136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.671966:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1febec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584283136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.671974:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788572211.672051:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.672083:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.672141:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572211.672172:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.672264:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584283264 00000100:00100000:0.0:1788572211.672268:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584283264 00000100:00100000:0.0:1788572211.672299:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788572211.672306:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584283264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.673171:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584283264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 863us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.673182:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788572211.673311:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572211.675607:0:192615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788572211.675984:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788572211.676013:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788572211.676026:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6dc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.676038:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6dc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572211.676048:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788572211.676050:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e59028fe800 from 7 10000000:01000000:0.0:1788572211.676053:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788572211.676090:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.676109:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.676119:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.676144:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.676208:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.676252:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24517f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572211.676339:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584283392 00000100:00100000:2.0:1788572211.676347:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584283392 00000100:00100000:2.0:1788572211.676398:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788572211.676407:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584283392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572211.676420:0:192514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572211.676435:0:192514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11255000/0x265cfe11109bd6ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd6e3 expref: -99 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.676457:0:192514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11255000/0x265cfe11109bd6ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd6e3 expref: 22 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.676469:0:192514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11255000/0x265cfe11109bd6ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd6e3 expref: 22 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.676887:0:192514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255000, rc 0) 00000100:00100000:2.0:1788572211.676940:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584283392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 533us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572211.676948:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788572211.677026:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572211.677043:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.677052:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.677129:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.677157:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.677193:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24517f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572211.677287:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584283520 00000100:00100000:2.0:1788572211.677292:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584283520 00000100:00100000:2.0:1788572211.677330:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788572211.677338:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584283520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572211.677464:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584283520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572211.677471:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788572211.677715:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.677837:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.677885:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572211.677917:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a2d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.677957:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584283648 00000100:00100000:0.0:1788572211.677962:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584283648 00000100:00100000:0.0:1788572211.677998:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788572211.678006:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584283648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.678093:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584283648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.678199:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788572211.678270:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572211.683643:0:192616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788572211.688230:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788572211.688285:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572211.688297:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.688311:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572211.688321:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788572211.688325:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e5a0efbb380 from 1 10000000:01000000:0.0:1788572211.688328:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788572211.688371:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.688380:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.688393:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572211.688420:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.689207:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572211.689294:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24517f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572211.693220:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584283776 00000100:00100000:2.0:1788572211.693239:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584283776 00000100:00100000:2.0:1788572211.693306:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788572211.693316:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584283776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572211.693335:0:192507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572211.693356:0:192507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11255400/0x265cfe11109bd6f8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd6f1 expref: -99 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.693387:0:192507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11255400/0x265cfe11109bd6f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd6f1 expref: 23 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.693400:0:192507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11255400/0x265cfe11109bd6f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd6f1 expref: 23 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572211.693410:0:192507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255400, rc 0) 00000100:00100000:2.0:1788572211.693519:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584283776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572211.693526:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788572211.695673:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572211.695699:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6f8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.695711:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6f8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572211.695747:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788572211.695753:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6f8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.695761:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6f8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572211.695771:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788572211.695774:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5a0efbb380 from 1 10000000:01000000:3.0:1788572211.695776:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788572211.695812:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.695820:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.695829:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572211.695851:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.695908:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572211.695953:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a2d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.696049:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584283904 00000100:00100000:0.0:1788572211.696058:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584283904 00000100:00100000:0.0:1788572211.696115:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788572211.696124:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a01326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584283904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572211.696136:0:192514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572211.696149:0:192514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a370b3400/0x265cfe11109bd706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd6ff expref: -99 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.696168:0:192514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a370b3400/0x265cfe11109bd706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd6ff expref: 24 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.696178:0:192514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a370b3400/0x265cfe11109bd706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd6ff expref: 24 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572211.696186:0:192514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b3400, rc 0) 00000100:00100000:0.0:1788572211.696221:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a01326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584283904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572211.696227:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788572211.698136:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584283904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572211.698166:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd706 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.698178:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd706 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572211.698266:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584284032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572211.698323:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572211.698369:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a2d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788572211.698513:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584284032 00000100:00100000:0.0:1788572211.698520:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584284032 00000100:00100000:0.0:1788572211.698574:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788572211.698584:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a01325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584284032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572211.698668:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a01325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584284032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (345us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572211.698676:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788572211.699179:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584284032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788572211.699209:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788572211.699216:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd706 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572211.699225:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd706 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572212.092962:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584284160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572212.093046:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572212.093119:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584284160 00000100:00100000:0.0:1788572212.093127:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584284160 00000100:00100000:0.0:1788572212.093179:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6247 00000100:00100000:0.0:1788572212.093188:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584284160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572212.093220:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572212.093265:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584284160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572212.093272:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6247 00000100:00080000:0.0:1788572212.093297:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572212.094578:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584284160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572212.096808:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584284288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572212.096885:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572212.096929:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584284288 00000100:00100000:2.0:1788572212.096937:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584284288 00000100:00100000:2.0:1788572212.097128:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6248 00000100:00100000:2.0:1788572212.097139:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584284288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572212.097171:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00080000:0.0:1788572212.097244:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572212.099173:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584284288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2028us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572212.099185:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6248 00000100:00100000:3.0:1788572212.099223:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584284288:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572212.668667:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572213.693857:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572214.123303:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572214.123397:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572214.123433:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572214.123571:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569476992 00000100:00100000:1.0:1788572214.123581:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569476992 00000100:00100000:1.0:1788572214.123642:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7634 00000100:00100000:1.0:1788572214.123652:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569476992:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572214.123736:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569476992:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 85us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572214.123744:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7634 00000100:00080000:3.0:1788572214.124337:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572214.124782:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569476736 00000100:00100000:2.0:1788572214.124790:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569476736 00000100:00100000:2.0:1788572214.124842:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 71 00000100:00100000:2.0:1788572214.124851:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569476736:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572214.124897:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569476736:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 47us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572214.124907:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 71 00000100:00100000:2.0:1788572214.124939:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569476864 00000100:00100000:2.0:1788572214.124944:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569476864 00000100:00100000:2.0:1788572214.124981:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 186 00000100:00100000:2.0:1788572214.124988:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569476864:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572214.125018:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569476864:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572214.125025:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 186 00000100:00080000:2.0:1788572214.125187:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788572214.716814:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572214.905139:0:192788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788572215.166576:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572215.166584:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572215.166588:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572215.166596:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8962 00000100:00080000:1.0:1788572215.166602:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572215.166608:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572215.166630:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3f8f0000 x1875444584284544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572215.166666:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584284544:0@lo:38:kworker.0 00000100:00080000:1.0:1788572215.166669:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572215.166672:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1788572215.166735:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572215.166792:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584284544 00000100:00100000:3.0:1788572215.166799:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584284544 00000100:00080000:1.0:1788572215.166830:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788572215.166834:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00080000:1.0:1788572215.166836:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8962 00000100:00080000:1.0:1788572215.166838:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788572215.166841:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584284544:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1788572215.166842:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5a0a15c800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572215.166855:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3f8f1880 x1875444584284800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:3.0:1788572215.166868:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8968 last 0 00000100:00100000:2.0:1788572215.166896:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584284800:0@lo:38:kworker.0 00000020:00000080:3.0:1788572215.166905:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x265cfe11109bd70d 00000004:00100000:3.0:1788572215.166920:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788572215.166924:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572215.166971:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572215.166976:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572215.166978:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572215.166982:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8962 00000100:00080000:1.0:1788572215.166984:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572215.166988:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572215.167000:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4143ad80 x1875444584285056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572215.167034:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584285056:0@lo:38:kworker.0 00000100:00100000:2.0:1788572215.167073:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572215.167110:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584284800 00000100:00100000:2.0:1788572215.167114:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584284800 00000100:00100000:2.0:1788572215.167134:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1788572215.167139:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584284800:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788572215.167167:0:188833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8968 last 0 00000020:00000080:2.0:1788572215.167191:0:188833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x265cfe11109bd714 00000004:00100000:2.0:1788572215.167197:0:188833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572215.167223:0:188833:0:(import.c:65:import_set_state_nolock()) ffff8e59059d2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572215.167269:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875444584284800:12345-0@lo:38:kworker.0 Request processed in 129us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572215.167276:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00010000:00080000:2.0:1788572215.167314:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a3f8f1880 x1875444584284800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572215.167324:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e590cac1000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788572215.167327:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 79 00000100:00100000:3.0:1788572215.167352:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875444584284544:12345-0@lo:38:kworker.0 Request processed in 510us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572215.167359:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1788572215.167383:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584285056 00000100:00100000:3.0:1788572215.167386:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584285056 00000100:00100000:3.0:1788572215.167404:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788572215.167409:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584285056:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788572215.167423:0:188053:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8e5a0f059000, cookie 0x265cfe11109bd570 00010000:00080000:3.0:1788572215.167427:0:188053:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8e5a0f059000 cur 8968 last 1788572209 00000004:00100000:3.0:1788572215.167436:0:188053:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572215.167449:0:188053:0:(import.c:65:import_set_state_nolock()) ffff8e590cac4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572215.167512:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584285056:12345-0@lo:38:kworker.0 Request processed in 102us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572215.167519:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00080000:2.0:1788572215.168108:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8e5a3f8f1880 x1875444584284800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572230 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572215.168117:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788572215.168121:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788572215.168124:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788572215.168130:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584284800:0@lo:38:kworker.0 00010000:00080000:2.0:1788572215.168148:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a3f8f0000 x1875444584284544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572215.168159:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 79 00000100:00080000:2.0:1788572215.168936:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8e5a3f8f0000 x1875444584284544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572230 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572215.168944:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788572215.168948:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788572215.168951:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788572215.168955:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584284544:0@lo:38:kworker.0 00000100:00080000:2.0:1788572215.168991:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 79 00000100:00080000:2.0:1788572215.168998:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788572215.169002:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788572215.169004:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 326417519069 gen 2 00000100:00080000:2.0:1788572215.169008:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a1f80e800 from lustre-MDT0000_UUID committed 326417519069 last 0 00000100:00080000:2.0:1788572215.169010:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788572215.169340:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584285056:0@lo:38:kworker.0 00010000:00080000:2.0:1788572215.169364:0:192805:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788572215.169368:0:192805:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788572215.169373:0:192805:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1788572215.169861:0:192805:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788572215.169901:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584285184:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788572215.169960:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572215.170264:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572215.170267:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1788572215.170268:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584285184 00000100:00080000:1.0:1788572215.170271:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788572215.170274:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584285184 00000100:00080000:1.0:1788572215.170275:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8962 00000100:00080000:1.0:1788572215.170280:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572215.170284:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572215.170300:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4143aa00 x1875444584285696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572215.170313:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788572215.170321:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584285184:12345-0@lo:400:ldlm_lock_repla.0 00000100:00080000:1.0:1788572215.170326:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788572215.170328:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572215.170330:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a37118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572215.170334:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e5a37118000 using connection 192.168.202.157@tcp/0@lo 00010000:00080000:3.0:1788572215.170339:0:189111:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e5a40521c00 x1875444584285184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:631/0 lens 224/0 e 0 to 0 dl 1788572226 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572215.170343:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4143ad80 x1875444584286208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572215.170350:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584285184:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 30us (390us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.170356:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788572215.170366:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584284416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572215.170403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572215.170442:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584285568:0@lo:400:kworker.0 00000100:00100000:3.0:1788572215.170467:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584284416 00000100:00100000:1.0:1788572215.170468:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572215.170471:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584284416 00000100:00100000:1.0:1788572215.170521:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788572215.170523:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788572215.170527:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584285312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572215.170529:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584284416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572215.170548:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572215.170569:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584285440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572215.170575:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584284416:12345-0@lo:400:kworker.0 Request processed in 47us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572215.170581:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788572215.170587:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572215.170603:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584286080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572215.170624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572215.170651:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584284416:0@lo:400:kworker.0 00000100:00100000:3.0:1788572215.170678:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584285440 00000100:00100000:3.0:1788572215.170682:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584285440 00000100:00100000:3.0:1788572215.170704:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788572215.170709:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584285440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572215.170733:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1788572215.170769:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584285440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572215.170775:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788572215.170807:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584285440:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788572215.170815:0:192536:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788572215.170821:0:192536:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 335007449093 00000020:00080000:2.0:1788572215.170826:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.170830:0:192536:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449093 00000020:00080000:2.0:1788572215.170834:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.170836:0:192536:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449093 00000100:00100000:2.0:1788572215.170852:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584284928:0@lo:400:kworker.0 00000100:00100000:2.0:1788572215.170883:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572215.170914:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584285952:0@lo:400:kworker.0 00000100:00100000:2.0:1788572215.170933:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572215.170950:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572215.170956:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584284672:0@lo:400:kworker.0 00000100:00100000:2.0:1788572215.170977:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572215.170994:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584285824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572215.171016:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572215.171041:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584284928 00000100:00100000:2.0:1788572215.171044:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584284672 00000100:00100000:3.0:1788572215.171045:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584284928 00000100:00100000:3.0:1788572215.171083:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788572215.171090:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584284928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572215.171127:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584284672 00000100:00100000:2.0:1788572215.171244:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788572215.171252:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584284672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572215.171313:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584285568 00000100:00100000:1.0:1788572215.171317:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584285568 00000100:00100000:3.0:1788572215.172220:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584284928:12345-0@lo:400:kworker.0 Request processed in 1127us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572215.172231:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788572215.172248:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584284672:12345-0@lo:400:kworker.0 Request processed in 997us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572215.172254:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788572215.172257:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584285824 00000100:00100000:3.0:1788572215.172261:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584285824 00000100:00100000:2.0:1788572215.172277:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584285696:0@lo:38:kworker.0 00000100:00100000:2.0:1788572215.172315:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572215.172331:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788572215.172335:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584286208:0@lo:38:kworker.0 00000100:00100000:3.0:1788572215.172338:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584285824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572215.172361:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572215.172372:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584285824:12345-0@lo:400:kworker.0 Request processed in 35us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572215.172378:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788572215.172425:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584285696 00000100:00100000:2.0:1788572215.172429:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584285696 00000100:00100000:2.0:1788572215.172440:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584286208 00000100:00100000:2.0:1788572215.172442:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584286208 00000100:00100000:2.0:1788572215.172451:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1788572215.172455:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584285696:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788572215.172504:0:188049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8968 last 0 00000020:00000080:2.0:1788572215.172542:0:188049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x265cfe11109bd71b 00000004:00100000:2.0:1788572215.172557:0:188049:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572215.172591:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e59059d5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572215.172628:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875444584285696:12345-0@lo:38:kworker.0 Request processed in 171us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572215.172634:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1788572215.172645:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1788572215.172648:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584286208:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788572215.172661:0:188049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8968 last 0 00000020:00000080:2.0:1788572215.172766:0:188049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x265cfe11109bd722 00000004:00100000:2.0:1788572215.172773:0:188049:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572215.172786:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e5906855800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572215.172812:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584286208:12345-0@lo:38:kworker.0 Request processed in 162us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572215.172818:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00010000:00080000:2.0:1788572215.172848:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4143aa00 x1875444584285696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572215.172862:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 79 00000100:00100000:1.0:1788572215.173244:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584285312 00000100:00100000:1.0:1788572215.173250:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584285312 00000100:00100000:1.0:1788572215.173282:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584286080 00000100:00100000:1.0:1788572215.173285:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584286080 00000100:00100000:1.0:1788572215.173301:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584285952 00000100:00100000:1.0:1788572215.173304:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584285952 00000100:00100000:1.0:1788572215.173324:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7635 00000100:00100000:1.0:1788572215.173330:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584285568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572215.173371:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584285568:12345-0@lo:400:kworker.0 Request processed in 42us (2902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572215.173377:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7635 00000100:00100000:1.0:1788572215.173388:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7636 00000100:00100000:1.0:1788572215.173394:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584285312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572215.173419:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584285312:12345-0@lo:400:kworker.0 Request processed in 26us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572215.173425:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7636 00000100:00100000:1.0:1788572215.173434:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7637 00000100:00100000:1.0:1788572215.173439:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584286080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572215.173462:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584286080:12345-0@lo:400:kworker.0 Request processed in 23us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572215.173467:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7637 00000100:00100000:1.0:1788572215.173475:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7638 00000100:00100000:1.0:1788572215.173507:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584285952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572215.173531:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584285952:12345-0@lo:400:kworker.0 Request processed in 25us (2597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572215.173536:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7638 00000100:00080000:3.0:1788572215.176195:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572215.176202:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572215.176206:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572215.176256:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8e5a4143aa00 x1875444584285696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572230 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572215.176269:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788572215.176274:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572215.176277:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584285312:0@lo:400:kworker.0 00000100:02000000:2.0:1788572215.176278:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788572215.176283:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584285696:0@lo:38:kworker.0 00000100:00100000:3.0:1788572215.176291:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584286080:0@lo:400:kworker.0 00010000:00080000:2.0:1788572215.176301:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4143ad80 x1875444584286208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572215.176302:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584285568:0@lo:400:kworker.0 00000100:00080000:2.0:1788572215.176315:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 79 00000100:00080000:2.0:1788572215.176323:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788572215.176328:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788572215.176329:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a37118000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788572215.176333:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584286208:0@lo:38:kworker.0 00000100:00100000:2.0:1788572215.176569:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584284672:0@lo:400:kworker.0 00000100:00100000:2.0:1788572215.176583:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584285824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572215.176597:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584284928:0@lo:400:kworker.0 00000100:00100000:2.0:1788572215.176611:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584285952:0@lo:400:kworker.0 00010000:00010000:3.0:1788572215.740773:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788572215.846445:0:192841:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788572215.846717:0:192841:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788572216.171601:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572216.171658:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572216.171687:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572216.171754:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569477120 00000100:00100000:1.0:1788572216.171765:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569477120 00000100:00100000:1.0:1788572216.171826:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 73 00000100:00100000:1.0:1788572216.171837:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569477120:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572216.171919:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569477120:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572216.171926:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 73 00000100:00100000:3.0:1788572216.172186:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569477248 00000100:00100000:3.0:1788572216.172191:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569477248 00000100:00080000:2.0:1788572216.172252:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572216.172297:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 189 00000100:00100000:3.0:1788572216.172305:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569477248:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572216.172341:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569477248:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 37us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572216.172347:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 189 00000100:00100000:3.0:1788572216.172371:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569477376 00000100:00100000:3.0:1788572216.172375:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569477376 00000100:00100000:3.0:1788572216.172418:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7639 00000100:00100000:3.0:1788572216.172426:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569477376:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572216.172456:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569477376:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572216.172462:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7639 00000100:00080000:0.0:1788572216.173360:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788572216.190792:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788572216.192900:0:184840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788572216.208620:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788572216.765677:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788572216.993709:0:192891:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788572216.993953:0:192891:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788572217.212953:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572217.212969:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584286336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572217.213044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.213089:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584286336 00000100:00100000:3.0:1788572217.213096:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584286336 00000100:00100000:3.0:1788572217.213149:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6249 00000100:00100000:3.0:1788572217.213158:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584286336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572217.213188:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572217.213234:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584286336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572217.213241:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6249 00000100:00080000:3.0:1788572217.213264:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572217.213296:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584286336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572217.213800:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584286464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572217.213839:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.213872:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584286464 00000100:00100000:3.0:1788572217.213877:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584286464 00000100:00100000:3.0:1788572217.213921:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6250 00000100:00100000:3.0:1788572217.213933:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584286464:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788572217.213943:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788572217.213960:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572217.214008:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584286464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572217.214083:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584286464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572217.223371:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6250 00010000:00010000:1.0:1788572217.788684:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572218.812741:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572219.837812:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572220.290388:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572220.290396:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1788572220.292476:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584286720:0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.292661:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572220.292754:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584287232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.292782:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572220.292814:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584287744:0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.292836:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572220.292863:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572220.292871:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584286848:0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.292895:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572220.292912:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584287360:0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.292932:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572220.292955:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584287872:0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.292978:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572220.293017:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584287232 00000100:00100000:0.0:1788572220.293025:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584287232 00000100:00100000:0.0:1788572220.293079:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584287744 00000100:00100000:0.0:1788572220.293083:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584287744 00000100:00100000:0.0:1788572220.293100:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584287360 00000100:00100000:0.0:1788572220.293103:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584287360 00000100:00100000:0.0:1788572220.293120:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584287872 00000100:00100000:0.0:1788572220.293123:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584287872 00000100:00100000:0.0:1788572220.293143:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7640 00000100:00100000:0.0:1788572220.293152:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584287232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.293204:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584287232:12345-0@lo:400:kworker.0 Request processed in 53us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572220.293211:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7640 00000100:00100000:0.0:1788572220.293232:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7641 00000100:00100000:0.0:1788572220.293238:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584287744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.293267:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584287744:12345-0@lo:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572220.293273:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7641 00000100:00100000:0.0:1788572220.293285:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7642 00000100:00100000:0.0:1788572220.293292:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584287360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.293322:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584287360:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572220.293328:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7642 00000100:00100000:0.0:1788572220.293339:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7643 00000100:00100000:0.0:1788572220.293345:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584287872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.293369:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584287872:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572220.293374:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7643 00000100:00080000:0.0:1788572220.293392:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572220.293395:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572220.293451:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584287360:0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.293464:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584287872:0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.293473:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584287232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572220.293512:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584287744:0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294103:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584286592:0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294146:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572220.294177:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584287104:0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294202:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572220.294225:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584287616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294249:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572220.294268:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584288128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572220.294289:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572220.294311:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572220.294318:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584286976:0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294341:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572220.294362:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584287488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294383:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572220.294396:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584288000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294434:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572220.294471:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584286720 00000100:00100000:1.0:1788572220.294475:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584286720 00000100:00100000:1.0:1788572220.294525:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584286848 00000100:00100000:1.0:1788572220.294529:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584286848 00000100:00100000:1.0:1788572220.294551:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584287104 00000100:00100000:1.0:1788572220.294553:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584287104 00000100:00100000:2.0:1788572220.294610:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584287616 00000100:00100000:2.0:1788572220.294615:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584287616 00000100:00100000:2.0:1788572220.294639:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584288128 00000100:00100000:2.0:1788572220.294642:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584288128 00000100:00100000:1.0:1788572220.294646:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584286976 00000100:00100000:1.0:1788572220.294649:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584286976 00000100:00100000:2.0:1788572220.294654:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788572220.294659:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584287488 00000100:00100000:1.0:1788572220.294661:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584287488 00000100:00100000:2.0:1788572220.294663:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584287616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294670:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584288000 00000100:00100000:1.0:1788572220.294672:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584288000 00000100:00100000:1.0:1788572220.294682:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788572220.294686:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584286720:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788572220.294699:0:188049:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a1ff84000 x1875444584286720/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:636/0 lens 224/0 e 0 to 0 dl 1788572231 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572220.294712:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584287616:12345-0@lo:400:kworker.0 Request processed in 51us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572220.294718:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788572220.294732:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788572220.294736:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584286720:12345-0@lo:400:kworker.0 Request processed in 49us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572220.294738:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584288128:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572220.294742:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000004:00000024:2.0:1788572220.294760:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572220.294767:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788572220.294773:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584286848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572220.294790:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584288128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572220.294796:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788572220.294797:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584286848:12345-0@lo:400:kworker.0 Request processed in 25us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572220.294802:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788572220.294811:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788572220.294816:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584287104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572220.294829:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584287616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294841:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584287104:12345-0@lo:400:kworker.0 Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572220.294843:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584288128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572220.294847:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788572220.294857:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788572220.294863:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584286976:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788572220.294870:0:188049:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e590d87e680 x1875444584286976/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:636/0 lens 224/0 e 0 to 0 dl 1788572231 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572220.294899:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584286976:12345-0@lo:400:kworker.0 Request processed in 37us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572220.294905:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788572220.294916:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788572220.294922:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584287488:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788572220.294929:0:188049:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a27261180 x1875444584287488/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:636/0 lens 224/0 e 0 to 0 dl 1788572231 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788572220.294948:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36eafb80 x1875444584286976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572220.294957:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584287488:12345-0@lo:400:kworker.0 Request processed in 36us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572220.294958:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584286976:0@lo:400:kworker.0 00000100:00100000:1.0:1788572220.294963:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788572220.294974:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788572220.294979:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584288000:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788572220.294986:0:188049:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a27261500 x1875444584288000/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:636/0 lens 224/0 e 0 to 0 dl 1788572231 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572220.295015:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584288000:12345-0@lo:400:kworker.0 Request processed in 36us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572220.295021:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00080000:2.0:1788572220.295041:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36ead180 x1875444584287488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572220.295052:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572220.295052:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584287488:0@lo:400:kworker.0 00010000:00080000:2.0:1788572220.295065:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4143aa00 x1875444584288000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572220.295071:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584286848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572220.295072:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584288000:0@lo:400:kworker.0 00000100:00100000:2.0:1788572220.295081:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584287104:0@lo:400:kworker.0 00010000:00080000:1.0:1788572220.295082:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36eaf800 x1875444584286720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572220.295090:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584286720:0@lo:400:kworker.0 00000100:00100000:3.0:1788572220.295753:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584286592 00000100:00100000:3.0:1788572220.295762:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584286592 00000100:00100000:3.0:1788572220.295818:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788572220.295827:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584286592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572220.295963:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584286592:12345-0@lo:400:kworker.0 Request processed in 137us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572220.296039:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788572220.298748:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584286592:0@lo:400:kworker.0 00010000:00010000:3.0:1788572220.860731:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572221.291170:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572221.291284:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569477632 00000100:00100000:1.0:1788572221.291295:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569477632 00000100:00100000:1.0:1788572221.291358:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 75 00000100:00100000:1.0:1788572221.291368:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569477632:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572221.291523:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569477632:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572221.291532:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 75 00000100:00100000:3.0:1788572221.304240:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572221.304387:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569477760 00000100:00100000:1.0:1788572221.304416:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569477760 00000100:00100000:1.0:1788572221.304519:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 196 00000100:00100000:1.0:1788572221.304530:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569477760:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572221.304620:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569477760:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 90us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572221.304627:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 196 00000100:00080000:0.0:1788572221.305351:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572221.332094:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572221.332203:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569477888 00000100:00100000:1.0:1788572221.332212:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569477888 00000100:00100000:1.0:1788572221.332288:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7644 00000100:00100000:1.0:1788572221.332299:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569477888:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572221.332379:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569477888:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 82us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572221.332387:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7644 00000100:00080000:0.0:1788572221.332456:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572221.886534:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572222.335346:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572222.335373:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584288256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572222.335465:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572222.336964:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572222.336984:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584288384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572222.337042:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572222.337225:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584288256 00000100:00100000:3.0:1788572222.337234:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584288256 00000100:00100000:3.0:1788572222.337296:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584288384 00000100:00100000:3.0:1788572222.337300:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584288384 00000100:00100000:3.0:1788572222.337320:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6251 00000100:00100000:3.0:1788572222.337329:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584288256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572222.337359:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572222.337417:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584288256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572222.337435:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6251 00000100:00100000:3.0:1788572222.337456:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6252 00000100:00100000:3.0:1788572222.337462:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584288384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572222.337504:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00080000:0.0:1788572222.337647:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572222.337652:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572222.337733:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584288384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 270us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572222.337740:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6252 00000100:00100000:0.0:1788572222.337823:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584288384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572222.339942:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584288256:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572222.908638:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572223.942635:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572224.956765:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572225.404783:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584288512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572225.404858:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572225.405350:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584288512 00000100:00100000:3.0:1788572225.405360:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584288512 00000100:00080000:2.0:1788572225.405841:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572225.405845:0:186041:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1788572225.405953:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584288768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572225.406012:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572225.406086:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584288768 00000100:00100000:2.0:1788572225.406090:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584288768 00000100:00100000:3.0:1788572225.406178:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788572225.406189:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584288512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572225.406224:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1788572225.406286:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584288512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572225.406293:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788572225.410465:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584288640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.410586:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572225.410623:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584288896:0@lo:400:kworker.0 00000100:00100000:3.0:1788572225.410675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572225.422239:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584289280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572225.426162:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572225.426272:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584289792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572225.426363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572225.426448:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584289280 00000100:00100000:0.0:1788572225.426460:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584289280 00000100:00100000:1.0:1788572225.426517:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584289152:0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.426567:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572225.426592:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4101a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584289664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.426617:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572225.426639:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788572225.426646:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584289024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.426679:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572225.426746:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584289792 00000100:00100000:0.0:1788572225.426751:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584289792 00000100:00100000:0.0:1788572225.426776:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584289664 00000100:00100000:0.0:1788572225.426779:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584289664 00000100:00100000:0.0:1788572225.426801:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7645 00000100:00100000:0.0:1788572225.426810:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584289280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572225.426865:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584289280:12345-0@lo:400:kworker.0 Request processed in 55us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572225.426874:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7645 00000100:00100000:0.0:1788572225.426894:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7646 00000100:00100000:1.0:1788572225.426898:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584289536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572225.426906:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584289792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572225.426934:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584289792:12345-0@lo:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572225.426940:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7646 00000100:00100000:0.0:1788572225.426951:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7647 00000100:00100000:0.0:1788572225.426956:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584289664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572225.426982:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584289664:12345-0@lo:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572225.426988:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7647 00000100:00100000:1.0:1788572225.427041:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572225.427077:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4101a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584289664:0@lo:400:kworker.0 00000100:00080000:0.0:1788572225.427100:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572225.427106:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572225.427114:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584288640 00000100:00100000:1.0:1788572225.427120:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584288640 00000100:00100000:0.0:1788572225.427150:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584288512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572225.427161:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788572225.427172:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584288640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572225.427187:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584289280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572225.427200:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584289792:0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.427222:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584288640:12345-0@lo:400:kworker.0 Request processed in 51us (16634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572225.427230:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788572225.427267:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584288896 00000100:00100000:1.0:1788572225.427272:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584288896 00000100:00100000:2.0:1788572225.430133:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584289152 00000100:00100000:2.0:1788572225.430149:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584289152 00000100:00100000:0.0:1788572225.430447:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584289024 00000100:00100000:0.0:1788572225.430453:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584289024 00000100:00100000:3.0:1788572225.432280:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584289408:0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.434189:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584289536 00000100:00100000:1.0:1788572225.434203:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584289536 00000100:00100000:1.0:1788572225.434251:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788572225.434263:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584288768:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788572225.434282:0:188050:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a1fdf4e00 x1875444584288768/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1788572236 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572225.434394:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584288768:12345-0@lo:400:kworker.0 Request processed in 135us (28381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572225.434402:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788572225.434418:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788572225.434424:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584288896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.434453:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584288896:12345-0@lo:400:kworker.0 Request processed in 30us (23778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572225.434458:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788572225.434469:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788572225.434475:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584289536:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788572225.434497:0:188050:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a1ffa7800 x1875444584289536/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1788572236 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572225.434526:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584289536:12345-0@lo:400:kworker.0 Request processed in 52us (7487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572225.434532:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788572225.436743:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572225.436807:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4101b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584289920:0@lo:400:kworker.0 00000100:00100000:3.0:1788572225.436848:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572225.436941:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788572225.436991:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36947800 x1875444584289536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572225.437005:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584289536:0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.437020:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584288640:0@lo:400:kworker.0 00010000:00080000:1.0:1788572225.437065:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1ff85880 x1875444584288768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572225.437075:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584288768:0@lo:400:kworker.0 00000100:00100000:3.0:1788572225.441134:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584288896:0@lo:400:kworker.0 00000100:00100000:3.0:1788572225.441203:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584289408 00000100:00100000:3.0:1788572225.441209:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584289408 00000100:00100000:3.0:1788572225.441281:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7648 00000100:00100000:3.0:1788572225.441290:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584289408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572225.443207:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584289408:12345-0@lo:400:kworker.0 Request processed in 1909us (6461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572225.443222:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7648 00000100:00080000:3.0:1788572225.443297:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572225.449308:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584289920 00000100:00100000:1.0:1788572225.449325:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584289920 00000100:00100000:1.0:1788572225.449405:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788572225.449417:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584289152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.449541:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584289152:12345-0@lo:400:kworker.0 Request processed in 126us (22973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572225.450108:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788572225.450136:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788572225.450145:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584289024:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788572225.450159:0:188833:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a1ffa6680 x1875444584289024/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1788572236 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572225.450203:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584289024:12345-0@lo:400:kworker.0 Request processed in 61us (23534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572225.450210:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788572225.450226:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788572225.450232:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584289920:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788572225.450243:0:188833:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8e5a4143aa00 x1875444584289920/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:641/0 lens 224/0 e 0 to 0 dl 1788572236 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572225.450275:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584289920:12345-0@lo:400:kworker.0 Request processed in 44us (13426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572225.450281:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:1.0:1788572225.450344:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36947b80 x1875444584289024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572225.450358:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584289024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.450372:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584289152:0@lo:400:kworker.0 00000100:00100000:1.0:1788572225.450437:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584289408:0@lo:400:kworker.0 00010000:00080000:1.0:1788572225.450448:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4101b800 x1875444584289920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572225.450457:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4101b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584289920:0@lo:400:kworker.0 00010000:00010000:3.0:1788572225.980739:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572226.412391:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572226.412644:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572226.412685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572226.412698:0:192514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569478016 00000100:00100000:2.0:1788572226.412708:0:192514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569478016 00000100:00100000:1.0:1788572226.412776:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569478144 00000100:00100000:1.0:1788572226.412780:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569478144 00000100:00100000:2.0:1788572226.412819:0:192514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 77 00000100:00100000:2.0:1788572226.412831:0:192514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569478016:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572226.412837:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 203 00000100:00100000:1.0:1788572226.412844:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569478144:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572226.412900:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569478144:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 55us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572226.412907:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 203 00000100:00100000:0.0:1788572226.412919:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569478272 00000100:00100000:0.0:1788572226.412923:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569478272 00000100:00100000:0.0:1788572226.412955:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7649 00000100:00100000:0.0:1788572226.412961:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569478272:12345-192.168.202.57@tcp:400:kworker.0 00000100:00080000:3.0:1788572226.415186:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572226.415198:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572226.417097:0:192514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569478016:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 4251us (4436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572226.417114:0:192514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 77 00000100:00100000:0.0:1788572226.417581:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569478272:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 4615us (4891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572226.417592:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7649 00000100:00100000:3.0:1788572226.441928:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572226.442786:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569478400 00000100:00100000:0.0:1788572226.442800:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569478400 00000100:00100000:0.0:1788572226.442884:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 204 00000100:00100000:0.0:1788572226.442896:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569478400:12345-192.168.202.57@tcp:38:ptlrpcd_rcv.0 00010000:02000400:0.0:1788572226.442932:0:188049:0:(ldlm_lib.c:974:target_handle_reconnect()) lustre-MDT0000: Client 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d (at 192.168.202.57@tcp) reconnected, waiting for 2 clients in recovery for 0:55 00010000:00080000:0.0:1788572226.460771:0:188049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp recovering/t326417519807 exp ffff8e5a0f05e800 cur 8979 last 1788572226 00000004:00100000:0.0:1788572226.460811:0:188049:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.57@tcp supports cksum type f7, return f7 00000100:00080000:0.0:1788572226.460839:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e59059d2800 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1788572226.460849:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e59059d2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572226.461149:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569478400:12345-192.168.202.57@tcp:38:ptlrpcd_rcv.0 Request processed in 18253us (19234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572226.461161:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 204 00000100:00100000:1.0:1788572226.465428:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572226.470356:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444567597824 00000100:00100000:2.0:1788572226.470376:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444567597824 00000100:00100000:2.0:1788572226.470520:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 980 00000100:00100000:2.0:1788572226.470533:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444567597824:12345-192.168.202.57@tcp:101:lfs.0 00010000:00080000:2.0:1788572226.470552:0:188833:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449093, current: 326417519807, replaying 00010000:00010000:2.0:1788572226.470564:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572226.470595:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd729 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25aed8a expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572226.470660:0:188833:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff8e5a1ffa4e00 x1875444567597824/t0(326417519807) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 520/3488 e 0 to 0 dl 1788572237 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00000400:2.0:1788572226.470671:0:188833:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff8e5a1ffa4e00 x1875444567597824/t326417519807(326417519807) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 520/3488 e 0 to 0 dl 1788572237 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00200000:3.0:1788572226.506328:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1b8b:0x0]: returning size 4096 00010000:00010000:3.0:1788572226.506386:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd729 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 7 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.506405:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a18b3f500) 00010000:00010000:3.0:1788572226.506408:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572226.506414:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 7 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.506441:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255a00, rc 0) 00000100:00100000:3.0:1788572226.506551:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444567597824:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 36018us (41131us total) trans 326417519807 rc 301/301 00000100:00100000:3.0:1788572226.506561:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 980 00000100:00100000:3.0:1788572226.522399:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572226.522633:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569468032 00000100:00100000:2.0:1788572226.522644:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569468032 00000100:00100000:2.0:1788572226.522720:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 981 00000100:00100000:2.0:1788572226.522731:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569468032:12345-192.168.202.57@tcp:101:multiop.0 00010000:00080000:2.0:1788572226.522753:0:188048:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449093, current: 335007449091, replaying 00010000:00010000:2.0:1788572226.522763:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572226.522785:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bd730 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb239 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572226.522993:0:188048:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x203f:0x0], cookie = 0x265cfe11109bd44a 00000004:00080000:2.0:1788572226.522997:0:188048:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x265cfe11109bd44a in new mfd 00010000:00010000:2.0:1788572226.523430:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bd730 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb239 expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.523448:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a18b3f800) 00010000:00010000:2.0:1788572226.523451:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572226.523457:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bd730 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb239 expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.523533:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254600, rc 0) 00000100:00100000:2.0:1788572226.523589:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2396:x1875444569468032:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 860us (1200us total) trans 335007449091 rc 301/301 00000100:00100000:2.0:1788572226.523596:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 981 00000100:00100000:2.0:1788572226.526001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572226.526122:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569469440 00000100:00100000:1.0:1788572226.526132:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569469440 00000100:00100000:1.0:1788572226.526199:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 982 00000100:00100000:1.0:1788572226.526210:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2396:x1875444569469440:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00080000:1.0:1788572226.526232:0:188050:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449093, current: 335007449093, replaying 00000100:00100000:1.0:1788572226.526252:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2396:x1875444569469440:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 45us (261us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572226.526258:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 982 00000020:00080000:2.0:1788572226.526376:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572226.526381:0:192536:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 335007449093, next_transno: 335007449093 00010000:00080000:2.0:1788572226.526385:0:192536:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (335007449093) 00000020:00080000:2.0:1788572226.526388:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572226.526397:0:192536:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569469440 t335007449093 from 192.168.202.57@tcp req@ffff8e5a41018380 x1875444569469440/t0(335007449093) o36->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 528/0 e 0 to 0 dl 1788572237 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572226.526607:0:192536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.526623:0:192536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.526638:0:192536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.526652:0:192536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.526659:0:192536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.526666:0:192536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.527047:0:192536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.527056:0:192536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.527063:0:192536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.527069:0:192536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572226.527074:0:192536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.527081:0:192536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.527094:0:192536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a18b3fc00) 00010000:00010000:2.0:1788572226.527097:0:192536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572226.527101:0:192536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.527108:0:192536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bd73e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572226.527130:0:192536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b40aadc5 reply state 00000000beb97d69 transno 335007449093 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.527141:0:192536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.527146:0:192536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18b3ff00) 00010000:00010000:2.0:1788572226.527148:0:192536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572226.527151:0:192536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572226.539391:0:192536:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1788572226.539421:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572226.539425:0:192536:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449094 00000020:00080000:0.0:1788572226.539430:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572226.539432:0:192536:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449094 00000100:00100000:3.0:1788572226.545089:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572226.545184:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569469952 00000100:00100000:2.0:1788572226.545194:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569469952 00000100:00100000:2.0:1788572226.545254:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 983 00000100:00100000:2.0:1788572226.545263:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2396:x1875444569469952:12345-192.168.202.57@tcp:36:rm.0 00010000:00080000:2.0:1788572226.545284:0:188048:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449094, current: 335007449094, replaying 00000100:00100000:2.0:1788572226.547394:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2396:x1875444569469952:12345-192.168.202.57@tcp:36:rm.0 Request processed in 2120us (2304us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572226.547407:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 983 00000020:00080000:1.0:1788572226.559438:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572226.559448:0:192536:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 335007449094, next_transno: 335007449094 00010000:00080000:1.0:1788572226.559455:0:192536:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (335007449094) 00000020:00080000:1.0:1788572226.559459:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572226.559474:0:192536:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569469952 t335007449094 from 192.168.202.57@tcp req@ffff8e59028efb80 x1875444569469952/t0(335007449094) o36->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 512/0 e 0 to 0 dl 1788572237 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572226.559607:0:192536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.559625:0:192536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.559639:0:192536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.559653:0:192536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.559660:0:192536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.559666:0:192536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.559797:0:192536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.559805:0:192536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.559812:0:192536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560052:0:192536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560060:0:192536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560067:0:192536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560072:0:192536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572226.560077:0:192536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560084:0:192536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560096:0:192536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x2040:0x0].0x0 (ffff8e5a1fdac900) 00010000:00010000:1.0:1788572226.560099:0:192536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572226.560103:0:192536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560110:0:192536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3000/0x265cfe11109bd75a lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x2040:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560135:0:192536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560142:0:192536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560147:0:192536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560152:0:192536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572226.560155:0:192536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560161:0:192536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560167:0:192536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a1fdacb00) 00010000:00010000:1.0:1788572226.560170:0:192536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572226.560172:0:192536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560177:0:192536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bd74c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572226.560187:0:192536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7fa9d19 reply state 00000000f9a8ae48 transno 335007449094 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560196:0:192536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.560202:0:192536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18b3ff00) 00010000:00010000:1.0:1788572226.560204:0:192536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572226.560207:0:192536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572226.560301:0:192536:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572226.560346:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572226.560349:0:192536:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449095 00000020:00080000:1.0:1788572226.560353:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572226.560355:0:192536:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449095 00000100:00100000:3.0:1788572226.566991:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572226.567037:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572226.567298:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569478528 00000100:00100000:0.0:1788572226.567310:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569478528 00000100:00100000:1.0:1788572226.567321:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569478656 00000100:00100000:1.0:1788572226.567328:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569478656 00000100:00100000:0.0:1788572226.567440:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 984 00000100:00100000:0.0:1788572226.567452:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2396:x1875444569478528:12345-192.168.202.57@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788572226.567519:0:188833:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8e590b638700 x1875444569478528/t0(0) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 328/0 e 0 to 0 dl 1788572237 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572226.567538:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2396:x1875444569478528:12345-192.168.202.57@tcp:101:ldlm_lock_repla.0 Request processed in 90us (557us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572226.567545:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 984 00000100:00100000:0.0:1788572226.567555:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 985 00000100:00100000:0.0:1788572226.567562:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2396:x1875444569478656:12345-192.168.202.57@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788572226.567570:0:188833:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8e590b639880 x1875444569478656/t0(0) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 328/0 e 0 to 0 dl 1788572237 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572226.567579:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2396:x1875444569478656:12345-192.168.202.57@tcp:101:ldlm_lock_repla.0 Request processed in 19us (543us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572226.567584:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 985 00000020:00080000:3.0:1788572226.567637:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572226.567642:0:192536:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 335007449095 00010000:00080000:3.0:1788572226.567646:0:192536:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788572226.567649:0:192536:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572226.567655:0:192536:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788572226.567658:0:192536:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788572226.567678:0:192536:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.202.57@tcp: req@ffff8e590b638700 x1875444569478528/t0(0) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 328/0 e 0 to 0 dl 1788572237 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572226.567696:0:192536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572226.567722:0:192536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bd761 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25aed8a expref: -99 pid: 192536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.567750:0:192536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bd761 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 13 pid: 192536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.567767:0:192536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bd761 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 13 pid: 192536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.567775:0:192536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60ca00, rc 0) 00010000:00080000:3.0:1788572226.567834:0:192536:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572226.567847:0:192536:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788572226.567849:0:192536:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788572226.567854:0:192536:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.202.57@tcp: req@ffff8e590b639880 x1875444569478656/t0(0) o101->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 328/0 e 0 to 0 dl 1788572237 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572226.567864:0:192536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572226.567884:0:192536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bd768 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25aecaa expref: -99 pid: 192536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.567899:0:192536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bd768 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aecaa expref: 13 pid: 192536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.567910:0:192536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bd768 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aecaa expref: 13 pid: 192536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.567917:0:192536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590a60d000, rc 0) 00010000:00080000:3.0:1788572226.567938:0:192536:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572226.567944:0:192536:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788572226.575176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572226.576443:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569478784 00000100:00100000:1.0:1788572226.576455:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569478784 00000100:00100000:1.0:1788572226.576569:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 205 00000100:00100000:1.0:1788572226.576580:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590b63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:2396:x1875444569478784:12345-192.168.202.57@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1788572226.576601:0:188050:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e590b63bb80 x1875444569478784/t0(0) o400->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 224/0 e 0 to 0 dl 1788572237 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572226.576621:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590b63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:2396:x1875444569478784:12345-192.168.202.57@tcp:400:ptlrpcd_rcv.0 Request processed in 44us (1456us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572226.576628:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 205 00010000:00080000:2.0:1788572226.576822:0:192536:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1788572226.576947:0:192536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 79, last_transno is 339302416384 00000001:00100000:1.0:1788572226.582839:0:192502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000001:00100000:1.0:1788572226.582853:0:192502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1788572226.582884:0:192502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449094 is committed 00000001:00080000:2.0:1788572226.582994:0:192536:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788572226.583042:0:192536:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1788572226.583061:0:192536:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8e5a40521c00 x1875444584285184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:643/0 lens 224/0 e 1 to 0 dl 1788572238 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788572226.583208:0:192536:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.202.57@tcp: req@ffff8e590b63bb80 x1875444569478784/t0(0) o400->700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp:642/0 lens 224/0 e 0 to 0 dl 1788572237 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572226.583253:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788572226.583262:0:3640:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8e5a40521880 x1875444584285184/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1788572243 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572226.583272:0:3640:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8e5a40521880 x1875444584285184/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1788572243 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572226.583279:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00010000:02000000:2.0:1788572226.583280:0:192536:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:15, of 2 clients 2 recovered and 0 were evicted. 00000100:02000000:0.0:1788572226.583291:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1788572226.583298:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000c5ea5e5): req@ffff8e5a31cd2680 x1875444584265856/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572198 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572226.583331:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584285184:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788572226.583403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572226.583474:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584265856 00000100:00100000:0.0:1788572226.583508:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584265856 00000100:00100000:0.0:1788572226.583547:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788572226.583556:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584265856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572226.583584:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:0.0:1788572226.583624:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584265856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572226.583632:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788572226.583677:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584265856:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788572226.586961:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.586981:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.586989:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.586996:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572226.587001:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587011:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587030:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18b3ff00) 00010000:00010000:3.0:1788572226.587033:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572226.587038:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587045:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bd745 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587068:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587075:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587081:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587086:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572226.587089:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587095:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587102:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18b3ff00) 00010000:00010000:3.0:1788572226.587105:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572226.587108:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.587114:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109bd753 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572226.587727:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584290048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572226.587905:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572226.594969:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584290048 00000100:00100000:3.0:1788572226.594987:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584290048 00000100:00100000:3.0:1788572226.595064:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788572226.595075:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584290048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572226.595112:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572226.595224:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584290048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (7319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.595232:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788572226.595300:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584290048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572226.599678:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572226.600527:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569477504 00000100:00100000:0.0:1788572226.600543:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569477504 00000100:00100000:0.0:1788572226.600607:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 986 00000100:00100000:0.0:1788572226.600618:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+8:159519:x1875444569477504:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572226.600639:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572226.600681:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bd76f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb27f expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.600755:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bd776 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.600770:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bd776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.600786:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bd776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572226.600841:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1788572226.600845:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572226.600873:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bd776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.600902:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b3200/0x265cfe11109bd76f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb27f expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.600922:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bd776 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb27f expref: 9 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.600931:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a31dfcf00) 00010000:00010000:0.0:1788572226.600934:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572226.600938:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a370b2200, rc 0) 00000100:00100000:0.0:1788572226.601009:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:159519:x1875444569477504:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 393us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572226.601016:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 986 00000100:00100000:1.0:1788572226.614848:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572226.614929:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569478912 00000100:00100000:3.0:1788572226.614939:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569478912 00000100:00100000:3.0:1788572226.615003:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 987 00000100:00100000:3.0:1788572226.615014:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:159519:x1875444569478912:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572226.615049:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572226.615120:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:159519:x1875444569478912:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 107us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.615128:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 987 00000100:00100000:3.0:1788572226.624382:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572226.624508:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569479040 00000100:00100000:1.0:1788572226.624520:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569479040 00000100:00100000:1.0:1788572226.624576:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 988 00000100:00100000:1.0:1788572226.624585:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159519:x1875444569479040:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:1.0:1788572226.624624:0:188049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572226.624711:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159519:x1875444569479040:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 127us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572226.624719:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 988 00000100:00100000:3.0:1788572226.633288:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572226.633398:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569479168 00000100:00100000:1.0:1788572226.633407:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569479168 00000100:00100000:1.0:1788572226.633468:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6253 00000100:00100000:1.0:1788572226.633516:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159519:x1875444569479168:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:1.0:1788572226.633552:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572226.633614:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159519:x1875444569479168:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 137us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572226.633622:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6253 00000100:00100000:1.0:1788572226.649108:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000004:00000080:0.0:1788572226.650330:0:192536:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaac787b5be10 00100000:10000000:0.0:1788572226.650345:0:192536:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:2.0:1788572226.651820:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569479296 00000100:00100000:2.0:1788572226.651834:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569479296 00000100:00100000:2.0:1788572226.651892:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22608 00000100:00100000:2.0:1788572226.651900:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2396:x1875444569479296:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:2.0:1788572226.651935:0:43928:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d@192.168.202.57@tcp t0 exp 0000000000000000 cur 8979 last 0 00000020:00000080:2.0:1788572226.651967:0:43928:0:(genops.c:1385:class_connect()) connect: client 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d, cookie 0x265cfe11109bd77d 00002000:00100000:2.0:1788572226.651979:0:43928:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d/ffff8e5a37119000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788572226.651999:0:43928:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788572226.652081:0:43928:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788572226.652115:0:43928:0:(import.c:65:import_set_state_nolock()) ffff8e5a3711e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572226.652203:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569479296:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 302us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572226.652212:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22608 00000004:00080000:0.0:1788572226.656094:0:192904:0:(mdd_orphans.c:363:mdd_orphan_key_test_and_delete()) Found orphan [0x20001a9e3:0x203f:0x0] count 1, skip it 00000100:00100000:2.0:1788572226.656330:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000004:00080000:1.0:1788572226.657025:0:192524:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1989:0x0] 00000100:00100000:1.0:1788572226.657072:0:192524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192524:1875444584290176:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788572226.657124:0:192524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.657156:0:192524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0c00 going to sleep for 11 seconds 00000004:00080000:2.0:1788572226.657968:0:192522:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x19e2:0x0] 00000100:00100000:2.0:1788572226.657998:0:192522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4101aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192522:1875444584290304:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788572226.658243:0:192522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572226.658274:0:192522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a8a0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572226.658381:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584290176 00000100:00100000:1.0:1788572226.658390:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584290176 00000100:00100000:1.0:1788572226.658436:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584290304 00000100:00100000:1.0:1788572226.658440:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584290304 00000100:00100000:1.0:1788572226.658462:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22609 00000100:00100000:1.0:1788572226.658471:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:192524:x1875444584290176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788572226.658550:0:177559:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6625 -> diff = -88 00002000:02000040:1.0:1788572226.658555:0:177559:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6538 to 0x2c0000401:6625) 00000100:00100000:0.0:1788572226.661440:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569479424 00000100:00100000:0.0:1788572226.661454:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569479424 00000100:00100000:0.0:1788572226.661541:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6254 00000100:00100000:0.0:1788572226.661553:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159519:x1875444569479424:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572226.661585:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572226.661660:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159519:x1875444569479424:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 109us (5334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572226.661667:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6254 00000100:00080000:0.0:1788572226.661704:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572226.661842:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22610 00000100:00100000:0.0:1788572226.661852:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:192522:x1875444584290304:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788572226.661872:0:43929:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6657 -> diff = -31 00002000:02000040:0.0:1788572226.661877:0:43929:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6627 to 0x280000401:6657) 00002000:00010000:1.0:1788572226.683163:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.683179:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683198:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e1:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.683202:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.683208:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683224:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683236:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683243:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683270:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.683389:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.683395:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683403:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e0:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.683406:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.683410:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683418:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683425:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683432:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.683683:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572226.688107:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.688120:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.688137:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19df:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.688140:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.688147:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.688162:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.688172:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.688181:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688263:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572226.688271:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688279:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.688283:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688292:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688319:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688332:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd784 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688356:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572226.688360:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688366:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.688369:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688377:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688386:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688392:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd78b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688403:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572226.688406:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688412:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.688415:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688421:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688430:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.688437:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.688438:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.688440:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.691396:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.697405:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572226.697423:0:177559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd792 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572226.701553:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.701569:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.701589:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19de:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.701594:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.701602:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.701620:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.701631:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.701640:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.712175:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572226.712194:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.712214:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.712219:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.712233:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.712770:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.712789:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.712791:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.712794:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.717656:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572226.717672:0:177559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572226.717833:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.717840:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.717854:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19dd:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.717876:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.717883:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.717899:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.717909:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.717918:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720212:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572226.720227:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720253:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.720259:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720271:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720296:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720306:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.720317:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.720320:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572226.720349:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.720355:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720367:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a01:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.720372:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.720377:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720393:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720402:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720410:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720437:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572226.720812:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.720819:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720828:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a00:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.720831:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.720835:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720844:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720851:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.720985:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721010:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572226.721021:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572226.721025:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721032:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.721036:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721044:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721057:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721066:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd19c1c4/0x265cfe11109bd7a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721089:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572226.721096:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721101:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.721104:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721111:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721119:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721125:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ff663b3/0x265cfe11109bd7ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721135:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.721136:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.721138:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572226.721186:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.721191:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721200:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ff:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.721204:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.721209:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721217:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721225:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721232:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721389:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572226.721433:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.721439:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721447:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fe:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.721451:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.721455:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721465:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721474:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721579:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721592:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788572226.721634:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.721639:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721647:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fd:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.721650:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.721655:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721664:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721673:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721681:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721693:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788572226.721729:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.721735:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721744:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fc:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.721747:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.721751:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721760:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721768:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721776:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721789:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788572226.721796:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572226.721800:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721807:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60de00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.721810:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721820:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721836:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721844:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000087cf258/0x265cfe11109bd7b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.721990:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572226.721995:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722002:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.722005:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722013:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722025:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722032:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a20f90c/0x265cfe11109bd7bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722044:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572226.722048:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722055:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.722057:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722064:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722073:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722080:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bd7c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722093:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572226.722096:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722102:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.722105:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722112:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722121:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722128:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021bfa06b/0x265cfe11109bd7ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722138:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.722139:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.722141:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572226.722184:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.722189:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722197:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fb:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.722200:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.722204:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722212:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722219:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722226:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.722238:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572226.722387:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572226.722393:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.722400:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.722403:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.722410:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.722420:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.722427:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bd7d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.722441:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.722443:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.722445:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.722451:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.724057:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.724131:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.724345:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572226.724355:0:177559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd7a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572226.724442:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.724449:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724467:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19dc:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.724471:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.724495:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724519:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724530:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724539:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724558:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572226.724567:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572226.724573:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724581:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572226.724585:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724595:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724618:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724626:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd7df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724641:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.724643:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.724645:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572226.724687:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.724693:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724701:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19db:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.724704:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.724709:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724718:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724726:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724734:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724746:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.724781:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.724787:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724795:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19da:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.724798:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.724803:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724812:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724820:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724828:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.724841:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572226.724848:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572226.724853:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725055:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572226.725059:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725067:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725078:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725085:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd7e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725099:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572226.725103:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725109:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572226.725112:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725120:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725128:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725134:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd7ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725145:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.725146:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.725148:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572226.725194:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.725199:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725208:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d9:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.725210:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.725213:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725221:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725228:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725234:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725341:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572226.725349:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572226.725353:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725364:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572226.725367:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725374:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725384:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725390:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd7f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725403:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.725405:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.725406:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572226.725451:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.725456:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725464:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d8:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.725467:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.725471:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572226.725593:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.725600:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725609:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fa:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.725611:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.725615:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725625:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725633:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725640:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725659:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572226.725712:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.725717:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725724:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f9:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.725727:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.725731:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725745:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725752:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725759:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725770:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788572226.725805:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.725809:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725817:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f8:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.725819:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.725823:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725832:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725839:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.725851:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726386:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572226.726394:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726403:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.726408:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726417:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726431:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726438:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bd7d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726459:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572226.726463:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726469:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.726472:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726493:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726513:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726520:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bd802 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.726534:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.726536:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.726538:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.726544:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.726765:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.726776:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.726784:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.726797:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.726802:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.726814:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572226.726821:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572226.726825:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.726831:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572226.726834:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.726842:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.726851:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728034:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd7fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728064:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.728066:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.728068:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572226.728180:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.728187:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728198:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d7:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.728202:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.728208:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728218:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728227:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728234:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728260:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.728300:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.728306:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728325:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d6:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.728328:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.728333:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728342:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728349:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728356:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728371:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572226.728378:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572226.728382:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728390:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572226.728394:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728408:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728421:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728428:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd810 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728441:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572226.728444:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728449:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572226.728452:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728458:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728466:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.728474:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd817 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.729705:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572226.729819:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.729827:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.729843:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f7:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.729847:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.729853:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.730720:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.730733:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.730742:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.730765:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788572226.730832:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.730838:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.730848:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f6:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.730851:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572226.731433:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572226.731443:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731452:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.731457:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731472:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731522:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731530:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4699137/0x265cfe11109bd809 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731553:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572226.731557:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731563:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.731566:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731574:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731583:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731589:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bd81e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.731604:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.731606:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.731608:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.732053:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.732054:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.732056:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.732064:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.732069:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572226.732165:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.732172:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.732184:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d5:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.732188:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.732194:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.732206:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.732215:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.732222:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.732394:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.732408:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.732415:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.732422:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.732776:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572226.732833:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.732838:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.732848:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d4:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.732851:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.732854:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.732880:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.732888:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.732896:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736457:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788572226.736618:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.736626:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736645:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f5:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.736650:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.736656:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736671:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736683:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736689:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736704:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788572226.736745:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.736750:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736758:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f4:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.736761:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.736765:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736774:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736782:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736789:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736806:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788572226.736840:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.736845:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736852:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f3:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.736856:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.736859:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736868:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736876:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736883:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736890:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788572226.736925:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.736930:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736938:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f2:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.736941:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.736945:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736954:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736961:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736968:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.736977:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788572226.737007:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737012:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737020:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f1:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737023:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737027:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737035:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737043:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737050:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737059:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788572226.737096:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737101:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737109:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f0:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737112:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737116:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737124:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737131:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737138:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737146:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788572226.737177:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737182:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737189:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ef:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737192:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737195:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737203:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737210:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737216:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737224:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1788572226.737252:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737256:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737263:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ee:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737265:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737269:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737276:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737283:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737288:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737296:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1788572226.737343:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737347:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737355:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ed:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737358:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737361:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737369:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737377:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737384:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737397:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1788572226.737427:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737431:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737437:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ec:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737440:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737444:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737451:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737457:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737464:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737471:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1788572226.737533:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737538:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737544:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19eb:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737547:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737551:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737559:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737566:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737573:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737580:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1788572226.737610:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737615:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737621:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ea:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737624:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737627:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737635:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737642:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737649:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737656:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1788572226.737687:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737691:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737699:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e9:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737701:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737705:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737713:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737720:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737726:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737734:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1788572226.737766:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737772:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737779:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e8:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737781:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737785:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737793:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737800:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737807:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737815:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1788572226.737845:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737849:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737855:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e7:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737858:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737861:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737868:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737876:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737883:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737890:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1788572226.737918:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.737923:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737929:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e6:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.737932:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.737936:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737943:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737950:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737957:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.737969:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:3.0:1788572226.737998:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.738002:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738010:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e5:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.738012:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.738016:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738023:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738031:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738037:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738046:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:3.0:1788572226.738080:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.738085:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738092:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e4:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.738095:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.738099:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738107:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738115:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738121:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738129:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:3.0:1788572226.738164:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.738168:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738175:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e3:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:3.0:1788572226.738178:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572226.738182:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738190:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738197:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738204:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.738211:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00080000:3.0:1788572226.738235:0:43929:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6626 00000100:00100000:3.0:1788572226.738357:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:192522:x1875444584290304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 76504us (80111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.738367:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22610 00000100:00100000:3.0:1788572226.738443:0:192522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4101aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192522:1875444584290304:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788572226.738459:0:192522:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x1a01:0x0] from OST, last_created [0x280000401:0x1a01:0x0]last_used is [0x280000401:0x19e2:0x0] 00000100:00100000:3.0:1788572226.738559:0:192522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192522:1875444584290560:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788572226.738593:0:192522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572226.738625:0:192522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d59b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.738648:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584290432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572226.738671:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572226.738703:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584290432 00000100:00100000:3.0:1788572226.738709:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584290432 00000100:00100000:3.0:1788572226.738750:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6255 00000100:00100000:3.0:1788572226.738759:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584290432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572226.738778:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572226.738809:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584290432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.738816:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6255 00000100:00100000:3.0:1788572226.738850:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584290432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572226.738872:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584290560 00000100:00100000:3.0:1788572226.738875:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584290560 00000100:00100000:3.0:1788572226.738901:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22611 00000100:00100000:3.0:1788572226.738907:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:192522:x1875444584290560:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788572226.738935:0:177556:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 6658 00010000:00010000:0.0:1788572226.740191:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:0.0:1788572226.740206:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740219:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740224:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740235:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740270:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740278:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd82c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740356:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:0.0:1788572226.740361:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740368:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740370:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740378:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740389:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740396:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bd825 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740411:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:0.0:1788572226.740415:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740421:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740424:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740436:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740445:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740453:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1788572226.740456:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740463:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740465:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740472:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740524:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740531:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054de720f/0x265cfe11109bd83a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740544:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1788572226.740548:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740555:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740558:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740565:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740574:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740581:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd5cbb5a/0x265cfe11109bd841 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740593:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1788572226.740596:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740602:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740606:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740613:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740622:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740630:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bd848 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740665:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788572226.740669:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740675:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740678:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740687:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740697:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740705:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bd84f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740717:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788572226.740721:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740727:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740731:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740739:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740748:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740754:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000448687b5/0x265cfe11109bd856 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740765:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788572226.740768:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740776:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740779:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740785:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740793:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740800:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e5f94c6/0x265cfe11109bd85d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740810:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788572226.740814:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740820:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.740823:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740830:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740838:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740845:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bd864 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.740856:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788572226.741045:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741053:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741057:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741071:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741082:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741090:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d7b538/0x265cfe11109bd86b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741103:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788572226.741107:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741112:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741115:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741123:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741131:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741138:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bd872 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741153:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788572226.741156:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741162:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741165:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741172:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741179:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741185:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6057337/0x265cfe11109bd879 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741196:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788572226.741199:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741205:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741208:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741220:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741228:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741235:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbe01203/0x265cfe11109bd880 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741256:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788572226.741260:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741266:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741269:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741276:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741285:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741292:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5e6adec/0x265cfe11109bd887 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741307:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788572226.741320:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741326:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741329:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741336:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741345:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741352:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088bcc14c/0x265cfe11109bd88e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741363:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788572226.741367:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741373:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741376:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741388:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741396:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741403:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001187a88/0x265cfe11109bd895 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741413:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572226.741416:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741422:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741425:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741433:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741440:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741447:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bd89c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741462:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572226.741466:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741471:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741474:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741508:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741518:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741524:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bd8a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741538:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572226.741542:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741549:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741552:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741564:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741572:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741578:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bd8aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741589:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572226.741592:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741597:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741599:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741605:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741612:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741619:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bd8b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741635:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572226.741638:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741644:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.741646:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741652:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741660:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741665:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b664d3ee/0x265cfe11109bd8b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.741676:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.741677:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.741680:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.741718:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.741723:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.741733:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.742005:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.752073:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572226.752086:0:177559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090c54f98/0x265cfe11109bd833 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572226.752220:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.752228:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752241:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d3:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:0.0:1788572226.752339:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.752630:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.752637:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752654:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752665:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752673:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752695:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.752742:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.752748:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752756:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d2:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.752758:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.752762:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752772:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752780:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752793:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.752849:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572226.753383:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.753389:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.753398:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d1:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.753401:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.753405:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.753413:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.753421:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.753428:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572226.753540:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+6:192522:x1875444584290560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14629us (14943us total) trans 34359738471 rc 0/0 00000100:00100000:3.0:1788572226.753550:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22611 00000100:00100000:3.0:1788572226.753626:0:192522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192522:1875444584290560:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788572226.753643:0:192522:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1a01:0x0]-[0x280000401:0x1a21:0x0] 00010000:00010000:2.0:1788572226.761093:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572226.761112:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761126:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.761131:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761142:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761165:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761173:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000369c866/0x265cfe11109bd8bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761204:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572226.761208:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761213:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.761217:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761224:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761233:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761239:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000648acb57/0x265cfe11109bd8c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761533:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572226.761537:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761543:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.761546:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761554:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761564:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.761572:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.761575:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.761577:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.761729:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.762390:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572226.762399:0:177559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd45f9c/0x265cfe11109bd8cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572226.762586:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.762594:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762610:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d0:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.762615:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.762624:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762639:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762648:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762656:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762672:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.762708:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.762714:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762721:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19cf:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.762723:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.762728:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762738:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762746:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762753:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762767:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572226.762805:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.762810:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762816:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ce:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.762819:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.762823:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762831:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762839:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.762851:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763062:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572226.763070:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763078:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.763082:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763093:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763108:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763116:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bd8d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763132:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572226.763135:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763141:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.763144:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763151:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763160:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763168:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bd8db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.763177:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.763179:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.763181:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.763300:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.763356:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.763362:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.763370:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19cd:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.763372:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.763376:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.763384:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.763392:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.763399:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.764146:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572226.764155:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.764165:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.764170:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.764179:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.764194:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.764202:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bd8e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.764222:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572226.764226:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.764232:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.764235:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.768379:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.768417:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.768433:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.768436:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.768441:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.769724:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.776077:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572226.776095:0:177559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014d833cd/0x265cfe11109bd8e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.776397:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572226.776462:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.776470:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.776594:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.777076:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19cc:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.777082:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.777089:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.777107:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.777117:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.777125:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.777191:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.779068:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.779082:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.779099:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19cb:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.779104:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.779112:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.779126:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.779136:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.779144:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783209:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572226.783227:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783258:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.783264:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783277:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783307:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783326:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bd8f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783354:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572226.783358:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783363:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.783366:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783379:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783389:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.783397:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.783398:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.783401:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.783703:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572226.783712:0:177559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b19748/0x265cfe11109bd8f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572226.783842:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.783848:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.784024:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.784044:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ca:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.784050:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.784058:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784072:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784088:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784097:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784119:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.784172:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.784177:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784184:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c9:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.784187:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.784190:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784199:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784206:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784213:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784319:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572226.784360:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.784366:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784373:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c8:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.784377:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.784381:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784390:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784398:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.784406:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788122:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572226.788141:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788154:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.788159:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788172:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788195:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788203:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bd8fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788237:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572226.788254:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788262:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.788265:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788279:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788287:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788294:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bd905 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788319:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572226.788322:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788328:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572226.788330:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788337:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788347:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.788355:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.788357:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.788359:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.789606:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.789719:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572226.789729:0:177559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7a4a651/0x265cfe11109bd90c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572226.790058:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.790066:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.790081:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c7:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.790085:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.790092:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.790106:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.790117:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.790125:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.790190:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.790231:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.790235:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.790254:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c6:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.790257:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.790261:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.790270:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.790277:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.790283:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.792934:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572226.792952:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.792969:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.792975:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.792989:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.793020:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.793028:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bd913 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.793073:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572226.793077:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.793084:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.793088:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.793095:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.793105:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.793113:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.793114:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.793116:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.794545:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572226.794558:0:177559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f8c0de6/0x265cfe11109bd91a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572226.794718:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.794725:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.794740:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c5:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.794745:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.794752:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.794770:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.794779:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.794793:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.794814:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.794853:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572226.795374:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572226.795383:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.795392:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572226.795397:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.795412:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.795430:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.795437:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bd921 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.795459:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.795461:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572226.795463:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.796028:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.796094:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796112:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c4:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.796116:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.796123:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796135:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796145:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796152:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796170:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572226.796324:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572226.796330:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.796337:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.796341:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.796349:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.796362:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.796368:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bd928 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.796386:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.796388:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.796390:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572226.796424:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.796430:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796438:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c3:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.796441:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.796445:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796454:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796461:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796468:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796610:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572226.796652:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572226.796657:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796665:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c2:0x0].0x0 since=8979s v=(0 0) 00010000:00010000:1.0:1788572226.796668:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572226.796672:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796683:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796693:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796701:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.796715:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572226.797317:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572226.797325:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797332:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.797337:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797345:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797358:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797364:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bd92f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797382:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572226.797384:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797390:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572226.797392:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797399:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797406:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797413:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bd936 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.797425:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.797427:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572226.797429:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788572226.797684:0:177559:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6537 00000100:00100000:1.0:1788572226.797772:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:192524:x1875444584290176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 139297us (140643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572226.797781:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22609 00010000:00010000:2.0:1788572226.797873:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572226.798090:0:192524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192524:1875444584290176:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788572226.798109:0:192524:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x19e1:0x0] from OST, last_created [0x2c0000401:0x19e1:0x0]last_used is [0x2c0000401:0x1989:0x0] 00000100:00100000:0.0:1788572226.798203:0:192524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192524:1875444584290816:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788572226.798241:0:192524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572226.798277:0:192524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59064e3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572226.798299:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584290816 00000100:00100000:0.0:1788572226.798304:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584290816 00000100:00100000:0.0:1788572226.798351:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22612 00000100:00100000:0.0:1788572226.798359:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:192524:x1875444584290816:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788572226.798391:0:43923:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6626 00000100:00100000:1.0:1788572226.800399:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572226.800425:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584290688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572226.800528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.800586:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584290688 00000100:00100000:1.0:1788572226.800595:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584290688 00000100:00100000:1.0:1788572226.800642:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6256 00000100:00100000:1.0:1788572226.800651:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584290688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572226.800671:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 896 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572226.800710:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584290688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572226.800717:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6256 00000100:00100000:1.0:1788572226.800764:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584290688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572226.805743:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:192524:x1875444584290816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7375us (7492us total) trans 4294975675 rc 0/0 00000100:00100000:0.0:1788572226.805758:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22612 00010000:00010000:3.0:1788572226.806518:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572226.809205:0:192524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192524:1875444584290816:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788572226.809228:0:192524:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x19e1:0x0]-[0x2c0000401:0x1a01:0x0] 00010000:00010000:0.0:1788572227.004714:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572227.453151:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572227.453176:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584291072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572227.453214:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584290944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572227.457693:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572227.457876:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584290944 00000100:00100000:0.0:1788572227.457886:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584290944 00000100:00100000:0.0:1788572227.457971:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6257 00000100:00100000:0.0:1788572227.457984:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584290944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572227.458010:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572227.458069:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584290944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572227.458079:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6257 00000100:00100000:0.0:1788572227.458136:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584290944:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572227.458432:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572227.459380:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572227.459638:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584291072 00000100:00100000:1.0:1788572227.459647:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584291072 00000100:00100000:1.0:1788572227.459705:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6258 00000100:00100000:1.0:1788572227.459715:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584291072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572227.459735:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572227.459794:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584291072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572227.459801:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6258 00000100:00100000:2.0:1788572227.459887:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584291072:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788572227.460011:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572228.030691:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572229.059304:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572230.078859:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572230.543576:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572230.543612:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584291200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572230.543709:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572230.543804:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584291200 00000100:00100000:1.0:1788572230.543814:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584291200 00000100:00100000:1.0:1788572230.543889:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788572230.543900:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584291200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572230.543950:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572230.544006:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584291200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572230.544014:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788572230.544076:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584291200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572230.547543:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584291456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.547638:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.547695:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584291968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.547724:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.547747:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584292480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.547774:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.547803:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788572230.547809:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584291328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.548516:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.548566:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584291840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.548601:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.548620:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584292352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.548641:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.548673:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584291712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.548697:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.548716:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584292224:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.548739:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.548754:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584292736:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.548773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.548790:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572230.548798:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584291584:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.548821:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572230.548983:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584291968 00000100:00100000:1.0:1788572230.548996:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584291968 00000100:00100000:1.0:1788572230.549058:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788572230.549071:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572230.549160:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584291968:12345-0@lo:400:kworker.0 Request processed in 92us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572230.549168:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788572230.549197:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584291456 00000100:00100000:1.0:1788572230.549783:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584291456 00000100:00100000:1.0:1788572230.549836:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584291840 00000100:00100000:1.0:1788572230.549840:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584291840 00000100:00100000:1.0:1788572230.549855:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584292352 00000100:00100000:1.0:1788572230.549858:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584292352 00000100:00100000:1.0:1788572230.549869:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584291712 00000100:00100000:1.0:1788572230.549871:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584291712 00000100:00100000:1.0:1788572230.549883:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584292736 00000100:00100000:1.0:1788572230.549885:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584292736 00000100:00100000:1.0:1788572230.549900:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788572230.549907:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584291456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572230.549958:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584291456:12345-0@lo:400:kworker.0 Request processed in 51us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572230.549965:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788572230.549977:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788572230.549983:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584291840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572230.550012:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584291840:12345-0@lo:400:kworker.0 Request processed in 30us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572230.550019:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788572230.550032:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788572230.550037:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572230.550066:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584292352:12345-0@lo:400:kworker.0 Request processed in 29us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572230.550075:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788572230.550089:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788572230.550095:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584291712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572230.550121:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584291712:12345-0@lo:400:kworker.0 Request processed in 27us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572230.550127:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788572230.550136:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788572230.550142:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584292736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572230.550169:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584292736:12345-0@lo:400:kworker.0 Request processed in 28us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572230.550174:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788572230.550405:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584291328 00000100:00100000:2.0:1788572230.550411:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584291328 00000100:00100000:0.0:1788572230.551328:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584292096:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.551381:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.551402:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584292608:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.551427:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572230.551594:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584291712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.551617:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584292736:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.551663:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584291584 00000100:00100000:0.0:1788572230.551669:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584291584 00000100:00100000:0.0:1788572230.551715:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788572230.551723:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584291584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.551776:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584291584:12345-0@lo:400:kworker.0 Request processed in 53us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572230.551783:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788572230.551810:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584292480 00000100:00100000:0.0:1788572230.551815:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584292480 00000100:00100000:0.0:1788572230.551843:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584292224 00000100:00100000:0.0:1788572230.551847:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584292224 00000100:00100000:0.0:1788572230.551868:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584292096 00000100:00100000:0.0:1788572230.551870:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584292096 00000100:00100000:0.0:1788572230.551886:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584292608 00000100:00100000:0.0:1788572230.551889:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584292608 00000100:00100000:0.0:1788572230.551908:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7650 00000100:00100000:0.0:1788572230.551914:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584292480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.551948:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584292480:12345-0@lo:400:kworker.0 Request processed in 34us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572230.551958:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7650 00000100:00100000:0.0:1788572230.551969:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7651 00000100:00100000:0.0:1788572230.551975:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584292224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552003:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584292224:12345-0@lo:400:kworker.0 Request processed in 28us (3263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572230.552009:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7651 00000100:00100000:0.0:1788572230.552020:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7652 00000100:00100000:0.0:1788572230.552025:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584292096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552051:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584292096:12345-0@lo:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572230.552057:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7652 00000100:00100000:0.0:1788572230.552067:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7653 00000100:00100000:0.0:1788572230.552073:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584292608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552098:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584292608:12345-0@lo:400:kworker.0 Request processed in 25us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572230.552104:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7653 00000100:00100000:0.0:1788572230.552147:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584291840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552162:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584292352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552176:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584291456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552190:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584291968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552202:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584292480:0@lo:400:kworker.0 00000100:00080000:0.0:1788572230.552233:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572230.552239:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572230.552242:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572230.552245:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572230.552318:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584291584:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552329:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584292096:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552339:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584292608:0@lo:400:kworker.0 00000100:00100000:0.0:1788572230.552349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584292224:0@lo:400:kworker.0 00000100:00100000:2.0:1788572230.555121:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788572230.555157:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a244fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584291328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572230.555306:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a244fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584291328:12345-0@lo:400:kworker.0 Request processed in 168us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572230.555314:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788572230.565506:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584291328:0@lo:400:kworker.0 00010000:00010000:0.0:1788572231.100713:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572231.542237:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572231.542342:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572231.542376:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572231.542397:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572231.542476:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569479936 00000100:00100000:3.0:1788572231.542508:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569479936 00000100:00100000:3.0:1788572231.542585:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7654 00000100:00100000:3.0:1788572231.542594:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569479936:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572231.542689:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569479936:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572231.542697:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7654 00000100:00100000:3.0:1788572231.542729:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569479552 00000100:00100000:3.0:1788572231.542733:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569479552 00000100:00100000:3.0:1788572231.542754:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 79 00000100:00100000:3.0:1788572231.542758:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569479552:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572231.542778:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569479552:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 20us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572231.542782:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 79 00000100:00100000:0.0:1788572231.543054:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569479680 00000100:00100000:0.0:1788572231.543062:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569479680 00000100:00100000:0.0:1788572231.543104:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569479808 00000100:00100000:0.0:1788572231.543106:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569479808 00000100:00100000:0.0:1788572231.543124:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 212 00000100:00100000:0.0:1788572231.543129:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2398:x1875444569479680:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572231.543155:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2398:x1875444569479680:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 27us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572231.543160:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 212 00000100:00100000:0.0:1788572231.544769:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 213 00000100:00100000:0.0:1788572231.544785:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569479808:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572231.544924:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569479808:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 143us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572231.544933:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 213 00000100:00080000:0.0:1788572231.544970:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572231.544975:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572231.544979:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572231.546119:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572231.549428:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569480064 00000100:00100000:2.0:1788572231.549448:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569480064 00000100:00080000:3.0:1788572231.549555:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572231.549576:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7655 00000100:00100000:2.0:1788572231.549591:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569480064:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572231.549714:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569480064:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 127us (3600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572231.549722:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7655 00000100:00100000:0.0:1788572232.060995:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572232.061055:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584292864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572232.061162:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572232.061501:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572232.061514:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584292992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572232.061557:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572232.061621:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584292864 00000100:00100000:2.0:1788572232.061630:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584292864 00000100:00100000:2.0:1788572232.061710:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6259 00000100:00100000:2.0:1788572232.061723:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584292864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572232.061765:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572232.061815:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584292864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572232.061823:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6259 00000100:00100000:1.0:1788572232.062867:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584292992 00000100:00100000:1.0:1788572232.062880:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584292992 00000100:00100000:1.0:1788572232.062935:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788572232.062946:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584292992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572232.062994:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1788572232.063208:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584292992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 263us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572232.063216:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788572232.063399:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572232.063417:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584293120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572232.063464:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572232.063586:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584292864:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788572232.064024:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572232.064044:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584293120 00000100:00100000:3.0:1788572232.064051:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584293120 00000100:00100000:3.0:1788572232.064109:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6260 00000100:00100000:3.0:1788572232.064119:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584293120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572232.064162:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572232.064226:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584293120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572232.064232:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6260 00000100:00080000:1.0:1788572232.067987:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572232.068637:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584292992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572232.069177:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584293120:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788572232.072170:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975675 is committed 00000001:00100000:0.0:1788572232.072228:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00010000:00010000:0.0:1788572232.124794:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572232.572960:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584293248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572232.573065:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572232.573322:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584293248 00000100:00100000:0.0:1788572232.573334:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584293248 00000100:00100000:0.0:1788572232.573420:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6261 00000100:00100000:0.0:1788572232.573431:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584293248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572232.573462:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00080000:3.0:1788572232.573630:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572232.573665:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572232.573677:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584293376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572232.573721:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572232.573764:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584293376 00000100:00100000:3.0:1788572232.573769:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584293376 00000100:00100000:3.0:1788572232.573802:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6262 00000100:00100000:3.0:1788572232.573809:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584293376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572232.573822:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572232.573872:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584293376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572232.573880:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6262 00000100:00080000:3.0:1788572232.573906:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572232.573954:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584293376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572232.574218:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584293248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 788us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572232.574225:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6261 00000100:00100000:3.0:1788572232.575101:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584293248:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1788572233.091535:0:184840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738471 is committed 00010000:00010000:2.0:1788572233.148690:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572234.172685:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572235.008741:0:193106:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788572235.200363:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572235.645418:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572235.645449:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584293504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572235.645552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.645829:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584293760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.645862:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.645888:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584294272:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.645912:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.645932:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584294784:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.645968:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.645990:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788572235.645995:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584293632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646022:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.646043:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584294144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646062:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.646075:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584294656:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646094:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.646123:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584294784 00000100:00100000:3.0:1788572235.646130:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584294784 00000100:00100000:3.0:1788572235.646190:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7656 00000100:00100000:3.0:1788572235.646200:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584294784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646266:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584294784:12345-0@lo:400:kworker.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.646274:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7656 00000100:00100000:3.0:1788572235.646298:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584293632 00000100:00100000:3.0:1788572235.646302:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584293632 00000100:00100000:3.0:1788572235.646325:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788572235.646332:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590581a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584293632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646360:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590581a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584293632:12345-0@lo:400:kworker.0 Request processed in 29us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.646367:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788572235.646401:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584293760 00000100:00100000:3.0:1788572235.646405:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584293760 00000100:00100000:3.0:1788572235.646430:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584294144 00000100:00100000:3.0:1788572235.646432:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584294144 00000100:00100000:3.0:1788572235.646446:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584294656 00000100:00100000:3.0:1788572235.646448:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584294656 00000100:00100000:3.0:1788572235.646460:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788572235.646466:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584293760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646529:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584293760:12345-0@lo:400:kworker.0 Request processed in 63us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.646535:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788572235.646548:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788572235.646554:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584294144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646580:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584294144:12345-0@lo:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.646587:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788572235.646597:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788572235.646603:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584294656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646627:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584294656:12345-0@lo:400:kworker.0 Request processed in 25us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.646634:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:3.0:1788572235.646649:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572235.646652:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572235.646654:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572235.646670:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584293888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646696:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.646712:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584294400:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.646745:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584294912:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.646779:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788572235.646784:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584294016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646802:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.646812:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584294528:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646828:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.646846:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584295040:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646865:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.646884:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584294400 00000100:00100000:3.0:1788572235.646887:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584294400 00000100:00100000:3.0:1788572235.646911:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584294912 00000100:00100000:3.0:1788572235.646914:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584294912 00000100:00100000:3.0:1788572235.646928:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584294528 00000100:00100000:3.0:1788572235.646930:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584294528 00000100:00100000:3.0:1788572235.646945:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7657 00000100:00100000:3.0:1788572235.646950:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584294400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.646982:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584294400:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.646989:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7657 00000100:00100000:3.0:1788572235.647001:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7658 00000100:00100000:3.0:1788572235.647007:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584294912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647031:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584294912:12345-0@lo:400:kworker.0 Request processed in 24us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.647036:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7658 00000100:00100000:3.0:1788572235.647045:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7659 00000100:00100000:3.0:1788572235.647051:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584294528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647072:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584294528:12345-0@lo:400:kworker.0 Request processed in 22us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.647078:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7659 00000100:00080000:3.0:1788572235.647100:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572235.647103:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572235.647108:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584293888 00000100:00100000:3.0:1788572235.647112:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584293888 00000100:00100000:3.0:1788572235.647130:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584294016 00000100:00100000:3.0:1788572235.647132:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584294016 00000100:00100000:3.0:1788572235.647143:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584295040 00000100:00100000:3.0:1788572235.647145:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584295040 00000100:00100000:3.0:1788572235.647155:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788572235.647160:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584293888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647185:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584293888:12345-0@lo:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.647191:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788572235.647202:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788572235.647208:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584294016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647248:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584294016:12345-0@lo:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.647254:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788572235.647264:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788572235.647269:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584295040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647292:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584295040:12345-0@lo:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.647297:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1788572235.647309:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572235.647312:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572235.647335:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584293632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647350:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584294144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647361:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584294656:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647370:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584293760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647379:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738471 gen 2 00000100:00100000:3.0:1788572235.647396:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584294784:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647423:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584294016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647432:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584294528:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647440:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584295040:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647449:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584293888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647456:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584294400:0@lo:400:kworker.0 00000100:00100000:3.0:1788572235.647464:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975675 gen 2 00000100:00100000:3.0:1788572235.647473:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584294912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572235.648086:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584293504 00000100:00100000:1.0:1788572235.648096:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584293504 00000100:00100000:1.0:1788572235.648147:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584294272 00000100:00100000:1.0:1788572235.648151:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584294272 00000100:00100000:1.0:1788572235.648165:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788572235.648172:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584293504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572235.648203:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572235.648284:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584293504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572235.648292:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788572235.648307:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788572235.648313:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584294272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572235.648348:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584294272:12345-0@lo:400:kworker.0 Request processed in 35us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572235.648354:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788572235.648396:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584294272:0@lo:400:kworker.0 00000100:00100000:0.0:1788572235.648772:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584293504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788572236.222626:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572236.651253:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572236.651298:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572236.651336:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572236.651354:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572236.651380:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572236.651547:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569480576 00000100:00100000:1.0:1788572236.651558:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569480576 00000100:00100000:1.0:1788572236.651610:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569480704 00000100:00100000:1.0:1788572236.651613:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569480704 00000100:00100000:1.0:1788572236.651635:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7660 00000100:00100000:1.0:1788572236.651644:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569480576:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572236.651722:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569480576:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 79us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572236.651730:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7660 00000100:00100000:1.0:1788572236.651746:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7661 00000100:00100000:1.0:1788572236.651752:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569480704:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572236.651789:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2399:x1875444569480704:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 37us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572236.651796:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7661 00000100:00080000:1.0:1788572236.651813:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572236.651816:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572236.656741:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569480320 00000100:00100000:3.0:1788572236.656993:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569480320 00000100:00100000:3.0:1788572236.657070:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569480448 00000100:00100000:3.0:1788572236.657074:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569480448 00000100:00100000:3.0:1788572236.657103:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 220 00000100:00080000:1.0:1788572236.657812:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572236.657819:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572236.659075:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2399:x1875444569480320:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572236.659221:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2399:x1875444569480320:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 161us (7967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572236.659229:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 220 00000100:00100000:3.0:1788572236.659266:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 221 00000100:00100000:3.0:1788572236.659273:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569480448:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572236.659298:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2399:x1875444569480448:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 27us (7944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572236.659303:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 221 00000100:00100000:3.0:1788572236.659330:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569480192 00000100:00100000:3.0:1788572236.659336:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569480192 00000100:00100000:3.0:1788572236.659372:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 81 00000100:00100000:3.0:1788572236.659379:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569480192:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572236.659400:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2399:x1875444569480192:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 22us (8064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572236.659405:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 81 00000100:00100000:0.0:1788572237.184916:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572237.185071:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584295168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572237.185156:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572237.189285:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584295168 00000100:00100000:3.0:1788572237.189296:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584295168 00000100:00100000:3.0:1788572237.189361:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6263 00000100:00100000:3.0:1788572237.189374:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584295168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572237.189406:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572237.189503:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584295168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (4346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572237.189510:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6263 00000100:00080000:3.0:1788572237.189534:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572237.189546:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572237.189561:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584295296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572237.189599:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572237.189638:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584295296 00000100:00100000:3.0:1788572237.189641:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584295296 00000100:00100000:3.0:1788572237.189667:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6264 00000100:00100000:3.0:1788572237.189673:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584295296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572237.189838:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584295168:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572237.190854:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572237.191064:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584295296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1252us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572237.191073:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6264 00000100:00080000:3.0:1788572237.191104:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572237.191217:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584295296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572237.194307:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572237.194331:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584295424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572237.194400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572237.194457:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584295424 00000100:00100000:3.0:1788572237.194465:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584295424 00000100:00100000:3.0:1788572237.194522:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788572237.194532:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584295424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572237.194564:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572237.194604:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584295424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572237.194611:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788572237.194657:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584295424:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788572237.249273:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572237.291670:0:193155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1788572237.695963:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572237.695991:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584295552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572237.696066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572237.696241:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584295680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572237.696271:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572237.696354:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584295552 00000100:00100000:0.0:1788572237.696363:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584295552 00000100:00100000:0.0:1788572237.696425:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584295680 00000100:00100000:0.0:1788572237.696429:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584295680 00000100:00100000:0.0:1788572237.696450:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6265 00000100:00100000:0.0:1788572237.696458:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584295552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572237.696506:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572237.696566:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584295552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572237.696573:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6265 00000100:00100000:0.0:1788572237.696594:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6266 00000100:00100000:0.0:1788572237.696601:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584295680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572237.696611:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572237.696640:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584295680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572237.696646:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6266 00000100:00100000:0.0:1788572237.696683:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584295680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572237.696717:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584295552:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572237.696883:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572237.696888:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572238.269538:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572239.199319:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572239.199566:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569480832 00000100:00100000:3.0:1788572239.199580:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569480832 00000100:00100000:3.0:1788572239.199680:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 989 00000100:00100000:3.0:1788572239.199691:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:159989:x1875444569480832:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572239.199759:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572239.199851:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:159989:x1875444569480832:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 162us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572239.199859:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 989 00000100:00080000:1.0:1788572239.200206:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572239.201850:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572239.201949:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569480960 00000100:00100000:3.0:1788572239.201962:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569480960 00000100:00100000:3.0:1788572239.202044:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 990 00000100:00100000:3.0:1788572239.202056:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159989:x1875444569480960:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572239.202104:0:188833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1788572239.202204:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159989:x1875444569480960:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 149us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572239.202211:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 990 00000100:00080000:1.0:1788572239.202536:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572239.205091:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572239.209975:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569481088 00000100:00100000:0.0:1788572239.209998:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569481088 00000100:00100000:0.0:1788572239.210118:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6267 00000100:00100000:0.0:1788572239.210132:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159989:x1875444569481088:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572239.210179:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572239.210303:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:159989:x1875444569481088:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 174us (5227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572239.210312:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6267 00000100:00080000:1.0:1788572239.210504:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572239.212907:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572239.213010:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569481216 00000100:00100000:3.0:1788572239.213025:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569481216 00000100:00100000:3.0:1788572239.213111:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6268 00000100:00100000:3.0:1788572239.213123:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:159989:x1875444569481216:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572239.213170:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572239.213305:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:159989:x1875444569481216:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 183us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572239.213314:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6268 00000100:00080000:1.0:1788572239.213394:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572239.253841:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572239.255244:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569481472 00000100:00100000:3.0:1788572239.255262:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569481472 00000100:00100000:3.0:1788572239.255359:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 991 00000100:00100000:3.0:1788572239.255370:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:159094:x1875444569481472:12345-192.168.202.57@tcp:36:multiop.0 00010000:00010000:3.0:1788572239.255520:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.255541:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.255677:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572239.256356:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009652b9cc reply state 000000009651a0ae transno 339302416385 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.256964:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.256983:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e590b478800) 00010000:00010000:3.0:1788572239.256986:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788572239.257543:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572239.258078:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:159094:x1875444569481472:12345-192.168.202.57@tcp:36:multiop.0 Request processed in 2700us (4243us total) trans 339302416385 rc 0/0 00000100:00100000:3.0:1788572239.258089:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 991 00000100:00100000:2.0:1788572239.270214:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572239.279790:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569481600 00000100:00100000:3.0:1788572239.279811:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569481600 00000100:00100000:3.0:1788572239.279904:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 992 00000100:00100000:3.0:1788572239.279919:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:159094:x1875444569481600:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1788572239.279951:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572239.279982:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bd944 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb286 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.280066:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bd944 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb286 expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.280084:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bd944 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb286 expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.280107:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e590b478800) 00010000:00010000:3.0:1788572239.280110:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572239.280115:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616e000, rc 0) 00000100:00100000:3.0:1788572239.280239:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:159094:x1875444569481600:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 321us (10050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572239.280246:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 992 00000100:00100000:2.0:1788572239.285877:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572239.285989:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569481728 00000100:00100000:0.0:1788572239.286002:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569481728 00000100:00100000:0.0:1788572239.286088:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22613 00000100:00100000:0.0:1788572239.286101:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569481728:12345-192.168.202.57@tcp:2:multiop.0 00002000:00010000:0.0:1788572239.286355:0:43923:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x19e2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788572239.286360:0:43923:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x19e2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788572239.286362:0:43923:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x19e2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788572239.286364:0:43923:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x19e2:0x0] updating lvb ctime from disk: 0 -> 1788572239 00002000:00010000:0.0:1788572239.286367:0:43923:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x19e2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788572239.286458:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2398:x1875444569481728:12345-192.168.202.57@tcp:2:multiop.0 Request processed in 359us (593us total) trans 34359738472 rc 0/0 00000100:00100000:0.0:1788572239.286466:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22613 00000100:00100000:2.0:1788572239.291849:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572239.292045:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569481856 00000100:00100000:0.0:1788572239.292059:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569481856 00000100:00100000:0.0:1788572239.292137:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 993 00000100:00100000:0.0:1788572239.292149:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:159094:x1875444569481856:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1788572239.292179:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572239.292221:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bd94b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb28d expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.292316:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bd952 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.292334:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bd952 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.292348:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bd952 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572239.292425:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572239.292452:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bd952 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.292534:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bd94b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb28d expref: 14 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.292695:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bd952 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb28d expref: 13 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.292705:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e590b478800) 00010000:00010000:0.0:1788572239.292708:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788572239.292712:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1c00, rc 0) 00000100:00100000:0.0:1788572239.292805:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:159094:x1875444569481856:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 658us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572239.292812:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 993 00010000:00010000:0.0:1788572239.295882:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572239.302857:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572239.303780:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569482112 00000100:00100000:3.0:1788572239.303797:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569482112 00000100:00100000:3.0:1788572239.303881:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1 00000100:00100000:3.0:1788572239.303893:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+13:159094:x1875444569482112:12345-192.168.202.57@tcp:35:multiop.0 00000004:00080000:3.0:1788572239.304274:0:188052:0:(mdd_object.c:4014:mdd_close()) Object [0x20001a9e3:0x203f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788572239.304359:0:188052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13c:0x0].2, 64 off8320 00000004:00080000:3.0:1788572239.304455:0:188052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8992298974307ns, next at 8993298889215ns, rc = 0 00010000:00010000:3.0:1788572239.304721:0:188052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.304747:0:188052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.304763:0:188052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.304772:0:188052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.304780:0:188052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.304787:0:188052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.304827:0:188052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572239.304957:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:159094:x1875444569482112:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 1061us (2109us total) trans 339302416386 rc 0/0 00000100:00100000:3.0:1788572239.304967:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1 00010000:00010000:2.0:1788572239.306004:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572239.306017:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572239.306028:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616ea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572239.306033:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572239.306044:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572239.306064:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e590b478800) 00010000:00010000:2.0:1788572239.306067:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572239.306074:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572239.306081:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616ea00/0x265cfe11109bd959 lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 188052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572239.306106:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572239.306108:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572239.306110:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572239.310045:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572239.311203:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569482240 00000100:00100000:3.0:1788572239.311225:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569482240 00000100:00100000:3.0:1788572239.311307:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 994 00000100:00100000:3.0:1788572239.311318:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:158949:x1875444569482240:12345-192.168.202.57@tcp:101:bash.0 00010000:00010000:3.0:1788572239.311350:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572239.311389:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f400/0x265cfe11109bd960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb294 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311524:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311544:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311564:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311583:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311592:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311598:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311685:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311693:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311700:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311707:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616fa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572239.311713:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311721:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311735:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a31dfcf00) 00010000:00010000:3.0:1788572239.311740:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572239.311903:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311912:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109bd967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311932:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311938:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311945:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311951:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616fe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572239.311954:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311960:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311968:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8e590b478500) 00010000:00010000:3.0:1788572239.311970:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572239.311973:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.311979:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fe00/0x265cfe11109bd96e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.312019:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f400/0x265cfe11109bd960 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb294 expref: 15 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.312030:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a31dfcf00) 00010000:00010000:3.0:1788572239.312033:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572239.312036:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f400/0x265cfe11109bd960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb294 expref: 15 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572239.312045:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616f400, rc 0) 00000100:00100000:3.0:1788572239.312130:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:158949:x1875444569482240:12345-192.168.202.57@tcp:101:bash.0 Request processed in 813us (2099us total) trans 0 rc 301/301 00000100:00100000:3.0:1788572239.312138:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 994 00010000:00010000:2.0:1788572240.332975:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572240.764815:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.764902:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.764961:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584296576:0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.764986:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.765001:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584297088:0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.765017:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.765045:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788572240.765050:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.765067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.765079:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584296448:0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.765101:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.765122:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584296960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.765143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.765187:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584296448 00000100:00100000:1.0:1788572240.765198:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584296448 00000100:00100000:1.0:1788572240.765254:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584296960 00000100:00100000:1.0:1788572240.765258:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584296960 00000100:00100000:1.0:1788572240.765275:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788572240.765286:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584296448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.765355:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584296448:12345-0@lo:400:kworker.0 Request processed in 70us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572240.765364:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788572240.765382:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788572240.765388:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584296960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.765413:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584296960:12345-0@lo:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572240.765419:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788572240.765508:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584296448:0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.765521:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584296960:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.765622:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584295808:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.765663:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.765699:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584296320:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.765722:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.765737:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584296832:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.765755:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.765767:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584297344:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.765783:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.765795:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788572240.765800:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584296192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.765818:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.765827:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584296704:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.765845:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.765857:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584297216:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.765876:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.765899:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584296064 00000100:00100000:3.0:1788572240.765903:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584296064 00000100:00100000:3.0:1788572240.765938:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584295936 00000100:00100000:3.0:1788572240.765941:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584295936 00000100:00100000:3.0:1788572240.765954:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584296320 00000100:00100000:3.0:1788572240.765956:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584296320 00000100:00100000:3.0:1788572240.765968:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584296832 00000100:00100000:3.0:1788572240.765970:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584296832 00000100:00100000:3.0:1788572240.765979:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584297344 00000100:00100000:3.0:1788572240.765981:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584297344 00000100:00100000:3.0:1788572240.765991:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584296192 00000100:00100000:3.0:1788572240.765993:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584296192 00000100:00100000:3.0:1788572240.766005:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788572240.766012:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584296064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766051:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584296064:12345-0@lo:400:kworker.0 Request processed in 39us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572240.766057:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788572240.766072:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788572240.766077:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584295936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766098:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584295936:12345-0@lo:400:kworker.0 Request processed in 22us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572240.766104:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788572240.766112:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788572240.766117:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584296320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766146:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584296320:12345-0@lo:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572240.766151:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788572240.766164:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788572240.766170:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584296832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766210:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584296832:12345-0@lo:400:kworker.0 Request processed in 41us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572240.766216:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788572240.766228:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788572240.766233:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584297344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766260:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584297344:12345-0@lo:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572240.766266:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788572240.766276:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788572240.766282:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584296192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766307:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584296192:12345-0@lo:400:kworker.0 Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572240.766313:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788572240.766351:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584296192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766361:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584296320:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766370:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584296832:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766378:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584297344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.766697:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584295808 00000100:00100000:1.0:1788572240.766703:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584295808 00000100:00100000:1.0:1788572240.766745:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788572240.766751:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584295808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.766792:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584295808:12345-0@lo:400:kworker.0 Request processed in 42us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572240.766799:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788572240.766832:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572240.766838:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572240.766860:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788572240.766871:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584296064:0@lo:400:kworker.0 00000100:00100000:3.0:1788572240.766934:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584295808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572240.767054:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584296576 00000100:00100000:0.0:1788572240.767060:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584296576 00000100:00100000:0.0:1788572240.767102:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584297088 00000100:00100000:0.0:1788572240.767105:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584297088 00000100:00100000:0.0:1788572240.767122:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584296704 00000100:00100000:0.0:1788572240.767125:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584296704 00000100:00100000:0.0:1788572240.767144:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584297216 00000100:00100000:0.0:1788572240.767148:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584297216 00000100:00100000:0.0:1788572240.767168:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7662 00000100:00100000:0.0:1788572240.767186:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584296576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572240.767229:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584296576:12345-0@lo:400:kworker.0 Request processed in 56us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572240.767235:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7662 00000100:00100000:0.0:1788572240.767252:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7663 00000100:00100000:0.0:1788572240.767258:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584297088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572240.767285:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584297088:12345-0@lo:400:kworker.0 Request processed in 28us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572240.767291:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7663 00000100:00100000:0.0:1788572240.767302:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7664 00000100:00100000:0.0:1788572240.767307:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584296704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572240.767340:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584296704:12345-0@lo:400:kworker.0 Request processed in 33us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572240.767345:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7664 00000100:00100000:0.0:1788572240.767355:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7665 00000100:00100000:0.0:1788572240.767361:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584297216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572240.767388:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584297216:12345-0@lo:400:kworker.0 Request processed in 27us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572240.767394:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7665 00000100:00100000:0.0:1788572240.767529:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584296704:0@lo:400:kworker.0 00000100:00100000:0.0:1788572240.767541:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584297216:0@lo:400:kworker.0 00000100:00100000:0.0:1788572240.767572:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584296576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572240.767584:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584297088:0@lo:400:kworker.0 00000100:00080000:3.0:1788572240.767734:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572240.767738:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572240.768722:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572240.768742:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584297472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572240.768804:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.768947:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584297472 00000100:00100000:1.0:1788572240.768954:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584297472 00000100:00100000:1.0:1788572240.769012:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788572240.769022:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584297472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572240.769059:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572240.769111:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584297472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572240.769117:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788572240.769228:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584297472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788572241.346344:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572241.788233:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572241.788280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572241.788314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572241.788336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572241.788363:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572241.788405:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569482880 00000100:00100000:1.0:1788572241.788420:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569482880 00000100:00100000:3.0:1788572241.788630:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569482368 00000100:00100000:3.0:1788572241.788636:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569482368 00000100:00100000:3.0:1788572241.788675:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 83 00000100:00100000:3.0:1788572241.788685:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590581b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569482368:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572241.788771:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590581b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2397:x1875444569482368:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 86us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572241.788779:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 83 00000100:00100000:3.0:1788572241.788832:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569482624 00000100:00100000:3.0:1788572241.788835:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569482624 00000100:00100000:3.0:1788572241.788863:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569482496 00000100:00100000:3.0:1788572241.788865:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569482496 00000100:00100000:3.0:1788572241.788884:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 228 00000100:00100000:3.0:1788572241.788891:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569482624:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572241.788921:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2397:x1875444569482624:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572241.788928:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 228 00000100:00100000:3.0:1788572241.788938:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 229 00000100:00100000:3.0:1788572241.788943:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:2397:x1875444569482496:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572241.788964:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+14:2397:x1875444569482496:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 21us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572241.788970:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 229 00000100:00080000:3.0:1788572241.788983:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572241.788988:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572241.788991:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572241.789366:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569482752 00000100:00100000:1.0:1788572241.789374:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569482752 00000100:00100000:1.0:1788572241.789414:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7666 00000100:00100000:1.0:1788572241.789422:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2397:x1875444569482880:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572241.789467:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2397:x1875444569482880:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 46us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572241.789474:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7666 00000100:00100000:1.0:1788572241.789515:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7667 00000100:00100000:1.0:1788572241.789522:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2397:x1875444569482752:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572241.789877:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+7:2397:x1875444569482752:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 355us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572241.789884:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7667 00000100:00080000:3.0:1788572241.791269:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572242.301109:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572242.301147:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584297600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572242.301264:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.301406:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584297600 00000100:00100000:3.0:1788572242.301416:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584297600 00000100:00100000:3.0:1788572242.301534:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788572242.301546:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584297600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572242.301595:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572242.301677:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584297600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572242.301684:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788572242.301897:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584297600:0@lo:41:osp-pre-0-1.0 00000004:00080000:0.0:1788572242.302423:0:192522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8995296942114ns, next at 8996296938802ns, rc = 0 00000100:00100000:0.0:1788572242.302450:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572242.302464:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584297728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572242.302547:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572242.302589:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584297728 00000100:00100000:0.0:1788572242.302594:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584297728 00000100:00100000:0.0:1788572242.302643:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6269 00000100:00100000:0.0:1788572242.302651:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584297728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572242.302677:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572242.302714:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584297728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572242.302721:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6269 00000100:00080000:0.0:1788572242.302746:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572242.302779:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584297728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572242.303001:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572242.303012:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4101aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584297856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572242.303047:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572242.303112:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584297856 00000100:00100000:2.0:1788572242.303116:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584297856 00000100:00100000:2.0:1788572242.303168:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6270 00000100:00100000:2.0:1788572242.303178:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584297856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572242.303198:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572242.303242:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584297856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572242.303248:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6270 00000100:00100000:2.0:1788572242.303279:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4101aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584297856:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788572242.303326:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572242.367033:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572242.812740:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572242.812771:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584297984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572242.812874:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572242.812940:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584297984 00000100:00100000:0.0:1788572242.812949:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584297984 00000100:00100000:0.0:1788572242.813016:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6271 00000100:00100000:0.0:1788572242.813027:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584297984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572242.813058:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572242.813113:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584297984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572242.813121:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6271 00000100:00080000:0.0:1788572242.813151:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572242.813208:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584297984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572242.813446:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572242.813458:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584298112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572242.813530:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572242.813616:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584298112 00000100:00100000:1.0:1788572242.813622:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584298112 00000100:00100000:1.0:1788572242.813669:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6272 00000100:00100000:1.0:1788572242.813677:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584298112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572242.813691:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572242.813731:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584298112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572242.813738:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6272 00000100:00080000:2.0:1788572242.813827:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572242.813853:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584298112:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572243.390269:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572244.415915:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572244.869851:0:192502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788572244.869890:0:192502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416386 is committed 00000004:00080000:3.0:1788572244.869900:0:192502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788572244.870251:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572244.870278:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4101b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584298240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572244.870366:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572244.871079:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584298240 00000100:00100000:3.0:1788572244.871089:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584298240 00000100:00100000:3.0:1788572244.871171:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22614 00000100:00100000:3.0:1788572244.871185:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584298240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572244.871212:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6626 count 1 00010000:00010000:3.0:1788572244.871236:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.871260:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb247 expref: 6 pid: 43931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.871269:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e2:0x0].0x0 since=76s v=(0 0) 00010000:00010000:3.0:1788572244.871273:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572244.871278:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.871314:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb247 expref: 6 pid: 43931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.871341:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb247 expref: 6 pid: 43931 timeout: 9097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572244.871355:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875444584298368:192.168.202.57@tcp:104: 00000100:00100000:3.0:1788572244.871429:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d1480 going to sleep for 11 seconds 00000100:00080000:2.0:1788572244.872312:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788572244.872317:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572244.872329:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572244.872336:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572244.872342:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572244.872347:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572244.872354:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572244.872371:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e590b478800) 00010000:00010000:0.0:1788572244.872374:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788572244.872379:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572244.872387:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bd93d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572244.873738:0:184840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738472 is committed 00000100:00100000:1.0:1788572244.908868:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572244.909111:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875444584298368:192.168.202.57@tcp:104: 00010000:00010000:3.0:1788572244.909157:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572244.909256:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569483008 00000100:00100000:1.0:1788572244.909264:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569483008 00010000:00010000:1.0:1788572244.909322:0:43930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb247 expref: 6 pid: 43931 timeout: 9097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572244.909358:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12895 00000100:00100000:1.0:1788572244.909368:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569483008:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572244.909386:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572244.909393:0:43930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb247 expref: 6 pid: 43931 timeout: 9097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572244.909406:0:43930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb247 expref: 6 pid: 43931 timeout: 9097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572244.909434:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f41f4863/0x265cfe11109bd45f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb247 expref: 6 pid: 43931 timeout: 9097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572244.909453:0:43930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572244.909457:0:43930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572244.909463:0:43930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572244.909473:0:43930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572244.909539:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788572244.909691:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788572244.909703:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.909712:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.909721:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.909729:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.909756:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572244.909957:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584298240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38775us (39589us total) trans 34359738473 rc 0/0 00000100:00100000:3.0:1788572244.909965:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22614 00010000:00010000:3.0:1788572244.909993:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572244.910000:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.910008:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616fe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572244.910013:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.910023:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.910037:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.910046:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5397f62/0x265cfe11109bd975 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.910067:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572244.910069:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572244.910071:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572244.910101:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a4101b800/2, rc 0, transno 34359738473 00000100:00100000:3.0:1788572244.910109:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4101b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584298240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572244.910321:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569483008:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 952us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572244.910330:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12895 00010000:00010000:3.0:1788572245.436928:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572245.884702:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572245.884731:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584298496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572245.884815:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572245.884830:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584298752:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.884854:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584298880:0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.884871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572245.884902:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572245.884910:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584299264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.884928:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584299392:0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.884941:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572245.884965:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572245.884968:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584299776:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.884990:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584299904:0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.884997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572245.885025:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572245.885026:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788572245.885036:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584298624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.885049:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572245.885058:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584299008:0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.885071:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572245.885087:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572245.885108:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584299136:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.885115:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584299520:0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.885155:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572245.885161:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572245.885181:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584299648:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.885187:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584300032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.885223:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572245.885236:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572245.885240:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584300160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.885270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572245.885275:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584298752 00000100:00100000:1.0:1788572245.885283:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584298752 00000100:00100000:0.0:1788572245.885301:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584298880 00000100:00100000:0.0:1788572245.885306:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584298880 00000100:00100000:1.0:1788572245.885335:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584299008 00000100:00100000:0.0:1788572245.885338:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584299136 00000100:00100000:1.0:1788572245.885340:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584299008 00000100:00100000:0.0:1788572245.885344:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584299136 00000100:00100000:1.0:1788572245.885363:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584299648 00000100:00100000:1.0:1788572245.885368:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584299648 00000100:00100000:0.0:1788572245.885371:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584300160 00000100:00100000:0.0:1788572245.885376:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584300160 00000100:00100000:1.0:1788572245.885393:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788572245.885402:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584298752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.885455:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584298752:12345-0@lo:400:kworker.0 Request processed in 55us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572245.885463:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788572245.885502:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788572245.885509:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584298880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.885545:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584298880:12345-0@lo:400:kworker.0 Request processed in 36us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572245.885552:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788572245.885568:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788572245.885576:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788572245.885581:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584299008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.885589:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584299136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.885627:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584299008:12345-0@lo:400:kworker.0 Request processed in 49us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572245.885634:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584299136:12345-0@lo:400:kworker.0 Request processed in 48us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572245.885641:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788572245.885648:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788572245.885663:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788572245.885670:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788572245.885676:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584299648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.885684:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584300160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.885717:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584299648:12345-0@lo:400:kworker.0 Request processed in 45us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572245.885727:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584300160:12345-0@lo:400:kworker.0 Request processed in 46us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572245.885728:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788572245.885739:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788572245.885760:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584298496 00000100:00100000:1.0:1788572245.885764:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584298496 00000100:00100000:1.0:1788572245.885782:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584299264 00000100:00100000:1.0:1788572245.885784:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584299264 00000100:00100000:1.0:1788572245.885793:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584299776 00000100:00100000:1.0:1788572245.885795:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584299776 00000100:00100000:1.0:1788572245.885805:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788572245.885811:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584298496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572245.885838:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572245.885871:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584298496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572245.885877:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788572245.885890:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788572245.885896:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584299264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.885923:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584299264:12345-0@lo:400:kworker.0 Request processed in 27us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572245.885930:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788572245.885945:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00080000:2.0:1788572245.886035:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572245.886040:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572245.886060:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584299392 00000100:00100000:2.0:1788572245.886065:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584299392 00000100:00100000:2.0:1788572245.886099:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584299904 00000100:00100000:2.0:1788572245.886103:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584299904 00000100:00100000:2.0:1788572245.886121:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584299520 00000100:00100000:2.0:1788572245.886124:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584299520 00000100:00100000:2.0:1788572245.886168:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584300032 00000100:00100000:2.0:1788572245.886171:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584300032 00000100:00100000:1.0:1788572245.886188:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584299008:0@lo:400:kworker.0 00000100:00100000:2.0:1788572245.886198:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7668 00000100:00100000:1.0:1788572245.886207:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584298880:0@lo:400:kworker.0 00000100:00100000:2.0:1788572245.886209:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584299392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572245.886252:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584299392:12345-0@lo:400:kworker.0 Request processed in 48us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572245.886258:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7668 00000100:00100000:2.0:1788572245.886273:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7669 00000100:00100000:2.0:1788572245.886279:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584299904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572245.886308:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584299904:12345-0@lo:400:kworker.0 Request processed in 30us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572245.886314:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7669 00000100:00100000:2.0:1788572245.886327:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7670 00000100:00100000:2.0:1788572245.886333:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584299520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572245.886359:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584299520:12345-0@lo:400:kworker.0 Request processed in 27us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572245.886365:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7670 00000100:00100000:2.0:1788572245.886377:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7671 00000100:00100000:2.0:1788572245.886382:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584300032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.886459:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584299776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.886516:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584299776:12345-0@lo:400:kworker.0 Request processed in 564us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572245.886524:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788572245.886729:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584298496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572245.886764:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584299520:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.886775:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584299392:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.886785:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584299904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.886842:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584299136:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.886854:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584299648:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.886863:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584300160:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.886872:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584298752:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.886882:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584299264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.886891:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584299776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.886958:0:192507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584298624 00000100:00080000:1.0:1788572245.886963:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572245.886965:0:192507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584298624 00000100:00080000:1.0:1788572245.886968:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572245.887004:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788572245.887013:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584298624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572245.887063:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584298624:12345-0@lo:400:kworker.0 Request processed in 52us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572245.887069:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788572245.887227:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584300032:12345-0@lo:400:kworker.0 Request processed in 843us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572245.887234:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7671 00000100:00100000:0.0:1788572245.887733:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584300032:0@lo:400:kworker.0 00000100:00100000:1.0:1788572245.888326:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584298624:0@lo:400:kworker.0 00010000:00010000:3.0:1788572246.460805:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572246.904982:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572246.905031:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572246.905063:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572246.905093:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572246.905923:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569483136 00000100:00100000:3.0:1788572246.905935:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569483136 00000100:00100000:3.0:1788572246.906092:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 85 00000100:00100000:3.0:1788572246.906103:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569483136:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572246.906192:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2398:x1875444569483136:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 91us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572246.906199:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 85 00000100:00100000:3.0:1788572246.907067:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569483520 00000100:00100000:3.0:1788572246.907077:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569483520 00000100:00100000:3.0:1788572246.907159:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7672 00000100:00100000:3.0:1788572246.907168:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569483520:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572246.907233:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569483520:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 67us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572246.907240:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7672 00000100:00080000:3.0:1788572246.907263:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572246.909074:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572246.909208:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569483264 00000100:00100000:2.0:1788572246.909216:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569483264 00000100:00100000:2.0:1788572246.909677:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569483392 00000100:00100000:2.0:1788572246.909682:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569483392 00000100:00100000:2.0:1788572246.909712:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 236 00000100:00100000:2.0:1788572246.909723:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:2398:x1875444569483264:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572246.909789:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:2398:x1875444569483264:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 67us (4819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572246.909796:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 236 00000100:00100000:2.0:1788572246.909813:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 237 00000100:00100000:2.0:1788572246.909820:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569483392:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572246.909844:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2398:x1875444569483392:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (4752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572246.909851:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 237 00000100:00080000:1.0:1788572246.913582:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572246.913593:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572246.926443:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569483648 00000100:00100000:0.0:1788572246.926458:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569483648 00000100:00100000:0.0:1788572246.926560:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7673 00000100:00100000:0.0:1788572246.926571:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569483648:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572246.926650:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2398:x1875444569483648:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 80us (17583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572246.926657:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7673 00000100:00080000:1.0:1788572246.927700:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1788572246.964230:0:193351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 74: Ensure applications don't fail waiting for OST recovery ========================================================== 21:37:26 (1788572246) 00000100:00100000:0.0:1788572247.420789:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572247.420813:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584300288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572247.420888:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572247.421043:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572247.421053:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584300416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572247.421087:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572247.421244:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584300416 00000100:00100000:3.0:1788572247.421252:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584300416 00000100:00100000:3.0:1788572247.421297:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788572247.421305:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584300416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572247.421341:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572247.421394:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584300416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572247.421402:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788572247.421452:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584300416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572247.421517:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584300288 00000100:00100000:3.0:1788572247.421522:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584300288 00000100:00100000:3.0:1788572247.421561:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6273 00000100:00100000:3.0:1788572247.421568:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584300288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572247.421588:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572247.421624:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584300288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572247.421629:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6273 00000100:00080000:3.0:1788572247.421645:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572247.421751:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584300288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572247.427025:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584300544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572247.427107:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572247.436292:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584300544 00000100:00100000:0.0:1788572247.436308:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584300544 00000100:00100000:1.0:1788572247.436544:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6274 00000100:00100000:1.0:1788572247.436560:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584300544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572247.436593:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572247.436680:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584300544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (9573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572247.436687:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6274 00000100:00100000:0.0:1788572247.436903:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584300544:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788572247.436995:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572247.488456:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572247.933411:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584300672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572247.933518:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572247.933887:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584300672 00000100:00100000:0.0:1788572247.933898:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584300672 00000100:00100000:0.0:1788572247.933976:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6275 00000100:00100000:0.0:1788572247.933987:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584300672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572247.934021:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572247.934072:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584300672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572247.934079:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6275 00000100:00080000:2.0:1788572247.934216:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572247.934258:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584300672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572247.935831:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572247.935851:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584300800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572247.935906:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572247.936021:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584300800 00000100:00100000:0.0:1788572247.936029:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584300800 00000100:00100000:0.0:1788572247.936100:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6276 00000100:00100000:0.0:1788572247.936119:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584300800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572247.936142:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572247.936184:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584300800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572247.936191:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6276 00000100:00080000:2.0:1788572247.936309:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572247.936343:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584300800:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572248.509627:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572249.533310:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572249.629635:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572249.629782:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569483904 00000100:00100000:3.0:1788572249.629792:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569483904 00000100:00100000:3.0:1788572249.629866:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2 00000100:00100000:3.0:1788572249.629876:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+11:160601:x1875444569483904:12345-192.168.202.57@tcp:35:umount.0 00000100:00100000:3.0:1788572249.630174:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:160601:x1875444569483904:12345-192.168.202.57@tcp:35:umount.0 Request processed in 298us (549us total) trans 339302416387 rc 0/0 00000100:00100000:3.0:1788572249.630182:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2 00000100:00080000:2.0:1788572249.630855:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572249.711213:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572249.711301:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572249.712642:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569484288 00000100:00100000:2.0:1788572249.712657:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569484288 00000100:00100000:2.0:1788572249.712760:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22615 00000100:00100000:2.0:1788572249.712772:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2396:x1875444569484288:12345-192.168.202.57@tcp:9:umount.0 00000020:00000080:2.0:1788572249.712807:0:43926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd77d 00000100:00080000:2.0:1788572249.712817:0:43926:0:(import.c:65:import_set_state_nolock()) ffff8e5a3711e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572249.712872:0:43926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975675 00000100:00100000:2.0:1788572249.713049:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+2:2396:x1875444569484288:12345-192.168.202.57@tcp:9:umount.0 Request processed in 279us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572249.713057:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22615 00010000:00010000:2.0:1788572249.713080:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572249.717173:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572249.719993:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572249.727467:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572249.727927:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569484416 00000100:00100000:1.0:1788572249.727940:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569484416 00000100:00100000:1.0:1788572249.728033:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569484160 00000100:00100000:1.0:1788572249.728037:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569484160 00000100:00100000:1.0:1788572249.728071:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4644 00000100:00100000:1.0:1788572249.728082:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712ceec8-7c82-4602-bd77-3db1811a6b63+11:2400:x1875444569484416:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572249.728114:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572249.728138:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590a60c800/0x265cfe11109bd634 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb271 expref: 11 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572249.728161:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572249.728219:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712ceec8-7c82-4602-bd77-3db1811a6b63+10:2400:x1875444569484416:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 138us (16915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572249.728226:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4644 00000100:00100000:1.0:1788572249.728247:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4645 00000100:00100000:1.0:1788572249.728255:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a062a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712ceec8-7c82-4602-bd77-3db1811a6b63+9:2397:x1875444569484160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572249.728263:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572249.728273:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11254e00/0x265cfe11109bd61f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb263 expref: 9 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572249.728285:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572249.728302:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a062a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712ceec8-7c82-4602-bd77-3db1811a6b63+8:2397:x1875444569484160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 48us (8321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572249.728309:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4645 00000100:00100000:0.0:1788572249.732595:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572249.732715:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569484544 00000100:00100000:2.0:1788572249.732725:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569484544 00000100:00100000:2.0:1788572249.732808:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22616 00000100:00100000:2.0:1788572249.732820:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+5:2396:x1875444569484544:12345-192.168.202.57@tcp:9:umount.0 00000020:00000080:2.0:1788572249.732850:0:177557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b98e6 00000100:00080000:2.0:1788572249.732860:0:177557:0:(import.c:65:import_set_state_nolock()) ffff8e590cc75800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572249.732903:0:177557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738473 00000100:00100000:2.0:1788572249.733064:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+2:2396:x1875444569484544:12345-192.168.202.57@tcp:9:umount.0 Request processed in 244us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572249.733073:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22616 00010000:00010000:3.0:1788572249.733359:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572249.733369:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572249.734973:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569484032 00000100:00100000:1.0:1788572249.734986:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569484032 00000100:00100000:1.0:1788572249.735054:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4646 00000100:00100000:1.0:1788572249.735064:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712ceec8-7c82-4602-bd77-3db1811a6b63+8:2397:x1875444569484032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572249.735079:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572249.735113:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a370b2400/0x265cfe11109bd626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb26a expref: 8 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572249.735130:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572249.735186:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712ceec8-7c82-4602-bd77-3db1811a6b63+7:2397:x1875444569484032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 123us (7735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572249.735194:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4646 00000100:00100000:0.0:1788572249.752041:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572249.752145:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569485056 00000100:00100000:1.0:1788572249.752156:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569485056 00000100:00100000:1.0:1788572249.752229:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 995 00000100:00100000:1.0:1788572249.752239:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+12:2396:x1875444569485056:12345-192.168.202.57@tcp:39:umount.0 00000020:00000080:1.0:1788572249.752285:0:188050:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd569 00000020:00010000:1.0:1788572249.752303:0:188050:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a0f05e800: total 0 00000100:00080000:1.0:1788572249.752311:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e59059d2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572249.752340:0:188050:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 79, last_transno is 339302416387 00000020:00010000:0.0:1788572249.752382:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a0f05e800: total 0 00010000:00010000:0.0:1788572249.752386:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572249.752441:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a0f05e800, canceled 0 locks, left on hash table 5. 00010000:00010000:0.0:1788572249.752475:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a31dfcf00) 00010000:00010000:0.0:1788572249.752512:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572249.752522:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a370b2200/0x265cfe11109bd776 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb27f expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572249.752538:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+9:2396:x1875444569485056:12345-192.168.202.57@tcp:39:umount.0 Request processed in 287us (523us total) trans 339302416388 rc 0/0 00000100:00100000:1.0:1788572249.752546:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 995 00010000:00010000:0.0:1788572249.752557:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e590b478800) 00010000:00010000:0.0:1788572249.752559:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788572249.752564:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1c00/0x265cfe11109bd952 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb28d expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572249.752578:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x203f:0x0].0x0 (ffff8e590b478800) 00010000:00010000:0.0:1788572249.752581:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572249.752585:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bd944 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x203f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb286 expref: 7 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572249.752602:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a18987a00) 00010000:00010000:0.0:1788572249.752604:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788572249.752608:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60ca00/0x265cfe11109bd761 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aed8a expref: 6 pid: 192536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572249.752621:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1b8b:0x0].0x0 (ffff8e5a18987a00) 00010000:00010000:0.0:1788572249.752624:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788572249.752628:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590a60d000/0x265cfe11109bd768 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1b8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25aecaa expref: 5 pid: 192536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572249.752641:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a0f05e800, canceled 5 locks, left on hash table 0. 00010000:00010000:0.0:1788572249.752668:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572249.752670:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572249.752672:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572249.760399:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572249.762228:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569485184 00000100:00100000:2.0:1788572249.762244:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569485184 00000100:00080000:3.0:1788572249.762335:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572249.762341:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 996 00000100:00100000:2.0:1788572249.762352:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+6:2396:x1875444569485184:12345-192.168.202.57@tcp:39:umount.0 00000020:00000080:2.0:1788572249.762396:0:188049:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6347 00000100:00080000:2.0:1788572249.762413:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e5a109d2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572249.762448:0:188049:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474837473 00010000:00010000:0.0:1788572249.762613:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572249.762693:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:700c1fe3-c9bd-4b4d-876e-3774b25f2a3d+3:2396:x1875444569485184:12345-192.168.202.57@tcp:39:umount.0 Request processed in 341us (2303us total) trans 21474837474 rc 0/0 00000100:00100000:2.0:1788572249.762701:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 996 00000100:00100000:3.0:1788572249.803194:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572249.803416:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569485440 00000100:00100000:1.0:1788572249.803427:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569485440 00000100:00100000:1.0:1788572249.803525:0:192508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 86 00000100:00100000:1.0:1788572249.803537:0:192508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+7:2396:x1875444569485440:12345-192.168.202.57@tcp:251:umount.0 00000020:00000080:1.0:1788572249.803585:0:192508:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd4f9 00000020:00010000:1.0:1788572249.803594:0:192508:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5903350000: total 0 00000100:00080000:1.0:1788572249.803599:0:192508:0:(import.c:65:import_set_state_nolock()) ffff8e5903351800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788572249.803694:0:192508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712ceec8-7c82-4602-bd77-3db1811a6b63+3:2396:x1875444569485440:12345-192.168.202.57@tcp:251:umount.0 Request processed in 159us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572249.803703:0:192508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 86 00000020:00010000:3.0:1788572249.804184:0:10395:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5903350000: total 0 00010000:00010000:3.0:1788572249.804259:0:10395:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5903350000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788572249.804297:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a370b3600/0x265cfe11109bd642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb278 expref: 2 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572249.804312:0:10395:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5903350000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788572249.804323:0:10395:0:(genops.c:885:class_export_put()) final put ffff8e5903350000/712ceec8-7c82-4602-bd77-3db1811a6b63 00010000:00010000:3.0:1788572249.804343:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572249.804345:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572249.804347:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572249.804451:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903350000/712ceec8-7c82-4602-bd77-3db1811a6b63 for MGS 00000020:00000080:0.0:1788572249.804532:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5903351800 for MGS 00010000:00010000:2.0:1788572250.560124:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572251.005154:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584300928:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.005230:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.005292:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572251.005300:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584301056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572251.005459:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572251.005510:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.005545:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584300928 00000100:00100000:3.0:1788572251.005552:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584300928 00000100:00100000:3.0:1788572251.005596:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788572251.005604:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584300928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.005679:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584300928:12345-0@lo:400:kworker.0 Request processed in 76us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572251.005687:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788572251.005729:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584301056 00000100:00100000:3.0:1788572251.005733:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584301056 00000100:00100000:3.0:1788572251.005772:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788572251.005779:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584301056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572251.005807:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1788572251.005840:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584301056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572251.005846:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788572251.005895:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584301056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572251.005907:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584300928:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.005946:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584301184:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.005975:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.005997:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572251.006003:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584301312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.006023:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.006048:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584301184 00000100:00100000:3.0:1788572251.006052:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584301184 00000100:00100000:3.0:1788572251.006099:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584301312 00000100:00100000:3.0:1788572251.006103:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584301312 00000100:00100000:3.0:1788572251.006126:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788572251.006133:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584301184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.006168:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584301184:12345-0@lo:400:kworker.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572251.006174:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788572251.006186:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788572251.006192:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584301312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.006219:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584301312:12345-0@lo:400:kworker.0 Request processed in 27us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572251.006225:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:3.0:1788572251.006241:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572251.006245:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572251.006262:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584301312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.006272:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584301184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.011735:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584301696:0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.011803:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.012128:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572251.012149:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584301568:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.012182:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572251.012208:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572251.012218:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584301824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.012221:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584301568 00000100:00100000:3.0:1788572251.012230:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584301568 00000100:00100000:0.0:1788572251.012253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572251.012288:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584301696 00000100:00100000:0.0:1788572251.012292:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584301696 00000100:00100000:3.0:1788572251.012296:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788572251.012309:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584301568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.012329:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788572251.012339:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584301696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.012371:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584301568:12345-0@lo:400:kworker.0 Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572251.012380:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788572251.012390:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584301696:12345-0@lo:400:kworker.0 Request processed in 53us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572251.012398:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:3.0:1788572251.012407:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572251.012427:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584301824 00000100:00100000:0.0:1788572251.012432:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584301824 00000100:00100000:3.0:1788572251.012441:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584301568:0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.012468:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7674 00000100:00100000:0.0:1788572251.012476:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584301824:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788572251.012516:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572251.012714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584301952:0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.012782:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572251.012827:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572251.012833:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584302080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.012856:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572251.012883:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584302080 00000100:00100000:1.0:1788572251.012887:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584302080 00000100:00100000:1.0:1788572251.012915:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788572251.012921:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584302080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.012959:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584302080:12345-0@lo:400:kworker.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572251.012966:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788572251.012998:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584302080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.013039:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572251.013048:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584302208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.013067:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584301952 00000100:00100000:3.0:1788572251.013072:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584301952 00000100:00100000:1.0:1788572251.013076:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.013126:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584302208 00000100:00100000:1.0:1788572251.013131:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7675 00000100:00100000:3.0:1788572251.013131:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584302208 00000100:00100000:1.0:1788572251.013143:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584301952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.013160:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7676 00000100:00100000:3.0:1788572251.013170:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584302208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.013182:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584301952:12345-0@lo:400:kworker.0 Request processed in 43us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572251.013190:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7675 00000100:00100000:3.0:1788572251.013223:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584302208:12345-0@lo:400:kworker.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572251.013231:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584302208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.013233:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7676 00000100:00080000:3.0:1788572251.013258:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572251.013263:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584301952:0@lo:400:kworker.0 00000100:00080000:3.0:1788572251.013263:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572251.013300:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584302336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.013323:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572251.013371:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584302464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.013391:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572251.013414:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584302464 00000100:00100000:1.0:1788572251.013417:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584302464 00000100:00100000:1.0:1788572251.013438:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788572251.013444:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584302464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.013474:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584302464:12345-0@lo:400:kworker.0 Request processed in 30us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572251.013499:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788572251.013522:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584302464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.013602:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584301696:0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.014194:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584301824:12345-0@lo:400:kworker.0 Request processed in 1717us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572251.014203:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7674 00000100:00100000:0.0:1788572251.014220:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584302336 00000100:00100000:0.0:1788572251.014224:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584302336 00000100:00100000:0.0:1788572251.014265:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7677 00000100:00100000:0.0:1788572251.014271:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584302336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.014310:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584302336:12345-0@lo:400:kworker.0 Request processed in 39us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572251.014316:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7677 00000100:00100000:0.0:1788572251.014344:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584302336:0@lo:400:kworker.0 00000100:00080000:0.0:1788572251.014359:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572251.014442:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584301824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572251.018025:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584301440:0@lo:400:kworker.0 00000100:00100000:2.0:1788572251.018113:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572251.018231:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584301440 00000100:00100000:1.0:1788572251.018240:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584301440 00000100:00100000:1.0:1788572251.018310:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788572251.018321:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584301440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572251.018380:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584301440:12345-0@lo:400:kworker.0 Request processed in 62us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572251.018388:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1788572251.018591:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572251.018619:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584301440:0@lo:400:kworker.0 00000001:00100000:2.0:1788572251.019273:0:184840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:2.0:1788572251.019279:0:184840:0:(genops.c:885:class_export_put()) final put ffff8e590cc73800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000001:00080000:2.0:1788572251.019309:0:184840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738473 is committed 00000020:00000080:1.0:1788572251.019378:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc73800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d for lustre-OST0000 00000020:00000080:1.0:1788572251.019431:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590cc75800 for lustre-OST0000 00010000:00010000:3.0:1788572251.582444:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572252.541009:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572252.541172:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584302848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572252.541243:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572252.541282:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572252.541288:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584302720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572252.541313:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572252.541344:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584302848 00000100:00100000:3.0:1788572252.541350:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584302848 00000100:00100000:3.0:1788572252.541396:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788572252.541405:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584302848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572252.541438:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572252.541502:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584302848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572252.541509:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788572252.541535:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584302720 00000100:00100000:3.0:1788572252.541539:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584302720 00000100:00100000:3.0:1788572252.541565:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6277 00000100:00100000:3.0:1788572252.541571:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584302720:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572252.541797:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584302848:0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1788572252.542902:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572252.543031:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584302720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1458us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572252.543040:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6277 00000100:00100000:1.0:1788572252.545046:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584302592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572252.545140:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572252.545804:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584302592 00000100:00100000:0.0:1788572252.545813:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584302592 00000100:00100000:0.0:1788572252.545874:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6278 00000100:00100000:0.0:1788572252.545884:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3a49c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584302592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572252.545918:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572252.545985:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3a49c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584302592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572252.545992:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6278 00000100:00100000:1.0:1788572252.546294:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584302592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572252.547959:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738473 gen 2 00000004:00080000:2.0:1788572252.547969:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a4101b800, transno 34359738473 00000100:00100000:2.0:1788572252.548008:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584302720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572252.604840:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572253.053005:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572253.053031:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584302976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572253.053118:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572253.053214:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584302976 00000100:00100000:1.0:1788572253.053224:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584302976 00000100:00100000:1.0:1788572253.053289:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6279 00000100:00100000:1.0:1788572253.053299:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584302976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572253.053322:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572253.053383:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584302976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572253.053390:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6279 00000100:00100000:1.0:1788572253.053434:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584302976:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572253.053662:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572253.054152:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572253.054165:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584303104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572253.054204:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572253.054332:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584303104 00000100:00100000:3.0:1788572253.054338:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584303104 00000100:00100000:3.0:1788572253.054387:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6280 00000100:00100000:3.0:1788572253.054396:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584303104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572253.054411:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572253.054458:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584303104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572253.054464:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6280 00000100:00100000:0.0:1788572253.054853:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584303104:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572253.054913:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788572253.628890:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572254.077154:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584303488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.077225:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572254.077264:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584304000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.077285:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572254.077302:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584304512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.077318:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572254.077338:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572254.077343:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584303616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.077364:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572254.077383:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584304128:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.077403:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572254.077420:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584304640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.077442:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572254.077475:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584304000 00000100:00100000:1.0:1788572254.077507:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584304000 00000100:00100000:1.0:1788572254.077556:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584304512 00000100:00100000:1.0:1788572254.077559:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584304512 00000100:00100000:1.0:1788572254.077585:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584304128 00000100:00100000:1.0:1788572254.077588:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584304128 00000100:00100000:1.0:1788572254.077603:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584304640 00000100:00100000:1.0:1788572254.077606:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584304640 00000100:00100000:1.0:1788572254.077625:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7678 00000100:00100000:1.0:1788572254.077648:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584304000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.077719:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584304000:12345-0@lo:400:kworker.0 Request processed in 86us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572254.077727:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7678 00000100:00100000:1.0:1788572254.077916:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7679 00000100:00100000:1.0:1788572254.077924:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584304512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.077958:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584304512:12345-0@lo:400:kworker.0 Request processed in 35us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572254.077964:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7679 00000100:00100000:1.0:1788572254.077977:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7680 00000100:00100000:1.0:1788572254.077983:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584304128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.078012:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584304128:12345-0@lo:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572254.078018:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7680 00000100:00100000:1.0:1788572254.078028:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7681 00000100:00100000:1.0:1788572254.078034:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584304640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.078071:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584304640:12345-0@lo:400:kworker.0 Request processed in 38us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572254.078077:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7681 00000100:00100000:1.0:1788572254.078863:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584303488 00000100:00100000:1.0:1788572254.078869:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584303488 00000100:00100000:1.0:1788572254.078896:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584303616 00000100:00100000:1.0:1788572254.078898:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584303616 00000100:00100000:1.0:1788572254.078909:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788572254.078914:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584303488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.078943:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584303488:12345-0@lo:400:kworker.0 Request processed in 30us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572254.078948:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788572254.078955:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788572254.078958:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584303616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.078981:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584303616:12345-0@lo:400:kworker.0 Request processed in 22us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572254.078987:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788572254.079044:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584303616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.079054:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584304128:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.079077:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584304640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.079088:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584303488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.079101:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584304000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.079111:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584304512:0@lo:400:kworker.0 00000100:00080000:2.0:1788572254.079150:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572254.079155:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572254.079157:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572254.079160:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572254.079165:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584303232:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.079201:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572254.079315:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584303360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.079347:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572254.079371:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584303872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.079394:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572254.079420:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584304384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.079441:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572254.079472:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584303872 00000100:00100000:3.0:1788572254.079476:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584303872 00000100:00100000:3.0:1788572254.079524:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584304384 00000100:00100000:3.0:1788572254.079527:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584304384 00000100:00100000:3.0:1788572254.079541:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788572254.079547:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584303872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.079587:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584303872:12345-0@lo:400:kworker.0 Request processed in 40us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572254.079594:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788572254.079608:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788572254.079614:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584304384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.079640:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584304384:12345-0@lo:400:kworker.0 Request processed in 26us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572254.079646:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788572254.079663:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584303360 00000100:00100000:3.0:1788572254.079920:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584303360 00000100:00100000:3.0:1788572254.079959:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788572254.079965:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584303360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.079997:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584303360:12345-0@lo:400:kworker.0 Request processed in 33us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572254.080003:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788572254.080034:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584303360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.080043:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584303872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.080052:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584304384:0@lo:400:kworker.0 00000100:00080000:3.0:1788572254.080294:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572254.080986:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584303744:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.081030:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572254.081073:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584304256:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.081095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572254.081119:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584304768:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.081139:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.081540:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584303744 00000100:00100000:0.0:1788572254.081548:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584303744 00000100:00100000:0.0:1788572254.081596:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584304256 00000100:00100000:0.0:1788572254.081599:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584304256 00000100:00100000:0.0:1788572254.081612:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584304768 00000100:00100000:0.0:1788572254.081613:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584304768 00000100:00100000:0.0:1788572254.081627:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1788572254.081954:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572254.081973:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788572254.081981:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584304256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.082047:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584304256:12345-0@lo:400:kworker.0 Request processed in 67us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572254.082054:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788572254.082087:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788572254.082094:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584304768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.082125:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584304768:12345-0@lo:400:kworker.0 Request processed in 33us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572254.082131:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788572254.082173:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584304256:0@lo:400:kworker.0 00000100:00100000:1.0:1788572254.082182:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584304768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.082239:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584303744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.082290:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584303744:12345-0@lo:400:kworker.0 Request processed in 655us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.082297:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788572254.085989:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584303744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572254.086681:0:192508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584303232 00000100:00100000:2.0:1788572254.086689:0:192508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584303232 00000100:00100000:0.0:1788572254.086908:0:192507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788572254.086921:0:192507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584303232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.087021:0:192507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584303232:12345-0@lo:400:kworker.0 Request processed in 103us (7819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.087029:0:192507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788572254.088049:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584303232:0@lo:400:kworker.0 00010000:00010000:3.0:1788572254.653090:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788572255.102439:0:192502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000001:00080000:3.0:1788572255.102456:0:192502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416388 is committed 00000020:00000080:3.0:1788572255.102463:0:192502:0:(genops.c:885:class_export_put()) final put ffff8e5a0f05e800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:1.0:1788572255.104025:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f05e800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d for lustre-MDT0000 00000020:00000080:1.0:1788572255.104193:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59059d2800 for lustre-MDT0000 00010000:00010000:2.0:1788572255.679311:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572256.130096:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572256.130119:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584304896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572256.130185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572256.130373:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584304896 00000100:00100000:3.0:1788572256.130381:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584304896 00000100:00100000:3.0:1788572256.130424:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788572256.130433:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584304896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572256.130466:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1788572256.130548:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584304896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572256.130555:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788572256.130614:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584304896:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788572256.132910:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000001:00080000:2.0:1788572256.132924:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837474 is committed 00000020:00000080:2.0:1788572256.132930:0:188042:0:(genops.c:885:class_export_put()) final put ffff8e5a1f80c800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:1.0:1788572256.133233:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1f80c800/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d for lustre-MDT0001 00000020:00000080:1.0:1788572256.133306:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a109d2800 for lustre-MDT0001 00000001:00100000:3.0:1788572256.136824:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:3.0:1788572256.136834:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5a37119000/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d 00000020:00000080:0.0:1788572256.137919:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a37119000/700c1fe3-c9bd-4b4d-876e-3774b25f2a3d for lustre-OST0001 00000020:00000080:0.0:1788572256.138076:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a3711e000 for lustre-OST0001 00010000:00010000:3.0:1788572256.702932:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788572257.185136:0:193450:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788572257.185195:0:193450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572257.185211:0:193450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572257.185218:0:193450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572257.185225:0:193450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572257.185250:0:193450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788572257.185256:0:193450:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788572257.185289:0:193450:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572257.185293:0:193450:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788572257.185300:0:193450:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788572257.185325:0:193450:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788572257.185573:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584305024:0@lo:39:umount.0 00000100:00100000:0.0:1788572257.185666:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572257.187958:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584305024 00000100:00100000:1.0:1788572257.187973:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584305024 00000100:00100000:1.0:1788572257.188058:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1788572257.188069:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875444584305024:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572257.188099:0:188048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd714 00000100:00080000:1.0:1788572257.188109:0:188048:0:(import.c:65:import_set_state_nolock()) ffff8e59059d2000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788572257.188202:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+1:3640:x1875444584305024:12345-0@lo:39:umount.0 Request processed in 135us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572257.188210:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000020:00000080:1.0:1788572257.188221:0:188048:0:(genops.c:885:class_export_put()) final put ffff8e59059d0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788572257.188822:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59059d0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572257.188879:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59059d2000 for lustre-MDT0000 00010000:00010000:3.0:1788572257.189264:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572257.189274:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.189284:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2e00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572257.189289:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.189300:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572257.189308:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572257.189315:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788572257.189318:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788572257.189321:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788572257.189355:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.189363:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572257.189398:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.189406:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2e00/0x265cfe11109bd69d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd6a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.189421:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572257.189423:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572257.189426:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572257.189945:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584305152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572257.190007:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572257.190079:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584305152 00000100:00100000:1.0:1788572257.190085:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584305152 00000100:00100000:1.0:1788572257.190131:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4647 00000100:00100000:1.0:1788572257.190139:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584305152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572257.190152:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572257.190166:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01670e00/0x265cfe11109bd6a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd69d expref: 24 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572257.190182:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572257.190212:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3643:x1875444584305152:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572257.190219:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4647 00000100:00100000:1.0:1788572257.190253:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584305152:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788572257.191878:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788572257.191899:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572257.191938:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572257.192000:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584305024:0@lo:39:umount.0 00000100:00080000:1.0:1788572257.195451:0:193450:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572257.195460:0:193450:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788572257.195467:0:193450:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788572257.197093:0:193450:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788572257.197102:0:193450:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788572257.197108:0:193450:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788572257.197134:0:193450:0:(import.c:65:import_set_state_nolock()) ffff8e59022d3000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788572257.197204:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584305280:0@lo:39:umount.0 00000100:00100000:1.0:1788572257.197287:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572257.197388:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584305280 00000100:00100000:2.0:1788572257.197396:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584305280 00000100:00100000:2.0:1788572257.197461:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1788572257.197472:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875444584305280:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788572257.197511:0:188050:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b7656 00000100:00080000:2.0:1788572257.197519:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e590cc74800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788572257.198101:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+1:3640:x1875444584305280:12345-0@lo:39:umount.0 Request processed in 628us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572257.198110:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000020:00000080:2.0:1788572257.198121:0:188050:0:(genops.c:885:class_export_put()) final put ffff8e5a109d4800/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:2.0:1788572257.198157:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788572257.198171:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572257.198210:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109d4800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:1.0:1788572257.198404:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59022d3000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788572257.198422:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584305280:0@lo:39:umount.0 00000100:00080000:3.0:1788572257.198527:0:193450:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788572257.198900:0:193450:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788572257.198905:0:193450:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788572257.200761:0:193450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.200783:0:193450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.200790:0:193450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.200798:0:193450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.200866:0:193450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572257.200874:0:193450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.200881:0:193450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.200887:0:193450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572257.200894:0:193450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788572257.201230:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590cc74800 for lustre-MDT0001 00010000:00010000:2.0:1788572257.202186:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572257.202197:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.202207:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572257.202212:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.202233:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572257.202241:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572257.202247:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572257.202249:0:82817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788572257.202287:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.202294:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788572257.202351:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584305408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572257.202415:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572257.202743:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584305408 00000100:00100000:0.0:1788572257.202751:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584305408 00000100:00100000:0.0:1788572257.202806:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4648 00000100:00100000:0.0:1788572257.202815:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3644:x1875444584305408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572257.202828:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572257.202845:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01671600/0x265cfe11109bd6b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd6ab expref: 23 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572257.202860:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572257.203091:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.203099:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bd6ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd6b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.203115:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572257.203119:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.203124:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670200 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572257.203127:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.203133:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572257.203139:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572257.203144:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788572257.203146:0:82817:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788572257.203161:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.203167:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572257.203184:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.203191:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572257.203193:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572257.203195:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572257.203442:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584305536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572257.203473:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572257.204090:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584305536 00000100:00100000:2.0:1788572257.204098:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584305536 00000100:00100000:2.0:1788572257.204138:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4649 00000100:00100000:2.0:1788572257.204146:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3641:x1875444584305536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572257.204157:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572257.204170:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01671400/0x265cfe11109bd6c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd6b9 expref: 23 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572257.204182:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572257.204235:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3641:x1875444584305536:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572257.204241:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4649 00000100:00100000:2.0:1788572257.204283:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584305536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572257.204509:0:193450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572257.204516:0:193450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a01670200/0x265cfe11109bd6b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd6c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572257.204528:0:193450:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788572257.204533:0:193450:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788572257.204535:0:193450:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788572257.204607:0:193450:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788572257.204612:0:193450:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:3.0:1788572257.204619:0:193450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788572257.204625:0:193450:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00000100:00100000:0.0:1788572257.204795:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3644:x1875444584305408:12345-0@lo:103:ldlm_bl.0 Request processed in 1979us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572257.204802:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4648 00010000:00010000:2.0:1788572257.206571:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:3.0:1788572257.207201:0:193450:0:(ofd_obd.c:1268:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:3.0:1788572257.207328:0:193450:0:(ofd_obd.c:1282:ofd_iocontrol()) syncing ost lustre-OST0000 00000100:00100000:1.0:1788572257.207808:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584305408:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788572257.209064:0:193450:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788572257.209074:0:193450:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8e5a4106b000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 34359738473 stale:0 00000020:00080000:3.0:1788572257.209081:0:193450:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8e5a36e24800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 34359738466 stale:0 00000020:00080000:3.0:1788572257.209086:0:193450:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8e5904158000) has exports, disconnecting them 00000020:00080000:3.0:1788572257.209091:0:193450:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8e5a4106b000), last request at 1788572254 00000020:00000080:3.0:1788572257.209099:0:193450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd5cb 00000100:00080000:3.0:1788572257.209111:0:193450:0:(import.c:65:import_set_state_nolock()) ffff8e5a4106f000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572257.209164:0:193450:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a4106b000): rc 0 00000020:00000080:3.0:1788572257.209167:0:193450:0:(genops.c:885:class_export_put()) final put ffff8e5a4106b000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1788572257.209182:0:193450:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8e5a36e24800), last request at 1788572254 00000020:00000080:3.0:1788572257.209186:0:193450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b637f 00000100:00080000:3.0:1788572257.209191:0:193450:0:(import.c:65:import_set_state_nolock()) ffff8e5a36e22800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788572257.209227:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a4106b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788572257.209275:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a4106f000 for lustre-OST0000 00010000:00010000:0.0:1788572257.209410:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788572257.209466:0:193450:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a36e24800): rc 0 00000020:00000080:3.0:1788572257.209469:0:193450:0:(genops.c:885:class_export_put()) final put ffff8e5a36e24800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1788572257.209574:0:193450:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8e5904158000) has no exports 00010000:00010000:0.0:1788572257.211770:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788572257.212731:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36e24800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788572257.213007:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a36e22800 for lustre-OST0000 00000020:01000000:3.0:1788572257.213081:0:193450:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a11104ea0 - data ffff8e5a0f5580d8/ffff8e5a1fec7400 00000020:01000000:3.0:1788572257.213303:0:193450:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a244d6840 - data ffff8e5901e10948/ffff8e5a114cdc00 00100000:10000000:3.0:1788572257.233177:0:193450:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788572257.240180:0:193450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe111097f108 00000020:00000080:2.0:1788572257.240192:0:193450:0:(genops.c:885:class_export_put()) final put ffff8e590b16b800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788572257.240245:0:193450:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a40f56000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788572257.240249:0:193450:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a40f56000 2 00000020:01000004:2.0:1788572257.240252:0:193450:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5a40f56000 from lustre-OST0000 00000020:00000080:2.0:1788572257.240277:0:193450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572257.240288:0:193450:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788572257.240291:0:193450:0:(genops.c:885:class_export_put()) final put ffff8e5906753800/lustre-OST0000_UUID 00000020:00000080:2.0:1788572257.240294:0:193450:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906753800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788572257.240300:0:193450:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788572257.240352:0:193450:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1788572257.240357:0:193450:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788572257.240360:0:193450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572257.240367:0:193450:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788572257.240373:0:193450:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e5a2454b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572257.240379:0:193450:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8e59028a4d40) has exports, disconnecting them 00000020:00080000:2.0:1788572257.240383:0:193450:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e5a2454b000), last request at 1788571809 00000020:00000080:2.0:1788572257.240387:0:193450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe111097f147 00000020:00080000:2.0:1788572257.240396:0:193450:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a2454b000): rc 0 00000020:00000080:2.0:1788572257.240401:0:193450:0:(genops.c:885:class_export_put()) final put ffff8e5a2454b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788572257.243774:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b16b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788572257.244746:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a2454b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788572257.258454:0:193450:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788572257.258464:0:193450:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572257.258469:0:193450:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788572257.258530:0:193450:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572257.258853:0:193450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572257.258865:0:193450:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788572257.258872:0:193450:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788572257.258877:0:193450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572257.258882:0:193450:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788572257.258889:0:193450:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8e5a372e4000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572257.258896:0:193450:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8e59028a19c0) has exports, disconnecting them 00000020:00080000:2.0:1788572257.258900:0:193450:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8e5a372e4000), last request at 1788571809 00000020:00000080:2.0:1788572257.258904:0:193450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe111097f15c 00000020:00080000:2.0:1788572257.258919:0:193450:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a372e4000): rc 0 00000020:00000080:2.0:1788572257.258923:0:193450:0:(genops.c:885:class_export_put()) final put ffff8e5a372e4000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788572257.259001:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0a15c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788572257.259008:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5a24620800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788572257.259011:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a24620800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788572257.259017:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788572257.260209:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a372e4000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788572257.270620:0:193450:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788572257.270629:0:193450:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788572257.270633:0:193450:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788572257.270741:0:193450:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572257.270956:0:193450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572257.270968:0:193450:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788572257.270975:0:193450:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a40f56000 1 00000020:00000080:3.0:1788572257.270982:0:193450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe111097f0ec 00000020:00000080:3.0:1788572257.270990:0:193450:0:(genops.c:885:class_export_put()) final put ffff8e590bb67800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788572257.271130:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59022d3000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788572257.271137:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5a109d6800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788572257.271141:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109d6800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788572257.271153:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:3.0:1788572257.271845:0:193450:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788572257.271853:0:193450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572257.271863:0:193450:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572257.271867:0:193450:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8e590415cd40) has no exports 00000020:00000080:1.0:1788572257.279142:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590bb67800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788572257.397444:0:193450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572257.397463:0:193450:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788572257.397469:0:193450:0:(genops.c:885:class_export_put()) final put ffff8e5a40f51000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788572257.397474:0:193450:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a40f51000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788572257.397967:0:193450:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788572257.398128:0:193450:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e5a40f57000 00000020:02000400:3.0:1788572257.398194:0:193450:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:1.0:1788572257.664988:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584305664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572257.665071:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572257.665130:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584305664 00000100:00100000:1.0:1788572257.665137:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584305664 00000100:00100000:1.0:1788572257.665190:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6281 00000100:00100000:1.0:1788572257.665199:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584305664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572257.665294:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572257.665340:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584305664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572257.665347:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6281 00000100:00080000:1.0:1788572257.665370:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572257.665407:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584305664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572257.690554:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584305792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572257.690630:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572257.690700:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584305792 00000100:00100000:3.0:1788572257.690710:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584305792 00000100:00100000:3.0:1788572257.690758:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788572257.690768:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584305792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572257.690805:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572257.690852:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584305792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572257.690863:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788572257.690910:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584305792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572257.691242:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584305920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572257.691277:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572257.691313:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584305920 00000100:00100000:1.0:1788572257.691317:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584305920 00000100:00100000:1.0:1788572257.691338:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6282 00000100:00100000:1.0:1788572257.691343:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3644:x1875444584305920:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1788572257.691349:0:8435:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572257.691379:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3644:x1875444584305920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (102us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572257.691385:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6282 00000100:02020000:1.0:1788572257.691414:0:3644:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788572257.691419:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572257.691424:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5a109b8000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572257.691427:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1788572257.691437:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1788572257.691439:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5a109b8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572257.691443:0:3644:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8962 00000100:00080000:1.0:1788572257.691449:0:3644:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5a109b8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572257.691469:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36b91f80 x1875444584306048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572257.691514:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584306048:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:1.0:1788572257.691541:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572257.691571:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584306048 00000100:00100000:1.0:1788572257.691575:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584306048 00000100:00100000:1.0:1788572257.691596:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22617 00000100:00100000:1.0:1788572257.691615:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3640:x1875444584306048:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:1.0:1788572257.691632:0:43920:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572257.691673:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3640:x1875444584306048:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 58us (131us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572257.691680:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22617 00000100:00080000:1.0:1788572257.691707:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a109b8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572257.691712:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572257.691714:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584306048:0@lo:8:ptlrpcd_00_03.0 00010000:00010000:1.0:1788572257.727404:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572258.173654:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572258.173679:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584306176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572258.173836:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572258.173905:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584306176 00000100:00100000:0.0:1788572258.173914:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584306176 00000100:00100000:0.0:1788572258.173964:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6283 00000100:00100000:0.0:1788572258.173973:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3642:x1875444584306176:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:0.0:1788572258.173981:0:9987:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788572258.174040:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3642:x1875444584306176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (203us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788572258.174048:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6283 00000100:02020000:3.0:1788572258.174128:0:3642:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788572258.174134:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788572258.174139:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788572258.174143:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788572258.174351:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572258.174362:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584306304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572258.174390:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572258.174418:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584306304 00000100:00100000:2.0:1788572258.174421:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584306304 00000100:00100000:2.0:1788572258.174455:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6284 00000100:00100000:2.0:1788572258.174460:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584306304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572258.174494:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572258.174531:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584306304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572258.174537:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6284 00000100:00080000:2.0:1788572258.174555:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572258.174596:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584306304:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1788572258.175826:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1788572258.175834:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572258.175841:0:3642:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8793 00000100:00080000:3.0:1788572258.175848:0:3642:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572258.175876:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104df80 x1875444584306432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572258.175912:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584306432:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1788572258.175967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572258.176039:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584306432 00000100:00100000:3.0:1788572258.176045:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584306432 00000100:00100000:3.0:1788572258.176092:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22618 00000100:00100000:3.0:1788572258.176100:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3640:x1875444584306432:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:3.0:1788572258.176120:0:177559:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572258.176165:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3640:x1875444584306432:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 65us (198us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572258.176171:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22618 00000100:00080000:3.0:1788572258.176207:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572258.176212:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572258.176215:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584306432:0@lo:8:ptlrpcd_00_01.0 00010000:00010000:1.0:1788572258.757400:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572259.214602:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572259.214609:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572259.214613:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572259.214622:0:177620:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9011 00000100:00080000:2.0:1788572259.214629:0:177620:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788572259.214637:0:177620:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572259.214659:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffab100 x1875444584307072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572259.214698:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572259.214702:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572259.214704:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a109b8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572259.214709:0:177620:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 9010 00000100:00080000:2.0:1788572259.214712:0:177620:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788572259.214716:0:177620:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5a109b8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572259.214728:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffaa680 x1875444584307584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572259.214798:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584306560:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.214864:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.214902:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584307200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.214932:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.214952:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584307840:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.214972:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.214995:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572259.215001:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584306688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.215041:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.215058:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584307328:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.215080:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.215111:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584306816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.215134:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.215148:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584307456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.215168:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.215184:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788572259.215189:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584306944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.215209:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.215230:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584307712:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.215249:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.215279:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584307072:0@lo:8:kworker.0 00000100:00100000:2.0:1788572259.215299:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.215315:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584307584:0@lo:8:kworker.0 00000100:00100000:2.0:1788572259.215334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572259.215365:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584307200 00000100:00100000:2.0:1788572259.215372:0:192509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584306560 00000100:00100000:3.0:1788572259.215374:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584307200 00000100:00100000:2.0:1788572259.215378:0:192509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584306560 00000100:00100000:2.0:1788572259.215422:0:192509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788572259.215432:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584307712 00000100:00100000:2.0:1788572259.215433:0:192509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5901afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3643:x1875444584306560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572259.215438:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584307712 00000100:00100000:3.0:1788572259.215473:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584307072 00000100:00100000:3.0:1788572259.215477:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584307072 00000100:00100000:2.0:1788572259.215508:0:192509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5901afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3643:x1875444584306560:12345-0@lo:400:kworker.0 Request processed in 76us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572259.215513:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584307584 00000100:00100000:2.0:1788572259.215517:0:192509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788572259.215519:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584307584 00000100:00100000:3.0:1788572259.215541:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7682 00000100:00100000:3.0:1788572259.215551:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584307200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.215558:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7683 00000100:00100000:2.0:1788572259.215569:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584307712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572259.215599:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584307200:12345-0@lo:400:kworker.0 Request processed in 49us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572259.215607:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7682 00000100:00100000:2.0:1788572259.215616:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584307712:12345-0@lo:400:kworker.0 Request processed in 49us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.215624:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7683 00000100:00100000:3.0:1788572259.215630:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22619 00000100:00100000:3.0:1788572259.215637:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:0+-99:3640:x1875444584307072:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788572259.215645:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22620 00000100:00100000:2.0:1788572259.215651:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3640:x1875444584307584:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788572259.215656:0:179391:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1788572259.215664:0:43923:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572259.215702:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:0+-99:3640:x1875444584307072:12345-0@lo:8:kworker.0 Request processed in 62us (399us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572259.215704:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3640:x1875444584307584:12345-0@lo:8:kworker.0 Request processed in 50us (368us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572259.215718:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22619 00000100:00100000:2.0:1788572259.215861:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22620 00000100:00100000:2.0:1788572259.215882:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584307840 00000100:00100000:2.0:1788572259.215886:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584307840 00000100:00100000:2.0:1788572259.215903:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584306688 00000100:00100000:2.0:1788572259.215905:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584306688 00000100:00100000:2.0:1788572259.215916:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584307328 00000100:00100000:2.0:1788572259.215919:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584307328 00000100:00100000:2.0:1788572259.215931:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584306816 00000100:00100000:2.0:1788572259.215933:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584306816 00000100:00100000:2.0:1788572259.215948:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788572259.215953:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584307840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.215982:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584307840:12345-0@lo:400:kworker.0 Request processed in 29us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.215987:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788572259.216000:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788572259.216104:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584306688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216136:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584306688:12345-0@lo:400:kworker.0 Request processed in 131us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.216142:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788572259.216154:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788572259.216159:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584307328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216181:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584307328:12345-0@lo:400:kworker.0 Request processed in 23us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.216187:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788572259.216198:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788572259.216204:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584306816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216227:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584306816:12345-0@lo:400:kworker.0 Request processed in 25us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.216232:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788572259.216258:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584307456 00000100:00100000:2.0:1788572259.216262:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584307456 00000100:00100000:2.0:1788572259.216294:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584306944 00000100:00100000:2.0:1788572259.216297:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584306944 00000100:00100000:2.0:1788572259.216308:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788572259.216313:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584307456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216344:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584307456:12345-0@lo:400:kworker.0 Request processed in 30us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.216350:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788572259.216361:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788572259.216367:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584306944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216394:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584306944:12345-0@lo:400:kworker.0 Request processed in 28us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.216400:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:2.0:1788572259.216434:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572259.216438:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572259.216440:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572259.216667:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572259.216672:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572259.216676:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584307072:0@lo:8:kworker.0 00000100:00080000:2.0:1788572259.216686:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a109b8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572259.216689:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572259.216691:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584307584:0@lo:8:kworker.0 00000100:00100000:2.0:1788572259.216726:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584306944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216736:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584307712:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216745:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584306816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216753:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584307456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216780:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584306688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216790:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584307328:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216798:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584306560:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216806:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584307200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.216814:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584307840:0@lo:400:kworker.0 00010000:00010000:2.0:1788572259.776815:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572260.822310:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572261.246745:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584307968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572261.246818:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572261.247121:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584307968 00000100:00100000:2.0:1788572261.248287:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584307968 00000100:00100000:2.0:1788572261.248359:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788572261.248370:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584307968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572261.248410:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446064128 avail 1299824640 00000100:00100000:2.0:1788572261.248571:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584307968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572261.248578:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788572261.248634:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584307968:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788572261.826427:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788572262.393566:0:193650:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788572262.393620:0:193650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.393635:0:193650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.393642:0:193650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.393649:0:193650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.393670:0:193650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788572262.393675:0:193650:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788572262.394191:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572262.394201:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.394210:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3000 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572262.394214:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.394224:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572262.394232:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572262.394237:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572262.394240:0:10395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788572262.394242:0:10395:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788572262.394285:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.394293:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572262.394321:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.394328:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3000/0x265cfe11109bd5fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd603 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.394339:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.394341:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.394342:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572262.394538:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584308096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572262.394611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572262.395932:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584308096 00000100:00100000:0.0:1788572262.395946:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584308096 00000100:00100000:0.0:1788572262.396047:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4650 00000100:00100000:0.0:1788572262.396057:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3641:x1875444584308096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572262.396072:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572262.396090:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590a60c200/0x265cfe11109bd603 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd5fc expref: 21 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.396104:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572262.396160:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:3641:x1875444584308096:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572262.396167:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4650 00000100:00100000:0.0:1788572262.396210:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584308096:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788572262.399475:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572262.399616:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788572262.399626:0:193650:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788572262.399657:0:193650:0:(import.c:65:import_set_state_nolock()) ffff8e5a37118000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788572262.401266:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584308224:0@lo:39:umount.0 00000100:00100000:2.0:1788572262.401347:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572262.401529:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584308224 00000100:00100000:1.0:1788572262.401547:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584308224 00000100:00100000:1.0:1788572262.401595:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1788572262.401604:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584308224:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572262.401631:0:188048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd722 00000100:00080000:1.0:1788572262.401639:0:188048:0:(import.c:65:import_set_state_nolock()) ffff8e5906855800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788572262.401710:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572262.401717:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875444584308224:12345-0@lo:39:umount.0 Request processed in 114us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572262.401725:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000020:00000080:1.0:1788572262.401735:0:188048:0:(genops.c:885:class_export_put()) final put ffff8e5a109be000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788572262.401773:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a37118000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572262.401790:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584308224:0@lo:39:umount.0 00000100:00080000:1.0:1788572262.401838:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:3.0:1788572262.401838:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109be000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1788572262.401842:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788572262.401846:0:193650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572262.401891:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5906855800 for lustre-MDT0000 00010000:00010000:1.0:1788572262.402881:0:193650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.402896:0:193650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.402904:0:193650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.402911:0:193650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.402938:0:193650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572262.402945:0:193650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.402952:0:193650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.402958:0:193650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.402969:0:193650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.402994:0:193650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572262.403001:0:193650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.403008:0:193650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403013:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572262.403014:0:193650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.403020:0:193650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403021:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403028:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b2c00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572262.403032:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.403034:0:193650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572262.403038:0:193650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403041:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.403045:0:193650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572262.403049:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.403051:0:193650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.403057:0:193650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572262.403061:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572262.403064:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788572262.403072:0:193650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788572262.403075:0:193650:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788572262.403080:0:193650:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788572262.403096:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403101:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:1.0:1788572262.403110:0:193650:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788572262.403115:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788572262.403119:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1788572262.403121:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:1.0:1788572262.403124:0:193650:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1788572262.403127:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2c00/0x265cfe11109bd523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd52a expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403140:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572262.403143:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403148:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60d200 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572262.403151:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403156:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572262.403162:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572262.403167:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572262.403169:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788572262.403182:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788572262.403195:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403201:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572262.403219:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403224:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590a60d200/0x265cfe11109bd649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403233:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572262.403236:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403241:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590a60c600 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572262.403243:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403249:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572262.403254:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572262.403259:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788572262.403261:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788572262.403263:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788572262.403275:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403281:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572262.403286:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403293:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590a60c600/0x265cfe11109bd5ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd5f5 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403304:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572262.403307:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403312:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a370b3a00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572262.403316:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403322:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572262.403328:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572262.403333:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572262.403334:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788572262.403336:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788572262.403347:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403352:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572262.403372:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403378:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3a00/0x265cfe11109bd50e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd515 expref: -99 pid: 192501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403391:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.403393:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.403394:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.403402:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.403408:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572262.403424:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584308352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572262.403475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572262.403558:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572262.403563:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584308736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572262.403587:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572262.403611:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584308480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572262.403630:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572262.403645:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572262.403649:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584308608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572262.403666:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572262.403708:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584308352 00000100:00100000:0.0:1788572262.403713:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584308352 00000100:00100000:0.0:1788572262.403749:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584308736 00000100:00100000:0.0:1788572262.403752:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584308736 00000100:00100000:0.0:1788572262.403781:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584308480 00000100:00100000:0.0:1788572262.403784:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584308480 00000100:00100000:0.0:1788572262.403794:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584308608 00000100:00100000:0.0:1788572262.403797:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584308608 00000100:00100000:0.0:1788572262.403812:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4651 00000100:00100000:0.0:1788572262.403818:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3642:x1875444584308352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572262.403829:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572262.403842:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11254c00/0x265cfe11109bd52a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd523 expref: 23 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403857:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572262.403885:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3642:x1875444584308352:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572262.403891:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4651 00000100:00100000:0.0:1788572262.403907:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4652 00000100:00100000:0.0:1788572262.403912:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a04f34450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3642:x1875444584308736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572262.403919:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572262.403927:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590a60dc00/0x265cfe11109bd515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd50e expref: 21 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.403934:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572262.403953:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a04f34450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:3642:x1875444584308736:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572262.403959:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4652 00000100:00100000:0.0:1788572262.404006:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4653 00000100:00100000:0.0:1788572262.404011:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3643:x1875444584308480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572262.404018:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572262.404025:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a370b2800/0x265cfe11109bd650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd649 expref: 19 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.404032:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572262.404054:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:3643:x1875444584308480:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572262.404060:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4653 00000100:00100000:0.0:1788572262.404071:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4654 00000100:00100000:0.0:1788572262.404077:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:3643:x1875444584308608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572262.404084:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572262.404091:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590a60c000/0x265cfe11109bd5f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd5ee expref: 17 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.404098:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572262.404116:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:3643:x1875444584308608:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572262.404121:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4654 00000100:00100000:0.0:1788572262.404161:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584308608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572262.404168:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584308480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572262.404187:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584308736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572262.404193:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584308352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572262.404886:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1788572262.408622:0:193650:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1788572262.409251:0:193650:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1788572262.409260:0:193650:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e59059d7000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572262.409267:0:193650:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e590cac0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572262.409271:0:193650:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a0f059000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 326417519069 stale:0 00000020:00080000:1.0:1788572262.409277:0:193650:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8e5901bfcd40) has exports, disconnecting them 00000020:00080000:1.0:1788572262.409282:0:193650:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e59059d7000), last request at 1788572215 00000020:00000080:1.0:1788572262.409289:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd71b 00000100:00080000:1.0:1788572262.409298:0:193650:0:(import.c:65:import_set_state_nolock()) ffff8e59059d5800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788572262.409327:0:193650:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e59059d7000): rc 0 00000020:00000080:1.0:1788572262.409329:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e59059d7000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788572262.409342:0:193650:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e590cac0800), last request at 1788572259 00000020:00000080:1.0:1788572262.409345:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd70d 00000100:00080000:1.0:1788572262.409355:0:193650:0:(import.c:65:import_set_state_nolock()) ffff8e590cac1000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788572262.409385:0:193650:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e590cac0800): rc 0 00000020:00000080:1.0:1788572262.409387:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e590cac0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788572262.409390:0:193650:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a0f059000), last request at 1788572209 00000020:00000080:1.0:1788572262.409394:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd570 00000100:00080000:1.0:1788572262.409402:0:193650:0:(import.c:65:import_set_state_nolock()) ffff8e590cac4800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788572262.409410:0:193650:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a0f059000): rc 0 00000020:00000080:1.0:1788572262.409413:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a0f059000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1788572262.409420:0:193650:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaac780d17ae0 00000100:00080000:1.0:1788572262.409435:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788572262.409439:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:0.0:1788572262.410056:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59059d7000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788572262.410097:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cac0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788572262.410119:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f059000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788572262.410144:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59059d5800 for lustre-MDT0000 00000020:00000080:0.0:1788572262.410148:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590cac1000 for lustre-MDT0000 00000020:00000080:0.0:1788572262.410151:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590cac4800 for lustre-MDT0000 00010000:00010000:0.0:1788572262.410161:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.410165:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572262.410236:0:193650:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788572262.410259:0:193650:0:(import.c:65:import_set_state_nolock()) ffff8e5a109bf000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788572262.410307:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584308864:0@lo:39:umount.0 00000100:00100000:0.0:1788572262.410388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572262.410410:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572262.410863:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788572262.410872:0:193650:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8e5a36b92680 x1875444584305920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788572273 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572262.410900:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738473 gen 3 00000004:00080000:0.0:1788572262.410916:0:193650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788572262.410975:0:193650:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788572262.410978:0:193650:0:(import.c:65:import_set_state_nolock()) ffff8e5a109b8000 lustre-OST0000_UUID: changing import state from DISCONN to CLOSED 00000004:00080000:0.0:1788572262.410991:0:193650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788572262.410993:0:193650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788572262.410996:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788572262.410998:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975675 gen 3 00000004:00080000:0.0:1788572262.411005:0:193650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572262.411027:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584305920:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572262.411060:0:193650:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788572262.411070:0:193650:0:(import.c:65:import_set_state_nolock()) ffff8e5906853800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788572262.411121:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584308992:0@lo:9:umount.0 00000020:00080000:0.0:1788572262.411144:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e5901bfcd40) has no exports 00000100:00100000:2.0:1788572262.411155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572262.411457:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584308864 00000100:00100000:1.0:1788572262.411466:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584308864 00000100:00100000:1.0:1788572262.411702:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788572262.411712:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584308864:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572262.411739:0:189111:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd5af 00000100:00080000:1.0:1788572262.411754:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1a9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572262.411779:0:189111:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474837474 00000100:00100000:1.0:1788572262.411927:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1875444584308864:12345-0@lo:39:umount.0 Request processed in 215us (1538us total) trans 21474837475 rc 0/0 00000100:00100000:1.0:1788572262.411935:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00010000:3.0:1788572262.411980:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788572262.413520:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e5901bfcd40) has no exports 00000100:00100000:1.0:1788572262.420696:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584308992 00000100:00100000:1.0:1788572262.420712:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584308992 00000100:00100000:1.0:1788572262.421186:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22621 00000100:00100000:1.0:1788572262.421198:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584308992:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788572262.421241:0:41719:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd5d9 00000100:00080000:1.0:1788572262.421251:0:41719:0:(import.c:65:import_set_state_nolock()) ffff8e5a4106e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572262.421303:0:41719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975675 00000100:00100000:1.0:1788572262.421523:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3640:x1875444584308992:12345-0@lo:9:umount.0 Request processed in 327us (10365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572262.421531:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22621 00010000:00010000:1.0:1788572262.421709:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572262.421744:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5906853800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788572262.421755:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788572262.421873:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572262.421879:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584308992:0@lo:9:umount.0 00000100:00080000:1.0:1788572262.421901:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a109bf000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788572262.421905:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584308864:0@lo:39:umount.0 00000100:00080000:3.0:1788572262.427895:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1788572262.512916:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd585 00000020:00000080:0.0:1788572262.512933:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a3f907800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788572262.513005:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788572262.513096:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572262.513110:0:193650:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572262.513115:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8e5a413fb380) has no exports 00000020:00000080:1.0:1788572262.513813:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd57e 00000020:00000080:1.0:1788572262.513820:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a0f3c1000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788572262.513980:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f907800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788572262.514138:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572262.514148:0:193650:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788572262.514151:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a0efd9000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788572262.514154:0:193650:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efd9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788572262.514164:0:193650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788572262.514860:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f3c1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788572262.514932:0:193650:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a1fefbd20 - data ffff8e5a0f4fd438/ffff8e5a3732e000 00000020:01000000:1.0:1788572262.515077:0:193650:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a244d65a0 - data ffff8e5a35a20e58/ffff8e5905543800 00000100:00080000:1.0:1788572262.596528:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788572262.596539:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788572262.596558:0:193650:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e5a2746e300 x1875444584308864/t21474837475(21474837475) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572272 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572262.596587:0:193650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788572262.600525:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572262.600532:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738473 gen 4 00000004:00080000:1.0:1788572262.600556:0:193650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572262.600559:0:193650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788572262.601011:0:192521:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788572262.601016:0:192521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13c:0x0] index 2 count 1 00000040:00080000:2.0:1788572262.601027:0:192521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 79 count 2 00000100:00080000:3.0:1788572262.602397:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788572262.602403:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975675 gen 4 00000004:00080000:3.0:1788572262.602419:0:193650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572262.602421:0:193650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788572262.604674:0:192523:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788572262.604681:0:192523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13e:0x0] index 1 count 1 00000040:00080000:2.0:1788572262.604693:0:192523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 79 count 2 00000020:00000080:2.0:1788572262.606922:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd53f 00000020:00000080:2.0:1788572262.606936:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a0a15f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788572262.607900:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd554 00000020:00000080:2.0:1788572262.607908:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a109bf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788572262.607914:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788572262.607919:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572262.607929:0:193650:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788572262.607933:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8e5901bf8000) has no exports 00000004:01000000:2.0:1788572262.608102:0:193650:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788572262.608113:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd5d2 00000020:00000080:2.0:1788572262.608118:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5906755000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788572262.608121:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788572262.608125:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572262.608131:0:193650:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788572262.608134:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8e5a109f8000) has no exports 00000020:00000080:2.0:1788572262.608139:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd5c4 00000020:00000080:2.0:1788572262.608142:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5906756800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788572262.608741:0:193650:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788572262.608747:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788572262.608751:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975675 gen 5 00000004:00080000:2.0:1788572262.608757:0:193650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572262.608760:0:193650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572262.608813:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572262.608823:0:193650:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572262.608830:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd5b6 00000020:00000080:2.0:1788572262.608835:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a3f899000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788572262.608839:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='F') 00000020:00000080:2.0:1788572262.608843:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572262.608848:0:193650:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788572262.608850:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8e5a4014b380) has no exports 00000020:00000080:2.0:1788572262.608854:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd5a8 00000020:00000080:2.0:1788572262.608857:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5906752800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788572262.610145:0:193650:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788572262.610151:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788572262.610155:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738473 gen 5 00000004:00080000:2.0:1788572262.610160:0:193650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572262.610163:0:193650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572262.610326:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0a15f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788572262.610342:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109bf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788572262.610348:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906755000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788572262.610352:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906756800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788572262.610357:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5906853800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788572262.610365:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5a3f89a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572262.610367:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f89a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788572262.610371:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572262.610458:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f899000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788572262.610463:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906752800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788572262.610670:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572262.610680:0:193650:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788572262.610693:0:193650:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788572262.610698:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd59a 00000020:00000080:2.0:1788572262.610704:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5906750000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788572262.610708:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788572262.610712:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572262.610717:0:193650:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788572262.610720:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8e5a109f99c0) has no exports 00000020:00000080:2.0:1788572262.610725:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd593 00000020:00000080:2.0:1788572262.610728:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a109b9000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788572262.613327:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a109b8000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788572262.613348:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5906751000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572262.613352:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906751000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788572262.613359:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572262.613452:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906750000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788572262.613458:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788572262.614072:0:193650:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788572262.614079:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788572262.614083:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788572262.614089:0:193650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572262.614145:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572262.614158:0:193650:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572262.614191:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572262.614195:0:193650:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572262.614198:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e590cc70800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572262.614201:0:193650:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc70800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788572262.614206:0:193650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572262.614275:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd55b 00000020:00000080:3.0:1788572262.614283:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a109bd000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788572262.614287:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788572262.614290:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572262.614295:0:193650:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572262.614298:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8e5901bfb380) has no exports 00000020:00000080:3.0:1788572262.614319:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572262.614322:0:193650:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788572262.614324:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd562 00000020:00000080:3.0:1788572262.614327:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a109b9800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788572262.614333:0:193650:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a3f8c3000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788572262.614335:0:193650:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a3f8c3000 3 00000020:01000004:3.0:1788572262.614339:0:193650:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5a3f8c3000 from lustre-MDT0000 00000020:00000080:3.0:1788572262.614354:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572262.614357:0:193650:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788572262.614359:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a0a158000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788572262.614361:0:193650:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0a158000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788572262.614367:0:193650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788572262.614395:0:193650:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788572262.614398:0:193650:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788572262.614401:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788572262.614403:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572262.614406:0:193650:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788572262.614412:0:193650:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e5a4106a000 e87131b0-4a60-4def-a26d-6e23dcfe5daa 0@lo 15 (0 0 10) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572262.614417:0:193650:0:(genops.c:1553:class_disconnect_exports()) OBD device 4 (ffff8e5901bf99c0) has exports, disconnecting them 00000020:00080000:3.0:1788572262.614421:0:193650:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e5a4106a000), last request at 1788572209 00000020:00000080:3.0:1788572262.614435:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd500 00000020:00010000:3.0:1788572262.614439:0:193650:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a4106a000: total 2 00000100:00080000:3.0:1788572262.614443:0:193650:0:(import.c:65:import_set_state_nolock()) ffff8e5a4106a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788572262.614457:0:193650:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a4106a000): rc 0 00000020:00080000:3.0:1788572262.614461:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8e5901bf99c0) has no exports 00000020:00000080:1.0:1788572262.615927:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a109bf000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788572262.615945:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5a0a15d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572262.615947:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0a15d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788572262.615955:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572262.616054:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109bd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788572262.616060:0:186041:0:(genops.c:885:class_export_put()) final put ffff8e5a3f8c0000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788572262.616061:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f8c0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788572262.616065:0:186041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788572262.616091:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788572262.616555:0:192509:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e5a1fdaea00:192509] 2 exiting: rc = 0 00000100:00100000:3.0:1788572262.616653:0:192508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e5a1fdaf000:192508] 1 exiting: rc = 0 00000100:00100000:3.0:1788572262.623460:0:192514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8e5a40b15e00:192514] 3 exiting: rc = 0 00000020:00010000:3.0:1788572262.624793:0:10396:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a4106a000: total 0 00010000:00010000:3.0:1788572262.624856:0:10396:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a4106a000, canceled 0 locks, left on hash table 10. 00010000:00010000:3.0:1788572262.624893:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11254800/0x265cfe11109bd67a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd673 expref: 11 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.624915:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01670600/0x265cfe11109bd6dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd6d5 expref: 10 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.624927:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01670400/0x265cfe11109bd66c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd665 expref: 9 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.624943:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11255000/0x265cfe11109bd6ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd6e3 expref: 8 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.624954:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11255400/0x265cfe11109bd6f8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd6f1 expref: 7 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.624965:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01671800/0x265cfe11109bd688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd681 expref: 6 pid: 192507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.624977:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a370b3400/0x265cfe11109bd706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd6ff expref: 5 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.624998:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590a60ce00/0x265cfe11109bd696 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd68f expref: 4 pid: 192508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.625015:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01671200/0x265cfe11109bd6ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd6c7 expref: 3 pid: 192514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.625025:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a370b3800/0x265cfe11109bd65e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd657 expref: 2 pid: 192509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.625034:0:10396:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a4106a000, canceled 10 locks, left on hash table 0. 00000020:00000080:3.0:1788572262.625049:0:10396:0:(genops.c:885:class_export_put()) final put ffff8e5a4106a000/e87131b0-4a60-4def-a26d-6e23dcfe5daa 00010000:00010000:3.0:1788572262.625072:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572262.625074:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572262.625076:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788572262.625111:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a4106a000/e87131b0-4a60-4def-a26d-6e23dcfe5daa for MGS 00000020:00000080:1.0:1788572262.625154:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a4106a800 for MGS 00000100:00100000:2.0:1788572262.664616:0:192507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e5a1fdae200:192507] 0 exiting: rc = 1 00000100:00100000:1.0:1788572262.664785:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664795:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664802:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664808:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664813:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664819:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664826:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664832:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664837:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664843:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664850:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664856:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664862:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664868:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664873:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664879:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664885:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664890:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664896:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664902:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664908:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664913:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664918:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664923:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664929:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664934:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664940:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664946:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664952:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664957:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664962:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664967:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664972:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664977:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664992:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.664998:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665004:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665008:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665013:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665019:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665024:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665029:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665033:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665038:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665044:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665049:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665053:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665059:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665064:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665069:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665074:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665079:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665084:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665090:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665094:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665099:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665105:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665111:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665116:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665120:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665126:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665131:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665135:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572262.665140:0:193650:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788572262.666374:0:193650:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a36976c00 - data ffff8e5a35a0f948/ffff8e5a415c7c00 00000020:01000000:1.0:1788572262.666522:0:193650:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a244d62a0 - data ffff8e5a0f6b8288/ffff8e5a40dabc00 00000020:00000080:1.0:1788572262.671389:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd4f2 00000020:00000080:1.0:1788572262.671403:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e590cc71800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788572262.671429:0:193650:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a3f8c3000 from MGS, refs=2 00000020:01000004:1.0:1788572262.671432:0:193650:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a3f8c3000 2 00000020:01000004:1.0:1788572262.671435:0:193650:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5a3f8c3000 from MGS 00000020:00000080:1.0:1788572262.671456:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572262.671464:0:193650:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788572262.671466:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e590cc70000/MGS 00000020:00000080:1.0:1788572262.671469:0:193650:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc70000/MGS for MGS 00000020:01000000:1.0:1788572262.671476:0:193650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788572262.671573:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788572262.671577:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572262.671585:0:193650:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788572262.671593:0:193650:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e59051d8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572262.671599:0:193650:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8e5a401499c0) has exports, disconnecting them 00000020:00080000:1.0:1788572262.671603:0:193650:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e59051d8800), last request at 1788572209 00000020:00000080:1.0:1788572262.671607:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd611 00000020:00080000:1.0:1788572262.671616:0:193650:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e59051d8800): rc 0 00000020:00000080:1.0:1788572262.671621:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e59051d8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788572262.671837:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc71800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788572262.671845:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59051d8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788572262.744922:0:193650:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788572262.744932:0:193650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572262.744938:0:193650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788572262.744946:0:193650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572262.745194:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572262.745208:0:193650:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788572262.745230:0:193650:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a3f8c3000 1 00000020:00000080:2.0:1788572262.745238:0:193650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd4e4 00000020:00000080:2.0:1788572262.745248:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e590cc77000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788572262.745254:0:193650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788572262.745262:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572262.745266:0:193650:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788572262.745270:0:193650:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8e5a413f8000) has no exports 00000020:00000080:3.0:1788572262.747662:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a37118000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788572262.747677:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e590cc76800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788572262.747681:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc76800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788572262.747691:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788572262.747780:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc77000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788572262.787151:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584309120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572262.787255:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572262.796837:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584309120 00000100:00100000:1.0:1788572262.796854:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584309120 00000100:00100000:1.0:1788572262.796914:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788572262.796924:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875444584309120:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788572262.796933:0:188053:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572262.797036:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875444584309120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (9781us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572262.797044:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:02020000:3.0:1788572262.797823:0:3642:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788572262.797829:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788572262.797834:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788572262.797838:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788572262.797844:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572262.797848:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8968 00000100:00080000:3.0:1788572262.797855:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572262.797884:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3f8f1500 x1875444584309248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572262.799372:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584309248:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788572262.799444:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572262.800584:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584309248 00000100:00100000:3.0:1788572262.800597:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584309248 00000100:00100000:3.0:1788572262.800652:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788572262.800660:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584309248:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788572262.801286:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572262.801368:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584309248:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 707us (1922us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572262.801376:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00080000:2.0:1788572262.801457:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572262.801463:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572262.801466:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584309248:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1788572262.849700:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572262.980292:0:193650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572262.980305:0:193650:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788572262.980312:0:193650:0:(genops.c:885:class_export_put()) final put ffff8e5a3f8c7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788572262.980317:0:193650:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f8c7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788572262.980329:0:193650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788572262.980468:0:193650:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e5a3f8c0800 00000020:02000400:2.0:1788572262.980555:0:193650:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1788572263.305744:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572263.305770:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584309376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572263.305844:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572263.305928:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584309376 00000100:00100000:1.0:1788572263.305936:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584309376 00000100:00100000:1.0:1788572263.306012:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6285 00000100:00100000:1.0:1788572263.306021:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584309376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572263.306048:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572263.306097:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584309376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572263.306104:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6285 00000100:00100000:1.0:1788572263.306155:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584309376:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572263.306211:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572263.871965:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572264.322346:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572264.322352:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572264.322356:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572264.322365:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9015 00000100:00080000:0.0:1788572264.322371:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572264.322379:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572264.322402:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ff85f80 x1875444584309888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572264.322420:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572264.322435:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788572264.322438:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572264.322443:0:186041:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9012 00000100:00080000:0.0:1788572264.322446:0:186041:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788572264.322450:0:186041:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572264.322463:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ff84000 x1875444584310016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572264.322701:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584310144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572264.322769:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572264.322811:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572264.322817:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584309504:0@lo:400:kworker.0 00000400:00000100:3.0:1788572264.322834:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584309504 offset 0 length 224: 4 00000100:00100000:3.0:1788572264.322857:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584310272:0@lo:400:kworker.0 00000100:00100000:3.0:1788572264.322882:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572264.322915:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584310272 00000100:00100000:3.0:1788572264.322918:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584310144 00000100:00100000:2.0:1788572264.322923:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584310272 00000100:00100000:3.0:1788572264.322923:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584310144 00000100:00100000:2.0:1788572264.322957:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1788572264.322957:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7684 00000100:00100000:2.0:1788572264.322964:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875444584310272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572264.322964:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584310144:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788572264.322982:0:188050:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788572264.323029:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584309632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572264.323068:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584310144:12345-0@lo:400:kworker.0 Request processed in 104us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572264.323075:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7684 00000100:00100000:1.0:1788572264.323216:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584309888:0@lo:38:kworker.0 00000100:00080000:3.0:1788572264.332273:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788572264.332281:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788572264.332285:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788572264.332292:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572264.332295:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8968 00000100:00080000:3.0:1788572264.332305:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572264.332343:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3f8f0a80 x1875444584310400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572264.332363:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584310272:0@lo:400:kworker.0 00000100:00100000:3.0:1788572264.332382:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584310144:0@lo:400:kworker.0 00000100:00100000:0.0:1788572264.342611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572264.342678:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572264.342691:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584309760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572264.342729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572264.342777:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584309632 00000100:00100000:0.0:1788572264.342785:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584309632 00000100:00100000:0.0:1788572264.342811:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584309760 00000100:00100000:0.0:1788572264.342813:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584309760 00000100:00100000:0.0:1788572264.342844:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788572264.342852:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584309760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572264.342904:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584309760:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572264.342911:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788572264.342932:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1788572264.342937:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875444584309632:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788572264.342942:0:188048:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788572264.342980:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875444584309632:12345-0@lo:400:kworker.0 Request processed in 42us (376us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788572264.342987:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00080000:0.0:1788572264.343008:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572264.343041:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584309760:0@lo:400:kworker.0 00000100:00080000:0.0:1788572264.343054:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788572264.343059:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788572264.343063:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788572264.343068:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572264.343073:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8968 00000100:00080000:0.0:1788572264.343079:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572264.343122:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590a84b100 x1875444584310528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572264.343137:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584309632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572264.349229:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572264.349291:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584310016:0@lo:8:kworker.0 00000100:00100000:1.0:1788572264.349334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572264.349363:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584310400:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788572264.349389:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572264.349405:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584310528:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788572264.349425:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572264.349663:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584310400 00000100:00100000:1.0:1788572264.349672:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584310400 00000100:00100000:1.0:1788572264.349698:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584310528 00000100:00100000:1.0:1788572264.349700:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584310528 00000100:00100000:1.0:1788572264.349711:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1788572264.349717:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584310400:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788572264.349737:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572264.349783:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584310400:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 65us (393us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572264.349790:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1788572264.349806:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1788572264.349809:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584310528:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788572264.349817:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572264.349838:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584310528:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 28us (413us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572264.349844:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00080000:1.0:1788572264.349878:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572264.349883:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572264.349887:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584310400:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788572264.349896:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572264.349899:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572264.349901:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584310528:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788572264.350703:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584309888 00000100:00100000:0.0:1788572264.350710:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584309888 00000100:00100000:0.0:1788572264.350737:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788572264.350744:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584309888:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572264.350757:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572264.350806:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584309888:12345-0@lo:38:kworker.0 Request processed in 62us (1583us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572264.350813:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788572264.350834:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584310016 00000100:00100000:0.0:1788572264.350837:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584310016 00000100:00100000:0.0:1788572264.350859:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22622 00000100:00100000:0.0:1788572264.350863:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3640:x1875444584310016:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572264.350872:0:43918:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572264.350899:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3640:x1875444584310016:12345-0@lo:8:kworker.0 Request processed in 34us (1564us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572264.350909:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22622 00000100:00080000:0.0:1788572264.350948:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572264.350953:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572264.350956:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584309888:0@lo:38:kworker.0 00000100:00080000:0.0:1788572264.350976:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572264.350980:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572264.350983:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584310016:0@lo:8:kworker.0 00000100:00100000:2.0:1788572264.362443:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875444584310272:12345-0@lo:400:kworker.0 Request processed in 39464us (39545us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572264.362464:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00010000:00010000:0.0:1788572264.893757:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572265.919033:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572266.940766:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788572267.905405:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572267.905417:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5a4106f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572267.905571:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a4106f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788572267.905641:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a4106e000 for lustre-OST0001 00000001:00100000:3.0:1788572267.908830:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788572267.908848:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837475 is committed 00000020:00000080:3.0:1788572267.908853:0:188042:0:(genops.c:885:class_export_put()) final put ffff8e590308c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572267.914551:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590308c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788572267.914752:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a1f1a9000 for lustre-MDT0001 00010000:00010000:2.0:1788572267.964777:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572268.413091:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572268.413114:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584310656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572268.413193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572268.413414:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584310656 00000100:00100000:3.0:1788572268.413421:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584310656 00000100:00100000:3.0:1788572268.413540:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6286 00000100:00100000:3.0:1788572268.413550:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584310656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572268.413581:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572268.413910:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584310656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 361us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572268.413917:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6286 00000100:00100000:2.0:1788572268.414038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584310656:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572268.414902:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572268.990178:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572269.438863:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572269.438870:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572269.438874:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572269.438882:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9017 00000100:00080000:1.0:1788572269.438889:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572269.438896:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572269.438933:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4e680 x1875444584310912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572269.439017:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584310912:0@lo:38:kworker.0 00000100:00100000:3.0:1788572269.439090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572269.439206:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572269.439210:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572269.439212:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572269.439216:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9017 00000100:00080000:1.0:1788572269.439219:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572269.439223:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572269.439237:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4ce00 x1875444584311168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572269.439309:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584310784:0@lo:400:kworker.0 00000400:00000100:2.0:1788572269.439337:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584310784 offset 0 length 224: 4 00000100:00100000:2.0:1788572269.439397:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584310912 00000100:00100000:2.0:1788572269.439405:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584310912 00000100:00100000:2.0:1788572269.439442:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1788572269.439450:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584310912:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572269.439469:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572269.439943:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584311040:0@lo:400:kworker.0 00000100:00100000:0.0:1788572269.439985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572269.440021:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584311040 00000100:00100000:0.0:1788572269.440026:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584311040 00000100:00100000:0.0:1788572269.440085:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788572269.440093:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584311040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572269.440152:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584311040:12345-0@lo:400:kworker.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572269.440160:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:0.0:1788572269.440183:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572269.440211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584311040:0@lo:400:kworker.0 00000100:00100000:3.0:1788572269.443507:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584311168:0@lo:38:kworker.0 00000100:00100000:3.0:1788572269.443687:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572269.443916:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584311168 00000100:00100000:0.0:1788572269.443934:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584311168 00000100:00100000:0.0:1788572269.443986:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788572269.443993:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584311168:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572269.444014:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572269.444059:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584311168:12345-0@lo:38:kworker.0 Request processed in 65us (372us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572269.444066:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:1.0:1788572269.444510:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572269.444515:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572269.444519:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572269.444524:0:186041:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9017 00000100:00080000:1.0:1788572269.444530:0:186041:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572269.444536:0:186041:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572269.444565:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4dc00 x1875444584311296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572269.444608:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572269.444612:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572269.444613:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572269.444617:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9017 00000100:00080000:1.0:1788572269.444620:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572269.444624:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572269.444637:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4c700 x1875444584311552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572269.444828:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584311424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572269.444865:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572269.444905:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584311424 00000100:00100000:0.0:1788572269.444910:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584311424 00000100:00100000:0.0:1788572269.444953:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7685 00000100:00100000:0.0:1788572269.444960:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584311424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572269.445014:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584311424:12345-0@lo:400:kworker.0 Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572269.445022:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7685 00000100:00100000:0.0:1788572269.445065:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584311424:0@lo:400:kworker.0 00000100:00100000:2.0:1788572269.452046:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584310912:12345-0@lo:38:kworker.0 Request processed in 12581us (12941us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572269.452065:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00080000:3.0:1788572269.454351:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572269.454362:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572269.454367:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584310912:0@lo:38:kworker.0 00000100:00100000:3.0:1788572269.454402:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584311296:0@lo:8:kworker.0 00000100:00100000:3.0:1788572269.454470:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572269.455160:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584311552:0@lo:38:kworker.0 00000100:00100000:3.0:1788572269.455193:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572269.455285:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572269.455290:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572269.455294:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584311168:0@lo:38:kworker.0 00000100:00100000:0.0:1788572269.457885:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584311552 00000100:00100000:0.0:1788572269.457897:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584311552 00000100:00100000:0.0:1788572269.458025:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1788572269.458036:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584311552:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572269.458062:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572269.458153:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584311552:12345-0@lo:38:kworker.0 Request processed in 117us (2958us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572269.458160:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:1.0:1788572269.458377:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584311296 00000100:00100000:1.0:1788572269.458382:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584311296 00000100:00100000:1.0:1788572269.458406:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22623 00000100:00100000:1.0:1788572269.458411:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0+-99:3640:x1875444584311296:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788572269.458421:0:177556:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572269.458454:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0+-99:3640:x1875444584311296:12345-0@lo:8:kworker.0 Request processed in 42us (3984us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572269.458460:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22623 00000100:00080000:3.0:1788572269.458949:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572269.458955:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572269.458960:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584311296:0@lo:8:kworker.0 00000100:00080000:3.0:1788572269.458982:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572269.458986:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572269.458990:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584311552:0@lo:38:kworker.0 00010000:00010000:0.0:1788572270.020792:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572271.037850:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572272.063528:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572273.085955:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572273.534673:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572273.534693:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584311680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572273.534764:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572273.534920:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584311680 00000100:00100000:1.0:1788572273.534929:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584311680 00000100:00100000:1.0:1788572273.534995:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6287 00000100:00100000:1.0:1788572273.535006:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584311680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572273.535037:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00080000:0.0:1788572273.535329:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572273.535458:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584311680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 452us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572273.535466:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6287 00000100:00100000:3.0:1788572273.539908:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584311680:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572274.108747:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572274.557403:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572274.557412:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572274.557415:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572274.557425:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9022 00000100:00080000:1.0:1788572274.557431:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572274.557439:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572274.557463:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4c700 x1875444584311936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572274.557537:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572274.557541:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572274.557543:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572274.557547:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9022 00000100:00080000:1.0:1788572274.557550:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572274.557554:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572274.557568:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4ce00 x1875444584312192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572274.557577:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572274.557580:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572274.557581:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572274.557586:0:105698:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9022 00000100:00080000:1.0:1788572274.557588:0:105698:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572274.557591:0:105698:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572274.557602:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4e680 x1875444584312320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572274.557617:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572274.557620:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572274.557621:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572274.557624:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9022 00000100:00080000:1.0:1788572274.557626:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572274.557629:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572274.557639:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a41329180 x1875444584312576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572274.557730:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572274.557749:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584311808:0@lo:400:kworker.0 00000400:00000100:0.0:1788572274.557805:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584311808 offset 0 length 224: 4 00000100:00100000:0.0:1788572274.557866:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584312064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572274.557915:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572274.557951:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572274.557957:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584312448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572274.557984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572274.558356:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584312064 00000100:00100000:1.0:1788572274.558366:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584312064 00000100:00100000:1.0:1788572274.558435:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788572274.558444:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584312064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572274.558517:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584312064:12345-0@lo:400:kworker.0 Request processed in 74us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572274.558525:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788572274.558551:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584312448 00000100:00100000:1.0:1788572274.558554:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584312448 00000100:00100000:1.0:1788572274.558575:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7686 00000100:00100000:1.0:1788572274.558582:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584312448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572274.558608:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584312448:12345-0@lo:400:kworker.0 Request processed in 27us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572274.558613:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7686 00000100:00080000:0.0:1788572274.558673:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572274.558705:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584312448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572274.558717:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584312064:0@lo:400:kworker.0 00000100:00100000:2.0:1788572274.559462:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584311936:0@lo:38:kworker.0 00000100:00100000:2.0:1788572274.559548:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572274.559584:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584312192:0@lo:38:kworker.0 00000100:00100000:2.0:1788572274.559610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572274.559637:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584312320:0@lo:8:kworker.0 00000100:00100000:2.0:1788572274.559762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572274.559788:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584312576:0@lo:38:kworker.0 00000100:00100000:2.0:1788572274.559810:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572274.559857:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584312320 00000100:00100000:2.0:1788572274.559862:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584312320 00000100:00100000:2.0:1788572274.559910:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22624 00000100:00100000:2.0:1788572274.559916:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875444584312320:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788572274.559924:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584312192 00000100:00100000:3.0:1788572274.559928:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584312192 00010000:00020000:2.0:1788572274.559934:0:8433:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572274.559951:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788572274.559956:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584312192:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572274.559966:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572274.559969:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875444584312320:12345-0@lo:8:kworker.0 Request processed in 53us (208us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572274.559976:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22624 00000100:00100000:3.0:1788572274.559991:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584312192:12345-0@lo:38:kworker.0 Request processed in 34us (379us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572274.559996:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584311936 00000100:00100000:3.0:1788572274.559997:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788572274.559999:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584311936 00000100:00100000:2.0:1788572274.560015:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584312576 00000100:00100000:2.0:1788572274.560017:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584312576 00000100:00100000:2.0:1788572274.560035:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:2.0:1788572274.560040:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584311936:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788572274.560040:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1788572274.560044:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584312576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572274.560049:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1788572274.560051:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572274.560074:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584311936:12345-0@lo:38:kworker.0 Request processed in 33us (526us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572274.560074:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584312576:12345-0@lo:38:kworker.0 Request processed in 28us (263us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572274.560080:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00080000:0.0:1788572274.560162:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572274.560167:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572274.560171:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584311936:0@lo:38:kworker.0 00000100:00080000:0.0:1788572274.560180:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572274.560183:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572274.560185:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584312192:0@lo:38:kworker.0 00000100:00080000:0.0:1788572274.560192:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572274.560195:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572274.560198:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584312320:0@lo:8:kworker.0 00000100:00080000:0.0:1788572274.560205:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572274.560208:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572274.560210:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584312576:0@lo:38:kworker.0 00000100:00100000:3.0:1788572274.570707:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00010000:00010000:0.0:1788572275.133088:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572276.156964:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572277.182849:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572278.204658:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572278.653752:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572278.653770:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584312704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572278.653854:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572278.653980:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584312704 00000100:00100000:0.0:1788572278.653990:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584312704 00000100:00100000:0.0:1788572278.654059:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6288 00000100:00100000:0.0:1788572278.654069:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584312704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572278.654099:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572278.654154:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584312704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572278.654162:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6288 00000100:00100000:3.0:1788572278.654284:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584312704:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572278.654442:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572279.237685:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572279.677451:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572279.677458:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572279.677462:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572279.677469:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9027 00000100:00080000:1.0:1788572279.677475:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572279.677504:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572279.677529:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a41329500 x1875444584312960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572279.677562:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572279.677566:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572279.677568:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572279.677572:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9027 00000100:00080000:1.0:1788572279.677575:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572279.677579:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572279.677589:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a41328000 x1875444584313216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572279.677597:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572279.677600:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572279.677602:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572279.677606:0:105698:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9027 00000100:00080000:1.0:1788572279.677608:0:105698:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572279.677611:0:105698:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572279.677620:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a41329c00 x1875444584313344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572279.677634:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572279.677638:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572279.677639:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572279.677642:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9027 00000100:00080000:1.0:1788572279.677645:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572279.677648:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572279.677656:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4132aa00 x1875444584313600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572279.677682:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572279.677693:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584312832:0@lo:400:kworker.0 00000400:00000100:1.0:1788572279.677742:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584312832 offset 0 length 224: 4 00000100:00100000:1.0:1788572279.677796:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584312960:0@lo:38:kworker.0 00000100:00100000:1.0:1788572279.677827:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572279.677879:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584313216:0@lo:38:kworker.0 00000100:00100000:1.0:1788572279.677903:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572279.677922:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584313344:0@lo:8:kworker.0 00000100:00100000:1.0:1788572279.677944:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572279.677961:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584313600:0@lo:38:kworker.0 00000100:00100000:1.0:1788572279.677982:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572279.678015:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584313088:0@lo:400:kworker.0 00000100:00100000:2.0:1788572279.678542:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584313216 00000100:00100000:2.0:1788572279.678551:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584313216 00000100:00100000:2.0:1788572279.678587:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788572279.678595:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584313216:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572279.678614:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572279.678664:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584313216:12345-0@lo:38:kworker.0 Request processed in 67us (758us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572279.678671:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788572279.678693:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584312960 00000100:00100000:2.0:1788572279.678697:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584312960 00000100:00100000:2.0:1788572279.678715:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1788572279.678720:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584312960:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572279.678733:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572279.678759:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584312960:12345-0@lo:38:kworker.0 Request processed in 39us (932us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572279.678765:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1788572279.678774:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584313600 00000100:00100000:2.0:1788572279.678777:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584313600 00000100:00100000:2.0:1788572279.678792:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1788572279.678796:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584313600:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572279.678805:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572279.678829:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584313600:12345-0@lo:38:kworker.0 Request processed in 31us (846us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572279.678845:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1788572279.678865:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584313472:0@lo:400:kworker.0 00000100:00100000:2.0:1788572279.678894:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572279.680502:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572279.680574:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584313344 00000100:00100000:1.0:1788572279.680582:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584313344 00000100:00100000:1.0:1788572279.680615:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584313472 00000100:00100000:1.0:1788572279.680618:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584313472 00000100:00100000:1.0:1788572279.680654:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7687 00000100:00100000:1.0:1788572279.680663:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584313472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572279.680731:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584313472:12345-0@lo:400:kworker.0 Request processed in 69us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572279.680738:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7687 00000100:00100000:1.0:1788572279.680754:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22625 00000100:00100000:1.0:1788572279.680759:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3640:x1875444584313344:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788572279.680774:0:43920:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572279.680802:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3640:x1875444584313344:12345-0@lo:8:kworker.0 Request processed in 42us (2858us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572279.680808:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22625 00000100:00100000:1.0:1788572279.680826:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584313088 00000100:00100000:1.0:1788572279.680830:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584313088 00000100:00100000:1.0:1788572279.680878:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788572279.680885:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584313088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572279.680923:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584313088:12345-0@lo:400:kworker.0 Request processed in 39us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572279.680930:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:1.0:1788572279.680951:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572279.680983:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584313472:0@lo:400:kworker.0 00000100:00080000:1.0:1788572279.681021:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572279.681026:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572279.681029:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584312960:0@lo:38:kworker.0 00000100:00080000:1.0:1788572279.681059:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572279.681063:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572279.681066:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584313216:0@lo:38:kworker.0 00000100:00080000:1.0:1788572279.681077:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572279.681080:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572279.681083:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584313344:0@lo:8:kworker.0 00000100:00080000:1.0:1788572279.681093:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572279.681096:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572279.681098:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584313600:0@lo:38:kworker.0 00000100:00100000:1.0:1788572279.681127:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584313088:0@lo:400:kworker.0 00010000:00010000:0.0:1788572280.258501:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788572280.734364:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572264/real 1788572264] req@ffff8e5a1ff84380 x1875444584309504/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572280 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572280.734404:0:3643:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8e5a1ff84380 x1875444584309504/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572280 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572280.734413:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788572280.734417:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788572280.734421:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.157@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788572280.734423:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788572280.734426:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a1ff84380 x1875444584309504/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572280 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572280.734436:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a31c4f100 x1875444584310784/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572285 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572280.734460:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a31c4fb80 x1875444584311808/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572290 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572280.734501:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a4132b100 x1875444584312832/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572295 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788572280.734510:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788572280.734513:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788572280.734514:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788572280.734517:0:3643:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1788572280.734548:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584312832:0@lo:400:kworker.0 00000100:00100000:3.0:1788572280.734560:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584311808:0@lo:400:kworker.0 00000100:00100000:3.0:1788572280.734615:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584309504:0@lo:400:kworker.0 00000100:00100000:0.0:1788572280.734866:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584310784:0@lo:400:kworker.0 00000100:00080000:0.0:1788572280.734893:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572280.734897:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788572280.734900:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572280.734905:0:186041:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 8962 00000100:00080000:0.0:1788572280.734914:0:186041:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572280.734940:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ff85c00 x1875444584313728/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572280.734960:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572280.734964:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572280.734966:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572280.734969:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9032 00000100:00080000:0.0:1788572280.734971:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572280.734975:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572280.734991:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ff84a80 x1875444584313856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572280.735025:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572280.735029:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572280.735031:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572280.735035:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9032 00000100:00080000:0.0:1788572280.735037:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572280.735052:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572280.735066:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4f100 x1875444584314112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572280.735075:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572280.735078:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788572280.735079:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572280.735083:0:186041:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9032 00000100:00080000:0.0:1788572280.735086:0:186041:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572280.735090:0:186041:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572280.735101:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4fb80 x1875444584314240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572280.735117:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572280.735120:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572280.735122:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572280.735126:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9032 00000100:00080000:0.0:1788572280.735128:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572280.735131:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572280.735143:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c4ce00 x1875444584314496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572280.735167:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584313728:0@lo:250:kworker.0 00000400:00000100:0.0:1788572280.735211:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584313728 offset 0 length 520: 4 00000100:00100000:0.0:1788572280.735259:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584313856:0@lo:38:kworker.0 00000100:00100000:0.0:1788572280.735291:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572280.735320:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584314112:0@lo:38:kworker.0 00000100:00100000:0.0:1788572280.735343:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572280.735359:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584314240:0@lo:8:kworker.0 00000100:00100000:0.0:1788572280.735594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572280.735616:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584314496:0@lo:38:kworker.0 00000100:00100000:0.0:1788572280.735638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572280.735669:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584313856 00000100:00100000:0.0:1788572280.735676:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584313856 00000100:00100000:0.0:1788572280.735706:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584314496 00000100:00100000:0.0:1788572280.735709:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584314496 00000100:00100000:0.0:1788572280.735727:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1788572280.735733:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584313856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572280.735753:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572280.735793:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584313856:12345-0@lo:38:kworker.0 Request processed in 58us (501us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572280.735800:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1788572280.735818:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1788572280.735836:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584314496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572280.735846:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572280.735870:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584314496:12345-0@lo:38:kworker.0 Request processed in 46us (231us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572280.735876:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1788572280.735896:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584314112 00000100:00100000:0.0:1788572280.735899:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584314112 00000100:00100000:0.0:1788572280.735920:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788572280.735925:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584314112:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572280.735934:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572280.735960:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584314112:12345-0@lo:38:kworker.0 Request processed in 34us (615us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572280.735965:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788572280.735981:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584314240 00000100:00100000:0.0:1788572280.735984:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584314240 00000100:00100000:0.0:1788572280.736001:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22626 00000100:00100000:0.0:1788572280.736006:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:0+-99:3640:x1875444584314240:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572280.736014:0:179391:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572280.736039:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:0+-99:3640:x1875444584314240:12345-0@lo:8:kworker.0 Request processed in 32us (658us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572280.736099:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22626 00000100:00080000:0.0:1788572280.736139:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572280.736144:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572280.736147:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584313856:0@lo:38:kworker.0 00000100:00080000:0.0:1788572280.736155:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572280.736158:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572280.736161:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584314112:0@lo:38:kworker.0 00000100:00080000:0.0:1788572280.736169:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572280.736172:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572280.736174:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584314240:0@lo:8:kworker.0 00000100:00080000:0.0:1788572280.736180:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572280.736183:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572280.736185:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584314496:0@lo:38:kworker.0 00000100:00100000:0.0:1788572280.736218:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584314368:0@lo:400:kworker.0 00000100:00100000:0.0:1788572280.736456:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572280.736504:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572280.736512:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584313984:0@lo:400:kworker.0 00000100:00100000:0.0:1788572280.736538:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572280.736566:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584314368 00000100:00100000:0.0:1788572280.736571:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584314368 00000100:00100000:0.0:1788572280.736614:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7688 00000100:00100000:0.0:1788572280.736621:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584314368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572280.736662:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584314368:12345-0@lo:400:kworker.0 Request processed in 42us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572280.736670:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7688 00000100:00100000:0.0:1788572280.736686:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584313984 00000100:00100000:0.0:1788572280.736689:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584313984 00000100:00100000:0.0:1788572280.736712:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788572280.736718:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584313984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572280.736747:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584313984:12345-0@lo:400:kworker.0 Request processed in 30us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572280.736754:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:0.0:1788572280.736769:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572280.736795:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584313984:0@lo:400:kworker.0 00000100:00100000:0.0:1788572280.736806:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584314368:0@lo:400:kworker.0 00010000:00010000:3.0:1788572281.276749:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572282.303190:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572283.337659:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572283.779731:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572283.779756:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584314624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572283.779839:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572283.779887:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584314624 00000100:00100000:1.0:1788572283.779895:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584314624 00000100:00100000:1.0:1788572283.779955:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6289 00000100:00100000:1.0:1788572283.779965:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584314624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572283.779994:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572283.780038:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584314624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572283.780045:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6289 00000100:00080000:1.0:1788572283.780065:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572283.780101:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584314624:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572284.352129:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788572285.325305:0:194071:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788572285.325311:0:194071:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788572285.325313:0:194071:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788572285.325733:0:194071:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e5a10fc4800 00000020:01000004:2.0:1788572285.325752:0:194071:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788572285.325767:0:194071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788572285.325792:0:194071:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e5a40148000) 00000020:00000080:2.0:1788572285.325813:0:194071:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788572285.373754:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788572285.427696:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788572285.436306:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788572285.450811:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.454798:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.455186:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.455409:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.455848:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.456176:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.456463:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.456746:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.457422:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.459334:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.460145:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.460446:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.460757:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.461360:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.461657:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.461954:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.462276:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.463112:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.463445:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.463803:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788572285.464210:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788572285.464439:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788572285.465258:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788572285.465653:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788572285.468403:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788572285.469399:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788572285.469731:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788572285.470060:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788572285.470406:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788572285.470664:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788572285.470936:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788572285.473424:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788572285.474428:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.474723:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788572285.475306:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788572285.475627:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.475891:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788572285.476265:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788572285.476590:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.476798:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.477188:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788572285.477423:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788572285.477808:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.478158:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.479389:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.484950:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.489569:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.491410:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.494962:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.496882:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788572285.498530:0:194071:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1788572285.499098:0:194071:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788572285.499318:0:194071:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788572285.499327:0:194071:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788572285.499349:0:194071:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd983 00000020:01000004:3.0:1788572285.499356:0:194071:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788572285.499367:0:194071:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788572285.499372:0:194071:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a10fc4800 from MGS 00000020:01000004:3.0:1788572285.499376:0:194071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788572285.499385:0:194071:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e5a109f8000) 00000020:00000080:3.0:1788572285.499396:0:194071:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1788572285.499459:0:194071:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a10fc4800 from MGS, refs=2 00080000:01000000:3.0:1788572285.499464:0:194071:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788572285.499468:0:194071:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd991 00010000:00010000:3.0:1788572285.499644:0:194071:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:0.0:1788572285.526912:0:194071:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788572285.557666:0:194077:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788572285.557831:0:194071:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788572285.557906:0:194071:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788572285.563667:0:194071:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788572285.564207:0:194071:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572285.564385:0:194071:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788572285.564392:0:194071:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788572285.574757:0:194071:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788572285.574790:0:194071:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788572285.578777:0:194071:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788572285.578799:0:194071:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788572285.581570:0:194071:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788572285.581597:0:194071:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788572285.581598:0:194071:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.157@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788572285.581603:0:194071:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.157@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1788572285.581609:0:194071:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 258, was 0): CONNECTING 00000100:00100000:3.0:1788572285.581615:0:194071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00080000:1.0:1788572285.820860:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572285.820871:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788572285.820873:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572285.820877:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572285.820881:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572285.820889:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9033 00000100:00080000:1.0:1788572285.820894:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572285.820902:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572285.820954:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb08380 x1875444584314752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572285.821056:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584314880:0@lo:400:kworker.0 00000100:00100000:2.0:1788572285.821145:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572285.821244:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572285.821248:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572285.821251:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572285.821255:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9033 00000100:00080000:1.0:1788572285.821258:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572285.821262:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572285.821293:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb09180 x1875444584315008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572285.821303:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572285.821306:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572285.821308:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572285.821311:0:177620:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9033 00000100:00080000:1.0:1788572285.821315:0:177620:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572285.821319:0:177620:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572285.821330:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb08a80 x1875444584315136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572285.821354:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572285.821357:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572285.821359:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572285.821362:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9033 00000100:00080000:1.0:1788572285.821364:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572285.821367:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572285.821378:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb0a300 x1875444584315392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572285.821409:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584315264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.821445:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572285.821538:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584315264 00000100:00100000:1.0:1788572285.821545:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584315264 00000100:00100000:1.0:1788572285.821598:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7689 00000100:00100000:1.0:1788572285.821607:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584315264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.821653:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584315264:12345-0@lo:400:kworker.0 Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572285.821660:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7689 00000100:00080000:1.0:1788572285.821679:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572285.821718:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584315264:0@lo:400:kworker.0 00000100:00100000:3.0:1788572285.821818:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584314880 00000100:00100000:3.0:1788572285.821824:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584314880 00000100:00100000:3.0:1788572285.821863:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788572285.821871:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584314880:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788572285.821992:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572285.822687:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584314752:0@lo:38:kworker.0 00000100:00100000:0.0:1788572285.822740:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.822792:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584315008:0@lo:38:kworker.0 00000100:00100000:0.0:1788572285.822819:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.822845:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584315136:0@lo:8:kworker.0 00000100:00100000:0.0:1788572285.822881:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.822901:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584315392:0@lo:38:kworker.0 00000100:00100000:0.0:1788572285.822921:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.822957:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584314752 00000100:00100000:0.0:1788572285.822962:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584314752 00000100:00100000:0.0:1788572285.822981:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584315392 00000100:00100000:0.0:1788572285.822984:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584315392 00000100:00100000:0.0:1788572285.822994:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1788572285.823001:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584314752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572285.823018:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572285.823055:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584314752:12345-0@lo:38:kworker.0 Request processed in 53us (315us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572285.823061:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1788572285.823078:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1788572285.823082:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584315392:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572285.823091:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572285.823115:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584315392:12345-0@lo:38:kworker.0 Request processed in 32us (193us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572285.823124:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1788572285.823151:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584315008 00000100:00100000:0.0:1788572285.823155:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584315008 00000100:00100000:0.0:1788572285.823174:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788572285.823178:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584315008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572285.823187:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572285.823213:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584315008:12345-0@lo:38:kworker.0 Request processed in 34us (394us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572285.823219:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:0.0:1788572285.823257:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572285.823268:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572285.823271:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584314752:0@lo:38:kworker.0 00000100:00080000:0.0:1788572285.823451:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572285.823455:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572285.823458:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584315008:0@lo:38:kworker.0 00000100:00080000:0.0:1788572285.823466:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572285.823469:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572285.823472:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584315392:0@lo:38:kworker.0 00000100:00100000:3.0:1788572285.824211:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584314880:12345-0@lo:400:kworker.0 Request processed in 2337us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572285.824221:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788572285.824370:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584315136 00000100:00100000:3.0:1788572285.824375:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584315136 00000100:00100000:3.0:1788572285.824406:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22627 00000100:00100000:3.0:1788572285.824412:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3640:x1875444584315136:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788572285.824425:0:43926:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572285.824467:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3640:x1875444584315136:12345-0@lo:8:kworker.0 Request processed in 55us (1585us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572285.824474:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22627 00000100:00080000:3.0:1788572285.824529:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572285.824533:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572285.824537:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584315136:0@lo:8:kworker.0 00000100:00100000:2.0:1788572285.825109:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584314880:0@lo:400:kworker.0 00010000:00010000:3.0:1788572286.397282:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572287.422521:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572288.446300:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572288.892805:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572288.892829:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584315520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572288.892916:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572288.896859:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584315520 00000100:00100000:1.0:1788572288.896874:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584315520 00000100:00100000:1.0:1788572288.896961:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6290 00000100:00100000:1.0:1788572288.896972:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584315520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572288.897006:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572288.897111:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584315520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (4196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572288.897119:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6290 00000100:00080000:2.0:1788572288.897292:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572288.897916:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584315520:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572289.468739:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572290.493195:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572290.940652:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572280/real 1788572280] req@ffff8e5a1ff85c00 x1875444584313728/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572290 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572290.940690:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e5a1ff85c00 x1875444584313728/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572290 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572290.940717:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572290.940748:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788572290.940763:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584313728:0@lo:250:kworker.0 10000000:01000000:2.0:1788572290.941077:0:194071:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788572290.941094:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd6f8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572290.941104:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd6f8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572290.941111:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788572290.941124:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.941133:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2000/0x265cfe11109bd6f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd6f8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.941149:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd65e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572290.941155:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd65e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572290.941160:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572290.941163:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.941167:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109bd657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd65e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.941176:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd67a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572290.941182:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd67a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572290.941187:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572290.941190:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.941193:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590a60cc00/0x265cfe11109bd673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd67a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.941206:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd6ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572290.941212:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd6ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572290.941217:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572290.941220:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.941224:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3e00/0x265cfe11109bd6c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd6ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.941233:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd6dc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941236:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 10000000:00010000:2.0:1788572290.941239:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd6dc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941241:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788572290.941244:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 10000000:01000000:2.0:1788572290.941244:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572290.941247:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1788572290.941248:0:177620:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 9033 00010000:00010000:2.0:1788572290.941250:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2600/0x265cfe11109bd6d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd6dc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941254:0:177620:0:(import.c:630:import_select_connection()) MGC192.168.202.157@tcp: tried all connections, increasing latency to 5s 00010000:00010000:2.0:1788572290.941257:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd706 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941260:0:177620:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 10000000:00010000:2.0:1788572290.941263:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd706 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572290.941267:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572290.941271:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.941273:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590a60da00/0x265cfe11109bd6ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd706 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.941284:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd66c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572290.941286:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4132aa00 x1875444584315648/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:2.0:1788572290.941291:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd66c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572290.941296:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572290.941299:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.941301:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11255600/0x265cfe11109bd665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd66c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941306:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572290.941309:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572290.941311:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:2.0:1788572290.941312:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941315:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9038 00000100:00080000:1.0:1788572290.941317:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 10000000:00010000:2.0:1788572290.941318:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941321:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 10000000:01000000:2.0:1788572290.941324:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572290.941326:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.941329:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b3c00/0x265cfe11109bd681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572290.941333:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a41329c00 x1875444584315776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1788572290.941339:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572290.941345:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572290.941354:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572290.941357:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.941360:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a01671c00/0x265cfe11109bd68f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941364:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572290.941367:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572290.941369:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:2.0:1788572290.941370:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bd6ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941372:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9038 00000100:00080000:1.0:1788572290.941375:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 10000000:00010000:2.0:1788572290.941376:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bd6ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572290.941378:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 10000000:01000000:2.0:1788572290.941382:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788572290.941389:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a41329500 x1875444584316032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572290.941390:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1788572290.941396:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572290.941399:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572290.941400:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572290.941403:0:177620:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9038 00000100:00100000:2.0:1788572290.941404:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584315904:0@lo:400:kworker.0 00000100:00080000:1.0:1788572290.941406:0:177620:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572290.941409:0:177620:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572290.941417:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4132ad80 x1875444584316160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572290.941443:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572290.941446:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572290.941448:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572290.941451:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9038 00000100:00080000:1.0:1788572290.941453:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572290.941456:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572290.941467:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb08700 x1875444584316416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572290.941475:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.941501:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572290.941510:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584316288:0@lo:400:kworker.0 00000100:00100000:1.0:1788572290.941541:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572290.941561:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.941566:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a370b2a00/0x265cfe11109bd6e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bd6ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572290.941572:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584316288 00000100:00100000:1.0:1788572290.941577:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584316288 00000100:00080000:2.0:1788572290.941582:0:194071:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 259, was 0): CONNECTING 00000100:00080000:2.0:1788572290.941585:0:194071:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1788572290.941621:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584315648:0@lo:250:kworker.0 00000100:00100000:1.0:1788572290.941625:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7690 00000100:00100000:1.0:1788572290.941632:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584316288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.941650:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572290.941672:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584315776:0@lo:38:kworker.0 00000100:00100000:1.0:1788572290.941675:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584316288:12345-0@lo:400:kworker.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572290.941682:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7690 00000100:00100000:2.0:1788572290.941690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572290.941700:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572290.941703:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584316032:0@lo:38:kworker.0 00000100:00100000:2.0:1788572290.941724:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.941727:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584316288:0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.941752:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584316160:0@lo:8:kworker.0 00000100:00100000:1.0:1788572290.941762:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584315648 00000100:00100000:1.0:1788572290.941765:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584315648 00000100:00100000:2.0:1788572290.941772:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.941781:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572290.941786:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875444584315648:12345-0@lo:250:kworker.0 00000100:00100000:2.0:1788572290.941786:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584316416:0@lo:38:kworker.0 00010000:00080000:1.0:1788572290.941806:0:194078:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e87131b0-4a60-4def-a26d-6e23dcfe5daa@0@lo t0 exp 0000000000000000 cur 9043 last 0 00000100:00100000:2.0:1788572290.941816:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788572290.941831:0:194078:0:(genops.c:1385:class_connect()) connect: client e87131b0-4a60-4def-a26d-6e23dcfe5daa, cookie 0x265cfe11109bd998 00000100:00100000:1.0:1788572290.941843:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584315904 00000100:00100000:1.0:1788572290.941846:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584315904 00000100:00100000:1.0:1788572290.941886:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584315776 00000100:00100000:1.0:1788572290.941890:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584315776 00000100:00100000:1.0:1788572290.941898:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584316416 00000100:00100000:1.0:1788572290.941901:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584316416 00000100:00100000:1.0:1788572290.941911:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788572290.941918:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584315904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572290.941974:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584315904:12345-0@lo:400:kworker.0 Request processed in 56us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572290.941976:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584316160 00000100:00100000:3.0:1788572290.941983:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584316160 00000100:00100000:1.0:1788572290.941984:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788572290.942001:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:1.0:1788572290.942006:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584315776:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788572290.942015:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22628 00010000:00020000:1.0:1788572290.942021:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572290.942023:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3640:x1875444584316160:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788572290.942035:0:177558:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572290.942059:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584315776:12345-0@lo:38:kworker.0 Request processed in 50us (366us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572290.942067:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1788572290.942076:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3640:x1875444584316160:12345-0@lo:8:kworker.0 Request processed in 52us (300us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572290.942083:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1788572290.942087:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22628 00000100:00100000:1.0:1788572290.942092:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584316416:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572290.942102:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572290.942131:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584316032 00000100:00100000:1.0:1788572290.942131:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584316416:12345-0@lo:38:kworker.0 Request processed in 39us (326us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572290.942135:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584316032 00000100:00100000:1.0:1788572290.942137:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1788572290.942157:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788572290.942161:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584316032:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788572290.942166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584315904:0@lo:400:kworker.0 00010000:00020000:0.0:1788572290.942171:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788572290.942190:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572290.942195:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572290.942198:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584315776:0@lo:38:kworker.0 00000100:00100000:0.0:1788572290.942199:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584316032:12345-0@lo:38:kworker.0 Request processed in 37us (474us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572290.942204:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:1.0:1788572290.942207:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572290.942210:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572290.942213:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584316032:0@lo:38:kworker.0 00000100:00080000:1.0:1788572290.942221:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572290.942223:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572290.942226:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584316160:0@lo:8:kworker.0 00000100:00080000:1.0:1788572290.942234:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572290.942236:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572290.942239:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584316416:0@lo:38:kworker.0 00000100:00080000:0.0:1788572290.942353:0:194078:0:(import.c:65:import_set_state_nolock()) ffff8e590b16d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572290.942407:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+5:3640:x1875444584315648:12345-0@lo:250:kworker.0 Request processed in 619us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572290.942417:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788572290.943812:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572290.944856:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.157@tcp: connect to target with instance 0 10000000:01000000:1.0:1788572290.944870:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1788572290.944876:0:3640:0:(import.c:1328:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x265cfe11109bd998 00000100:00080000:1.0:1788572290.949724:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1788572290.954212:0:3640:0:(import.c:1718:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00080000:0.0:1788572290.955056:0:194081:0:(import.c:1642:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.202.157@tcp to MGS@0@lo 00000100:00100000:0.0:1788572290.955062:0:194081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788572290.955085:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584315648:0@lo:250:kworker.0 10000000:01000000:0.0:1788572290.955124:0:194081:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:2.0:1788572290.961226:0:194071:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:2.0:1788572290.961247:0:194071:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788572290.961306:0:194071:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788572290.961312:0:194071:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788572290.961435:0:194071:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.157@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788572290.961606:0:194071:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.157@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788572290.961611:0:194071:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788572290.961613:0:194071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572290.961614:0:194071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572290.961616:0:194071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572290.961617:0:194071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572290.961618:0:194071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572290.961620:0:194071:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572290.961622:0:194071:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572290.961624:0:194071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572290.961626:0:194071:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572290.961629:0:194071:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788572290.961631:0:194071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788572290.961632:0:194071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572290.961633:0:194071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572290.961634:0:194071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572290.961635:0:194071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572290.961637:0:194071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572290.961638:0:194071:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572290.961639:0:194071:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572290.961640:0:194071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572290.961641:0:194071:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572290.961671:0:194071:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788572290.961690:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7840 going to sleep for 0 seconds 00000100:00100000:2.0:1788572290.961699:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584316544:0@lo:253:mount.lustre.0 00000020:00080000:2.0:1788572290.961718:0:194071:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:2.0:1788572290.961730:0:194071:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a10fc4800 from lustre-MDT0000 10000000:01000000:2.0:1788572290.961763:0:194071:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788572290.961766:0:194071:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788572290.961775:0:194071:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5a10fc4800 10000000:01000000:2.0:1788572290.961779:0:194071:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788572290.961783:0:194071:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e5a10fc4800 10000000:01000000:2.0:1788572290.961786:0:194071:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788572290.961790:0:194071:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a10fc4800 from 1 10000000:01000000:2.0:1788572290.961793:0:194071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788572290.961893:0:194071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.961904:0:194071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.961916:0:194071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572290.961927:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7c00 going to sleep for 0 seconds 00000100:00100000:2.0:1788572290.961931:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584316672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572290.961941:0:194071:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.961948:0:194071:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.961955:0:194071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.961967:0:194071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.961975:0:194071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.961981:0:194071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255400 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572290.961985:0:194071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.961993:0:194071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572290.962000:0:194071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572290.962005:0:194071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572290.962009:0:194071:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572290.962015:0:194071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.962022:0:194071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bd99f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572290.962041:0:194071:0:(mgc_request.c:1817:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:2.0:1788572290.962044:0:194071:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:3.0:1788572290.962219:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572290.962224:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1788572290.962962:0:194081:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1788572290.962970:0:194081:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1788572290.962973:0:194081:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788572290.963001:0:194081:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1788572290.963006:0:194081:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) MGC192.168.202.157@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:2.0:1788572290.963248:0:177620:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.202.157@tcp 10000000:01000000:2.0:1788572290.963265:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788572290.963268:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788572290.963270:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788572290.963271:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572290.963273:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572290.963274:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572290.963275:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572290.963277:0:177620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572290.963278:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572290.963279:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788572290.963397:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788572290.963403:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788572290.963405:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788572290.963406:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788572290.963407:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572290.963408:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572290.963409:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572290.963410:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572290.963411:0:177620:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572290.963413:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572290.963414:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788572290.963426:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788572290.963473:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584316928:0@lo:253:kworker.0 10000000:01000000:2.0:1788572290.963542:0:194071:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a10fc4800 from 1 10000000:01000000:2.0:1788572290.963546:0:194071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00000100:00100000:3.0:1788572290.963564:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572290.963568:0:194071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.963577:0:194071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.963586:0:194071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572290.963598:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584317056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572290.963602:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572290.963607:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584316800:0@lo:253:kworker.0 00000100:00100000:2.0:1788572290.963625:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572290.963629:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572290.970416:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572290.971572:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584316928 00000100:00100000:0.0:1788572290.971582:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584316928 00000100:00100000:0.0:1788572290.971628:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584317056 00000100:00100000:0.0:1788572290.971631:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584317056 00000100:00100000:0.0:1788572290.971647:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584316800 00000100:00100000:0.0:1788572290.971650:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584316800 00000100:00100000:0.0:1788572290.971669:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788572290.971679:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:3642:x1875444584316928:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788572290.971712:0:194078:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:0.0:1788572290.972679:0:194082:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788572290.975046:0:194078:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 331 00000100:00100000:2.0:1788572290.975610:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788572290.975626:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:194071:x1875444584317056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572290.975642:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572290.975666:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11255600/0x265cfe11109bd9ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd9a6 expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.975693:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11255600/0x265cfe11109bd9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd9a6 expref: 8 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.975704:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11255600/0x265cfe11109bd9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd9a6 expref: 8 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.975713:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255600, rc 0) 00000100:00100000:0.0:1788572290.975914:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584317056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572290.975933:0:194071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.975943:0:194071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572290.975961:0:194071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788572290.975977:0:194071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.975985:0:194071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572290.975993:0:194071:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788572290.975998:0:194071:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572290.976003:0:194071:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e5a10fc4800 10000000:01000000:0.0:1788572290.976006:0:194071:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788572290.976010:0:194071:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788572290.976013:0:194071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788572290.976036:0:194071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.976044:0:194071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.976052:0:194071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572290.976070:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584317184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572290.976115:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:194071:x1875444584317056:12345-0@lo:101:mount.lustre.0 Request processed in 494us (12488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.976123:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788572290.976154:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788572290.976162:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:3642:x1875444584316800:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788572290.976185:0:194079:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788572290.979072:0:194083:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788572290.979081:0:194083:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788572290.979085:0:194083:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788572290.979088:0:194083:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788572290.979354:0:194083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788572290.979571:0:194078:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788572290.979590:0:194078:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788572290.980463:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572290.980520:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572290.980576:0:194080:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788572290.980584:0:194080:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1788572290.984270:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584317184 00000100:00100000:1.0:1788572290.984283:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584317184 00000100:00100000:3.0:1788572290.984517:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572290.984529:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:194071:x1875444584317184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572290.984547:0:194084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572290.984567:0:194084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1616fa00/0x265cfe11109bd9bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bd9b4 expref: -99 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572290.984591:0:194084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1616fa00/0x265cfe11109bd9bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bd9b4 expref: 9 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572290.984602:0:194084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1616fa00/0x265cfe11109bd9bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bd9b4 expref: 9 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572290.984611:0:194084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616fa00, rc 0) 00000100:00100000:3.0:1788572290.984684:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:194071:x1875444584317184:12345-0@lo:101:mount.lustre.0 Request processed in 158us (4225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572290.984691:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572290.984878:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584317184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572290.984899:0:194071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572290.984908:0:194071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572290.984982:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584317312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572290.985015:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.985053:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904f41540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572290.985196:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584317312 00000100:00100000:2.0:1788572290.985201:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584317312 00000100:00100000:2.0:1788572290.985224:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788572290.985231:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:194071:x1875444584317312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572290.985358:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194071:x1875444584317312:12345-0@lo:501:mount.lustre.0 Request processed in 127us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.985366:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788572290.985615:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584317312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572290.985644:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584317440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572290.985684:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.985711:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904f41540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572290.985765:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584317440 00000100:00100000:2.0:1788572290.985770:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584317440 00000100:00100000:2.0:1788572290.985787:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788572290.985793:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194071:x1875444584317440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572290.986535:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194071:x1875444584317440:12345-0@lo:503:mount.lustre.0 Request processed in 738us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.986545:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572290.986664:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584317440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572290.988015:0:194085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194085:1875444584317568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572290.988096:0:194085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.988171:0:194085:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904f41000 going to sleep for 11 seconds 20000000:01000000:1.0:1788572290.989073:0:194078:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788572290.989087:0:194078:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788572290.989147:0:194079:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788572290.989197:0:194082:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788572290.989203:0:194082:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788572290.989226:0:194082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.989241:0:194082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788572290.989249:0:194082:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000047707s 00010000:00010000:0.0:1788572290.989254:0:194082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.989262:0:194082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.989269:0:194082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.989276:0:194082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.989281:0:194082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572290.989286:0:194082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.989295:0:194082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.989309:0:194082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.989316:0:194082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572290.989323:0:194082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bd9c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572290.989557:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:3642:x1875444584316928:12345-0@lo:253:kworker.0 Request processed in 17876us (25989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572290.989567:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788572290.989601:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584317568 00000100:00100000:1.0:1788572290.989608:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584317568 00000100:00100000:2.0:1788572290.992944:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788572290.992969:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:194085:x1875444584317568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572290.994308:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:194085:x1875444584317568:12345-0@lo:502:llog_process_th.0 Request processed in 1337us (6197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.994319:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:01000004:2.0:1788572290.994663:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788572290.994666:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788572290.994667:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572290.994669:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572290.994670:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572290.994672:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572290.994673:0:3642:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572290.994675:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572290.994676:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788572290.994679:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584316928:0@lo:253:kworker.0 20000000:01000000:2.0:1788572291.000466:0:194079:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572291.000511:0:194079:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788572291.003477:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3642:x1875444584316800:12345-0@lo:253:kworker.0 Request processed in 27306us (39837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.003519:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1788572291.003553:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788572291.003558:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788572291.003560:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572291.003561:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572291.003562:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572291.003564:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572291.003566:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572291.003568:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572291.003570:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788572291.003574:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584316800:0@lo:253:kworker.0 00000100:00100000:0.0:1788572291.003746:0:194085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194085:1875444584317568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788572291.003791:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 20000000:01000000:1.0:1788572291.003802:0:194082:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788572291.003809:0:194082:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:00000080:0.0:1788572291.003812:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.003816:0:194085:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788572291.003821:0:194085:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788572291.003825:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00010000:00010000:1.0:1788572291.003835:0:194082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788572291.003841:0:194085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e5a413f8000) 00010000:00010000:1.0:1788572291.003856:0:194082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788572291.003866:0:194085:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 20000000:01000000:1.0:1788572291.003867:0:194082:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000058927s 00010000:00010000:1.0:1788572291.003875:0:194082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788572291.003876:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00010000:00010000:1.0:1788572291.003886:0:194082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.003893:0:194082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.003900:0:194082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.003907:0:194082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572291.003911:0:194082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:01000000:0.0:1788572291.003971:0:194085:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788572291.003979:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd9d7 00010000:00010000:1.0:1788572291.004101:0:194082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.004119:0:194082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.004128:0:194082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.004135:0:194082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bd9c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788572291.004195:0:194085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788572291.004200:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572291.004203:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.004205:0:194085:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788572291.004207:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572291.004211:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.004212:0:194085:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788572291.004216:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788572291.004223:0:194085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e5a413fb380) 00000020:00000080:0.0:1788572291.004235:0:194085:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1788572291.004239:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788572291.004241:0:194085:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788572291.004244:0:194085:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788572291.004249:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788572291.004308:0:194085:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a10fc4800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788572291.004321:0:194085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e5a413fcd40) 00000020:00000080:0.0:1788572291.004331:0:194085:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1788572291.004379:0:194085:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788572291.004384:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bd9ec 00000020:00000080:0.0:1788572291.004652:0:194085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788572291.004659:0:194085:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788572291.004664:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x265cfe11109bd9f3 00080000:01000000:0.0:1788572291.004669:0:194085:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788572291.004672:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bd9fa 00010000:00010000:3.0:1788572291.155222:0:194085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:3.0:1788572291.158072:0:194085:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 326417519069 srv lr: 339302416387 lx: 0 gen 22 00000001:00000004:3.0:1788572291.158128:0:194085:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 80, last_transno is 339302416387 00000001:00080000:3.0:1788572291.158798:0:194085:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788572291.158928:0:194085:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5906681d80: xid 1875444581057152, transno 326417519069, client gen 22, slot idx 2 00000020:00000080:2.0:1788572291.161979:0:194085:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e5a401499c0) 00000020:00000080:2.0:1788572291.162016:0:194085:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788572291.162403:0:194085:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788572291.162411:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bda0f 00000020:00000080:3.0:1788572291.179826:0:194085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788572291.193425:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x265cfe11109bda16 00000020:00000080:0.0:1788572291.195415:0:194085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788572291.195429:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572291.195436:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.195438:0:194085:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788572291.195441:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788572291.195444:0:194085:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788572291.195455:0:194085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572291.195457:0:194085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572291.195459:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788572291.195462:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.195464:0:194085:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788572291.195467:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572291.195472:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.195473:0:194085:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788572291.195505:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788572291.195556:0:194085:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788572291.195574:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572291.195578:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.195579:0:194085:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788572291.195582:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572291.195585:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.195586:0:194085:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788572291.195589:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788572291.195595:0:194085:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:00000080:0.0:1788572291.195623:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788572291.195640:0:194085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e5a0efb99c0) 00000020:00000080:0.0:1788572291.195661:0:194085:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788572291.195666:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788572291.195727:0:194085:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788572291.195744:0:194085:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788572291.195751:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bda24 00010000:00080000:0.0:1788572291.195783:0:194085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5904e06800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:0.0:1788572291.203932:0:194085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-7 is initialized 00000020:00000080:1.0:1788572291.207896:0:194085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572291.207912:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788572291.207957:0:194085:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788572291.207979:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bda2b 00000100:00080000:1.0:1788572291.207990:0:194085:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788572291.207996:0:194085:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e5904e06800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572291.208033:0:194085:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb0a300 x1875444584317696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572291.208062:0:194085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788572291.208119:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572291.208123:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572291.208125:0:194085:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788572291.208128:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788572291.208131:0:194085:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788572291.208132:0:194085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572291.208134:0:194085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572291.208135:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788572291.208137:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572291.208139:0:194085:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788572291.208141:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788572291.208146:0:194085:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788572291.208149:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572291.208150:0:194085:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788572291.208153:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788572291.208157:0:194085:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:1.0:1788572291.208180:0:194085:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788572291.208182:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788572291.208194:0:194085:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e5a372019c0) 00000020:00000080:1.0:1788572291.208209:0:194085:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788572291.208214:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788572291.208272:0:194085:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788572291.208278:0:194085:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788572291.208282:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bda39 00010000:00080000:1.0:1788572291.208322:0:194085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e59059d6800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:1.0:1788572291.208547:0:194085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00080000:3.0:1788572291.208936:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572291.208940:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572291.208943:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572291.208948:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9043 00000100:00080000:3.0:1788572291.208953:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572291.208957:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572291.208971:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24c57100 x1875444584317952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572291.208986:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572291.208989:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572291.208991:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572291.208995:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9043 00000100:00080000:3.0:1788572291.208997:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572291.209001:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572291.209010:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24c54000 x1875444584318208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572291.209018:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572291.209021:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788572291.209022:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572291.209025:0:177620:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9043 00000100:00080000:3.0:1788572291.209027:0:177620:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572291.209030:0:177620:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572291.209038:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24c54a80 x1875444584318336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572291.209060:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572291.209063:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572291.209065:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572291.209068:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9043 00000100:00080000:3.0:1788572291.209071:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572291.209074:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572291.209083:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24c57b80 x1875444584318592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572291.209117:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584318080:0@lo:400:kworker.0 00000100:00100000:3.0:1788572291.209180:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.209230:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572291.209237:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584317824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572291.209267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.209307:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584318464:0@lo:400:kworker.0 00000100:00100000:3.0:1788572291.209331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.209376:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584318080 00000100:00100000:3.0:1788572291.209382:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584318080 00000100:00100000:3.0:1788572291.209424:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788572291.209433:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584318080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572291.209499:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584318080:12345-0@lo:400:kworker.0 Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572291.209506:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788572291.209530:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584317824 00000100:00100000:3.0:1788572291.209533:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584317824 00000100:00100000:3.0:1788572291.209555:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788572291.209561:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3644:x1875444584317824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572291.209590:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3644:x1875444584317824:12345-0@lo:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572291.209597:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788572291.209623:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584318464 00000100:00100000:3.0:1788572291.209627:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584318464 00000100:00100000:3.0:1788572291.209650:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7691 00000100:00100000:3.0:1788572291.209656:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584318464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572291.209688:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584318464:12345-0@lo:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572291.209693:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7691 00000100:00100000:3.0:1788572291.209747:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584318464:0@lo:400:kworker.0 00000100:00100000:3.0:1788572291.209776:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584317824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572291.209786:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584318080:0@lo:400:kworker.0 00000100:00100000:0.0:1788572291.210950:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584317696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788572291.211001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.211037:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584317952:0@lo:38:kworker.0 00000100:00100000:0.0:1788572291.211058:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.211083:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584318208:0@lo:38:kworker.0 00000100:00100000:0.0:1788572291.211102:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.211117:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584318336:0@lo:8:kworker.0 00000100:00100000:0.0:1788572291.211136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.211151:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584318592:0@lo:38:kworker.0 00000100:00100000:0.0:1788572291.211170:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.211202:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584317696 00000100:00100000:0.0:1788572291.211208:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584317696 00000100:00100000:0.0:1788572291.211230:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584318208 00000100:00100000:0.0:1788572291.211232:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584318208 00000100:00100000:0.0:1788572291.211242:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788572291.211248:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584317696:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788572291.211272:0:188054:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9044 last 0 00000020:00000080:0.0:1788572291.211317:0:188054:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bda40 00000004:00100000:0.0:1788572291.211332:0:188054:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788572291.211632:0:188054:0:(import.c:65:import_set_state_nolock()) ffff8e5a40f53000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572291.211683:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584317696:12345-0@lo:38:llog_process_th.0 Request processed in 432us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572291.211690:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788572291.211708:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788572291.211712:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584318208:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572291.211759:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584318208:12345-0@lo:38:kworker.0 Request processed in 45us (656us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572291.211766:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788572291.211790:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584318336 00000100:00100000:0.0:1788572291.211793:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584318336 00000100:00100000:0.0:1788572291.211883:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22629 00000100:00100000:0.0:1788572291.211889:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875444584318336:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572291.211901:0:8704:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572291.211931:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875444584318336:12345-0@lo:8:kworker.0 Request processed in 41us (794us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572291.211937:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22629 00000100:00100000:0.0:1788572291.211961:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584317952 00000100:00100000:0.0:1788572291.211963:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584317952 00000100:00100000:0.0:1788572291.211979:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584318592 00000100:00100000:0.0:1788572291.211983:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584318592 00000100:00100000:0.0:1788572291.211993:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1788572291.211998:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584317952:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572291.212030:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584317952:12345-0@lo:38:kworker.0 Request processed in 30us (970us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572291.212035:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1788572291.212046:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1788572291.212049:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584318592:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572291.212071:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584318592:12345-0@lo:38:kworker.0 Request processed in 21us (900us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572291.212076:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1788572291.212107:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788572291.212116:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 5 00000100:00080000:0.0:1788572291.212123:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788572291.212127:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788572291.212130:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5904e06800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788572291.212136:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584317696:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788572291.212147:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572291.212151:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572291.212154:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584317952:0@lo:38:kworker.0 00000100:00080000:0.0:1788572291.212162:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572291.212165:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572291.212167:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584318208:0@lo:38:kworker.0 00000100:00080000:0.0:1788572291.212175:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572291.212179:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572291.212182:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584318336:0@lo:8:kworker.0 00000100:00080000:0.0:1788572291.212189:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572291.212192:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572291.212194:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584318592:0@lo:38:kworker.0 00000100:00100000:3.0:1788572291.213588:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584318720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572291.213648:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.213708:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584318720 00000100:00100000:3.0:1788572291.213714:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584318720 00000100:00100000:3.0:1788572291.213766:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788572291.213774:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584318720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572291.213812:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1788572291.213853:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584318720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572291.213860:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788572291.213902:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584318720:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1788572291.215942:0:194085:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788572291.216270:0:194085:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788572291.222210:0:194085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572291.231114:0:194085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].80, 64 off13312 00000040:00080000:1.0:1788572291.231425:0:194085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x140:0x0].1, 64 off8256 00000040:00080000:3.0:1788572291.238690:0:194091:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 80 synced_idx: 80 lgh_last_idx: 80 00000040:00080000:3.0:1788572291.238698:0:194091:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x140:0x0] at index 80 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788572291.239059:0:194085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572291.239072:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788572291.239115:0:194085:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788572291.239137:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bda47 00000100:00080000:0.0:1788572291.239148:0:194085:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572291.239154:0:194085:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e59059d6800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572291.239189:0:194085:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ff84a80 x1875444584318848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572291.239223:0:194085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788572291.239339:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572291.239344:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.239346:0:194085:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788572291.239349:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788572291.239352:0:194085:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788572291.239353:0:194085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572291.239355:0:194085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572291.239356:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788572291.239359:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.239360:0:194085:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788572291.239363:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788572291.239367:0:194085:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788572291.239370:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.239372:0:194085:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788572291.239374:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788572291.239378:0:194085:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:0.0:1788572291.239402:0:194085:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788572291.239406:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788572291.239419:0:194085:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e5a0efbcd40) 00000020:00000080:0.0:1788572291.239433:0:194085:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type osp with refcount 2 00000020:00000080:0.0:1788572291.239438:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788572291.239541:0:194085:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788572291.239547:0:194085:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788572291.239552:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bda55 00010000:00080000:0.0:1788572291.239582:0:194085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a36c3b000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:0.0:1788572291.239763:0:194085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-9 is initialized 00000040:01000000:0.0:1788572291.239825:0:194085:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788572291.239841:0:194085:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788572291.240158:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584318848:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788572291.240230:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.240976:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584318848 00000100:00100000:0.0:1788572291.240985:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584318848 00000100:00100000:0.0:1788572291.241042:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22630 00000100:00100000:0.0:1788572291.241049:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0+-99:3640:x1875444584318848:12345-0@lo:8:llog_process_th.0 00010000:00020000:0.0:1788572291.241068:0:177556:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572291.241121:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0+-99:3640:x1875444584318848:12345-0@lo:8:llog_process_th.0 Request processed in 71us (891us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572291.241128:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22630 00000100:00080000:0.0:1788572291.241172:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572291.241176:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572291.241181:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584318848:0@lo:8:llog_process_th.0 00000040:00080000:1.0:1788572291.243459:0:194085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572291.244802:0:194085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].80, 64 off13312 00000040:00080000:1.0:1788572291.244970:0:194085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x142:0x0].1, 64 off8256 00000040:00080000:0.0:1788572291.253218:0:194093:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 80 synced_idx: 80 lgh_last_idx: 80 00000040:00080000:0.0:1788572291.253228:0:194093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x142:0x0] at index 80 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788572291.254743:0:194085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572291.254757:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788572291.254799:0:194085:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788572291.254832:0:194085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bda5c 00000100:00080000:0.0:1788572291.254845:0:194085:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572291.254851:0:194085:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5a36c3b000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572291.254886:0:194085:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ff84a80 x1875444584318976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572291.254917:0:194085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788572291.255125:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584318976:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788572291.255191:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788572291.255309:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572291.255313:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.255316:0:194085:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788572291.255319:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572291.255323:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.255324:0:194085:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788572291.255327:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788572291.255329:0:194085:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788572291.255331:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572291.255333:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.255335:0:194085:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788572291.255337:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572291.255339:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572291.255341:0:194085:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788572291.255344:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788572291.255371:0:194085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194085:1875444584319104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572291.255421:0:194085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.255454:0:194085:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a172d7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572291.255512:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584319104 00000100:00100000:2.0:1788572291.255518:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584319104 00000100:00100000:2.0:1788572291.255558:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572291.255566:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:194085:x1875444584319104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572291.255675:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:194085:x1875444584319104:12345-0@lo:502:llog_process_th.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.255683:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572291.255742:0:194085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194085:1875444584319104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572291.255767:0:194085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572291.255772:0:194085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572291.255773:0:194085:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788572291.255776:0:194085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788572291.255842:0:194071:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788572291.255867:0:194071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788572291.255880:0:194071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.255890:0:194071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572291.255898:0:194071:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a10fc4800 from 1 10000000:01000000:2.0:1788572291.255901:0:194071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788572291.255926:0:194071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.255933:0:194071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.255942:0:194071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572291.255956:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572291.255982:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572291.255998:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590108dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572291.256178:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584319232 00000100:00100000:0.0:1788572291.256183:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584319232 00000100:00100000:0.0:1788572291.256212:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788572291.256219:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:194071:x1875444584319232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572291.256228:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572291.256240:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bda63 expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.256265:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bda63 expref: 9 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.256276:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bda63 expref: 9 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.256285:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1c00, rc 0) 00000100:00100000:0.0:1788572291.256312:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:194071:x1875444584319232:12345-0@lo:101:mount.lustre.0 Request processed in 93us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572291.256318:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788572291.256711:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584318976 00000100:00100000:3.0:1788572291.256716:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584318976 00000100:00100000:3.0:1788572291.256755:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22631 00000100:00100000:3.0:1788572291.256761:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3640:x1875444584318976:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788572291.256785:0:43922:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9044 last 0 00000020:00000080:3.0:1788572291.256819:0:43922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bda71 00002000:00100000:3.0:1788572291.256831:0:43922:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e5903a23800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788572291.256835:0:43922:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788572291.256838:0:43922:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788572291.256909:0:43922:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788572291.256931:0:43922:0:(import.c:65:import_set_state_nolock()) ffff8e5903a23000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572291.256979:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584318976:12345-0@lo:8:llog_process_th.0 Request processed in 217us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572291.256986:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22631 00000100:00100000:3.0:1788572291.257032:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572291.257040:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788572291.257046:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788572291.257051:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788572291.257053:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36c3b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788572291.257465:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319232:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572291.257500:0:194071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.257511:0:194071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572291.258064:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319360:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788572291.258110:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572291.258139:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590108dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572291.258159:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584319360 00000100:00100000:2.0:1788572291.258164:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584319360 00000100:00100000:2.0:1788572291.258196:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572291.258203:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:194071:x1875444584319360:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788572291.258218:0:194078:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788572291.258233:0:194078:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788572291.258237:0:194078:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788572291.258239:0:194078:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 333 00000100:00100000:2.0:1788572291.258449:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:194071:x1875444584319360:12345-0@lo:256:mount.lustre.0 Request processed in 245us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.258455:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572291.258521:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319360:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788572291.261252:0:194071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572291.266168:0:194071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.266185:0:194071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572291.266196:0:194071:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a10fc4800 from 1 10000000:01000000:2.0:1788572291.266199:0:194071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572291.266241:0:194071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.266250:0:194071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.266261:0:194071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572291.266284:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572291.267060:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572291.267096:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572291.267128:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584319488 00000100:00100000:2.0:1788572291.267137:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584319488 00000100:00100000:2.0:1788572291.267182:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572291.267191:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:194071:x1875444584319488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572291.267203:0:194084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572291.267216:0:194084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254600/0x265cfe11109bda7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bda78 expref: -99 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.267242:0:194084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254600/0x265cfe11109bda7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bda78 expref: 10 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.267252:0:194084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254600/0x265cfe11109bda7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bda78 expref: 10 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.267260:0:194084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254600, rc 0) 00000100:00100000:2.0:1788572291.267420:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194071:x1875444584319488:12345-0@lo:101:mount.lustre.0 Request processed in 229us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.267428:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572291.267507:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572291.267521:0:194071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.267531:0:194071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572291.267587:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572291.267610:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572291.267627:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572291.267763:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584319616 00000100:00100000:0.0:1788572291.267768:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584319616 00000100:00100000:0.0:1788572291.267810:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572291.267817:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194071:x1875444584319616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572291.267942:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194071:x1875444584319616:12345-0@lo:501:mount.lustre.0 Request processed in 125us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572291.267949:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788572291.268066:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572291.268091:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572291.268134:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572291.268156:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572291.268169:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584319744 00000100:00100000:2.0:1788572291.268173:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584319744 00000100:00100000:2.0:1788572291.268194:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572291.268200:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194071:x1875444584319744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572291.268283:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194071:x1875444584319744:12345-0@lo:503:mount.lustre.0 Request processed in 82us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572291.268439:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584319872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572291.268493:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572291.268529:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584319872 00000100:00100000:1.0:1788572291.268534:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584319872 00000100:00100000:1.0:1788572291.268571:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6291 00000100:00100000:1.0:1788572291.268578:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584319872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572291.268597:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572291.268629:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584319872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572291.268635:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6291 00000100:00100000:1.0:1788572291.268665:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584319872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572291.268924:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788572291.268960:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572291.268981:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584319744:0@lo:503:mount.lustre.0 00000004:00080000:3.0:1788572291.269160:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788572291.269169:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584318976:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1788572291.269236:0:194093:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788572291.269313:0:194093:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 9044263832875ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788572291.269319:0:194093:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788572291.271390:0:194095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194095:1875444584320000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572291.271473:0:194095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572291.271855:0:194095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcacc0 going to sleep for 11 seconds 00000004:00080000:3.0:1788572291.272196:0:194073:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788572291.274591:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584320000 00000100:00100000:0.0:1788572291.274607:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584320000 00000100:00100000:0.0:1788572291.274709:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788572291.274719:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194095:x1875444584320000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572291.276518:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194095:x1875444584320000:12345-0@lo:502:llog_process_th.0 Request processed in 1793us (5036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572291.276535:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788572291.276680:0:194095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194095:1875444584320000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572291.276717:0:194095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572291.276726:0:194095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572291.276728:0:194095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788572291.276747:0:194095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a10fc4800 00000020:00000080:1.0:1788572291.276749:0:194095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572291.276757:0:194095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572291.276760:0:194095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572291.276761:0:194095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788572291.276763:0:194095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572291.276766:0:194095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572291.276767:0:194095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788572291.276771:0:194095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a10fc4800 00000020:00000080:1.0:1788572291.276773:0:194095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788572291.276876:0:194095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194095:1875444584320128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572291.276929:0:194095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572291.283818:0:194095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572291.289404:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584320128 00000100:00100000:2.0:1788572291.289419:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584320128 00000100:00100000:2.0:1788572291.289671:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788572291.289681:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194095:x1875444584320128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572291.289973:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194095:x1875444584320128:12345-0@lo:502:llog_process_th.0 Request processed in 292us (13042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.289981:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788572291.290076:0:194095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194095:1875444584320128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572291.290113:0:194095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572291.290122:0:194095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572291.290124:0:194095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788572291.290129:0:194095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788572291.292933:0:194071:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788572291.292966:0:194071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572291.292995:0:194071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.293008:0:194071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572291.293080:0:194071:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788572291.293083:0:194071:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5a10fc4800 10000000:01000000:2.0:1788572291.293086:0:194071:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5a10fc4800 10000000:01000000:2.0:1788572291.293090:0:194071:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788572291.293096:0:194071:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a10fc4800 from 1 10000000:01000000:2.0:1788572291.293100:0:194071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788572291.293135:0:194071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.293143:0:194071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.293153:0:194071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572291.293178:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584320256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572291.293241:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572291.293282:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572291.293319:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584320256 00000100:00100000:2.0:1788572291.293326:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584320256 00000100:00100000:2.0:1788572291.293366:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788572291.293375:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:194071:x1875444584320256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572291.293386:0:194084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572291.293399:0:194084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bda8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bda86 expref: -99 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.293420:0:194084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bda8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bda86 expref: 11 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.293430:0:194084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bda8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bda86 expref: 11 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572291.293655:0:194084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254a00, rc 0) 00000100:00100000:2.0:1788572291.293705:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194071:x1875444584320256:12345-0@lo:101:mount.lustre.0 Request processed in 329us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.293714:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788572291.293807:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584320256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572291.293824:0:194071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572291.293832:0:194071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572291.293887:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584320384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572291.293918:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.293947:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0915c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572291.294205:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584320384 00000100:00100000:2.0:1788572291.294210:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584320384 00000100:00100000:2.0:1788572291.294247:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572291.294255:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194071:x1875444584320384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572291.294623:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194071:x1875444584320384:12345-0@lo:501:mount.lustre.0 Request processed in 368us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.294630:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788572291.303461:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584320384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572291.303547:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584320512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572291.303627:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.305596:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0915c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572291.307475:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584320512 00000100:00100000:0.0:1788572291.308296:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584320512 00000100:00100000:0.0:1788572291.308361:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572291.308371:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194071:x1875444584320512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572291.308553:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194071:x1875444584320512:12345-0@lo:503:mount.lustre.0 Request processed in 183us (4926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572291.308561:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788572291.308751:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584320512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572291.311200:0:194098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194098:1875444584320640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572291.311278:0:194098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.311324:0:194098:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0915c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572291.311388:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584320640 00000100:00100000:0.0:1788572291.311394:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584320640 00000100:00100000:0.0:1788572291.311440:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788572291.311449:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194098:x1875444584320640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572291.311599:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194098:x1875444584320640:12345-0@lo:502:llog_process_th.0 Request processed in 150us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572291.311606:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788572291.311814:0:194098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194098:1875444584320640:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788572291.311875:0:194098:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788572291.311890:0:194098:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e5a109f99c0) 00000020:00000080:3.0:1788572291.311913:0:194098:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788572291.311998:0:194098:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a10fc4800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788572291.312002:0:194098:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a10fc4800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788572291.312005:0:194098:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a10fc4800 4 00010000:00080000:3.0:1788572291.312046:0:194098:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5902899800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572291.313723:0:194098:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-10 is initialized 00000020:00000080:3.0:1788572291.313959:0:194098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788572291.313996:0:194098:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788572291.314009:0:194098:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x265cfe11109bda9b 00000100:00080000:3.0:1788572291.314018:0:194098:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572291.314024:0:194098:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e5902899800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572291.314056:0:194098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24c54e00 x1875444584320768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572291.314096:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584320768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572291.314160:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572291.314203:0:194098:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788572291.315938:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584320768 00000100:00100000:1.0:1788572291.315951:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584320768 00000100:00100000:1.0:1788572291.315993:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1788572291.316002:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584320768:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572291.316090:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584320768:12345-0@lo:38:llog_process_th.0 Request processed in 88us (1930us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788572291.316098:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1788572291.322103:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572291.322118:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5902899800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572291.322124:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572291.322129:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584320768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572291.335103:0:194098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194098:1875444584320896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572291.335198:0:194098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.335238:0:194098:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0915c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572291.335315:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584320896 00000100:00100000:0.0:1788572291.335324:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584320896 00000100:00100000:0.0:1788572291.335368:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788572291.335378:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194098:x1875444584320896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572291.335776:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194098:x1875444584320896:12345-0@lo:502:llog_process_th.0 Request processed in 399us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572291.335786:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788572291.336915:0:194098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194098:1875444584320896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572291.336985:0:194098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194098:1875444584321024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572291.337095:0:194098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.337134:0:194098:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b186cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572291.337179:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584321024 00000100:00100000:0.0:1788572291.337185:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584321024 00000100:00100000:0.0:1788572291.337226:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788572291.337235:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194098:x1875444584321024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572291.337330:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194098:x1875444584321024:12345-0@lo:502:llog_process_th.0 Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572291.337338:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788572291.337434:0:194098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194098:1875444584321024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788572291.337464:0:194098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788572291.337743:0:194071:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788572291.337767:0:194071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572291.337788:0:194071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.337799:0:194071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788572291.337864:0:194071:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788572291.337866:0:194071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572291.337867:0:194071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572291.337868:0:194071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572291.337869:0:194071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572291.337870:0:194071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572291.337872:0:194071:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572291.337873:0:194071:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572291.337875:0:194071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572291.337876:0:194071:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572291.337880:0:194071:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788572291.337882:0:194071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572291.337884:0:194071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572291.337885:0:194071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572291.337886:0:194071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572291.337887:0:194071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572291.337888:0:194071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572291.337889:0:194071:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572291.337890:0:194071:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572291.337891:0:194071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572291.337892:0:194071:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572291.337908:0:194071:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788572291.337917:0:194071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584321152:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572291.337953:0:194071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.338978:0:194071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c537480 going to sleep for 11 seconds 00000100:00100000:1.0:1788572291.348374:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584321152 00000100:00100000:1.0:1788572291.348389:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584321152 00000100:00100000:2.0:1788572291.348540:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788572291.348551:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194071:x1875444584321152:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788572291.348587:0:194084:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788572291.348601:0:194084:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788572291.362703:0:194084:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572291.362725:0:194084:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788572291.363057:0:194082:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788572291.363062:0:194082:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788572291.363085:0:194082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.363110:0:194082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bda63 expref: 11 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.363119:0:194082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.363159:0:194082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bda63 expref: 11 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572291.363172:0:194082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109bda63 expref: 11 pid: 194079 timeout: 9144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572291.363186:0:194082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:194082:1875444584321280:0@lo:104: 00000100:00100000:1.0:1788572291.363247:0:194082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572291.363300:0:194082:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572291.363324:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584321280 00000100:00100000:3.0:1788572291.363339:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584321280 00000100:00100000:3.0:1788572291.363419:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5393 00000100:00100000:3.0:1788572291.363431:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:194082:x1875444584321280:12345-0@lo:104: 00010000:00010000:3.0:1788572291.363451:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572291.363599:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:194071:x1875444584321152:12345-0@lo:253:mount.lustre.0 Request processed in 15045us (25641us total) trans 0 rc 0/0 00010000:00010000:3.0:1788572291.363602:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572291.363616:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:194082:x1875444584321280:12345-0@lo:104: Request processed in 187us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.363627:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572291.363638:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5393 00010000:00010000:3.0:1788572291.363669:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572291.363677:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572291.363688:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255400 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572291.363693:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572291.363703:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572291.363712:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572291.363718:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572291.363777:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572291.363786:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572291.363813:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572291.363821:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bda63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bda6a expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572291.363842:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572291.363844:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572291.363846:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572291.363862:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584321408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572291.363947:0:194082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:194082:1875444584321280:0@lo:104: 00010000:00010000:1.0:1788572291.363972:0:194082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572291.364019:0:194071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194071:1875444584321152:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572291.364042:0:194071:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788572291.364045:0:194071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572291.364047:0:194071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572291.364049:0:194071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572291.364050:0:194071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572291.364052:0:194071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572291.364053:0:194071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572291.364055:0:194071:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572291.364057:0:194071:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572291.364059:0:194071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572291.364060:0:194071:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788572291.364077:0:194071:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788572291.367048:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.367887:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584321408 00000100:00100000:0.0:1788572291.367901:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584321408 00010000:00010000:0.0:1788572291.367940:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bda63 expref: 11 pid: 194079 timeout: 9144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572291.367990:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12896 00000100:00100000:0.0:1788572291.368000:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:3644:x1875444584321408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572291.368015:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572291.368020:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bda63 expref: 11 pid: 194079 timeout: 9144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368047:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109bda63 expref: 11 pid: 194079 timeout: 9144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368073:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1c00/0x265cfe11109bda6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bda63 expref: 11 pid: 194079 timeout: 9144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368100:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368109:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788572291.368127:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005065071s 00010000:00010000:0.0:1788572291.368131:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368139:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368147:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368155:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368162:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572291.368166:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368174:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368198:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572291.368208:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572291.368277:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:3644:x1875444584321408:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572291.368284:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12896 00010000:00010000:3.0:1788572291.369105:0:194082:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572291.369124:0:194082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572291.369133:0:194082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bdaa2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572291.369572:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584321408:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788572291.399455:0:194071:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 326417522199 00000040:01000000:0.0:1788572291.400089:0:194071:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788572291.400099:0:194103:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 326417522199 00000020:00080000:3.0:1788572291.400105:0:194103:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522199 00000040:01000000:0.0:1788572291.400648:0:194104:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788572291.400687:0:194071:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788572291.401405:0:194105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:194105:1875444584321536:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572291.401661:0:194105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572291.401710:0:194105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590520cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572291.401788:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584321536 00000100:00100000:1.0:1788572291.401796:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584321536 00000040:01000000:3.0:1788572291.401819:0:194071:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:1.0:1788572291.401873:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000040:00080000:3.0:1788572291.401885:0:194071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788572291.401889:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:194105:x1875444584321536:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572291.401985:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:194105:x1875444584321536:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 101us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572291.401992:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788572291.402080:0:194105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:194105:1875444584321536:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788572291.402116:0:194105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788572291.402147:0:194105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:194105:1875444584321664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788572291.402184:0:194105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572291.402207:0:194105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590394c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572291.402319:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584321664 00000100:00100000:1.0:1788572291.402324:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584321664 00000100:00100000:1.0:1788572291.402355:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788572291.402362:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:194105:x1875444584321664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572291.402474:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:194105:x1875444584321664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 112us (289us total) trans 0 rc 0/0 00000004:00000080:3.0:1788572291.402520:0:194071:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:1.0:1788572291.402526:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000040:01000000:3.0:1788572291.402532:0:194071:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788572291.402578:0:194071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788572291.402607:0:194105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:194105:1875444584321664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788572291.402674:0:194105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:194105:1875444584321792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788572291.402696:0:194105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572291.402716:0:194105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590394c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572291.402871:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584321792 00000100:00100000:1.0:1788572291.402876:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584321792 00000100:00100000:1.0:1788572291.402947:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788572291.402955:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:194105:x1875444584321792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572291.403006:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:194105:x1875444584321792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572291.403012:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000040:00080000:3.0:1788572291.406099:0:194071:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788572291.408687:0:194105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:194105:1875444584321792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788572291.409653:0:194105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:194105:1875444584321920:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788572291.409665:0:194071:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:2.0:1788572291.409763:0:194105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1788572291.409796:0:194071:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:2.0:1788572291.410058:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584321920 00000100:00100000:2.0:1788572291.410068:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584321920 00000100:00100000:2.0:1788572291.410114:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788572291.410123:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:194105:x1875444584321920:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788572291.410329:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:194105:x1875444584321920:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 206us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.410338:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788572291.410362:0:194105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904f41540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572291.410382:0:194105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:194105:1875444584321920:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788572291.410633:0:194071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788572291.411465:0:194071:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x83:0x0] (8/32) registered 00000040:00080000:2.0:1788572291.412438:0:194105:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788572291.412554:0:194105:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00010000:00080000:3.0:1788572291.416259:0:194071:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 339302416387 00010000:00080000:0.0:1788572291.421818:0:194106:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 194106 00010000:02000000:0.0:1788572291.421835:0:194106:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1788572291.421840:0:194106:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:0.0:1788572291.421844:0:194106:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00000020:01000004:3.0:1788572291.422140:0:194071:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788572291.422164:0:194071:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.157@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788572291.422191:0:194071:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788572291.422221:0:194071:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788572291.426234:0:194071:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788572291.426623:0:194071:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788572291.454651:0:194104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788572291.455108:0:194104:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788572291.455113:0:194104:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1788572291.465626:0:194106:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00010000:1.0:1788572291.530151:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572292.543955:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788572292.734839:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572292.734851:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a10fc4800 from 334 10000000:01000000:3.0:1788572292.734859:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572292.734930:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.734944:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.734959:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.734996:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.738931:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.738989:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572292.740037:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584322048 00000100:00100000:0.0:1788572292.740053:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584322048 00000100:00100000:0.0:1788572292.740135:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788572292.740148:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:6515:x1875444584322048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572292.740171:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572292.740199:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdaa9 expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.740237:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdaa9 expref: 11 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.740251:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdaa9 expref: 11 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.740267:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1800, rc 0) 00000100:00100000:0.0:1788572292.740346:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584322048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572292.740354:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788572292.743581:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572292.743622:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.743639:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.743992:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.744099:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.744159:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.747795:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584322176 00000100:00100000:1.0:1788572292.747816:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584322176 00000100:00100000:1.0:1788572292.747904:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572292.747917:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584322176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788572292.747951:0:194080:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788572292.747972:0:194080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788572292.747976:0:194080:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 334 00000100:00100000:1.0:1788572292.748135:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584322176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 219us (4035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.748143:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788572292.749754:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788572292.749838:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572292.749851:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.749869:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572292.749882:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788572292.749886:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a412c6800 from 52 10000000:01000000:3.0:1788572292.749890:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572292.749935:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.749943:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.749954:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.749978:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.750059:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.750107:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572292.753502:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584322304 00000100:00100000:0.0:1788572292.753529:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584322304 00000100:00100000:0.0:1788572292.753615:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572292.753635:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584322304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572292.753659:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572292.753687:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1600/0x265cfe11109bdabe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdab7 expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.753738:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1600/0x265cfe11109bdabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdab7 expref: 12 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.753754:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1600/0x265cfe11109bdabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdab7 expref: 12 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.753766:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1600, rc 0) 00000100:00100000:0.0:1788572292.753953:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584322304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 326us (3893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572292.753961:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788572292.757987:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572292.758036:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdabe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.758054:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdabe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.758190:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.758275:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.758341:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572292.758470:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584322432 00000100:00100000:0.0:1788572292.758506:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584322432 00000100:00100000:0.0:1788572292.758568:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788572292.758578:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584322432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572292.758780:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584322432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572292.758790:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788572292.758957:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.758994:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.759061:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.759092:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572292.761054:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584322560 00000100:00100000:0.0:1788572292.761073:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584322560 00000100:00100000:0.0:1788572292.761161:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788572292.761174:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584322560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572292.761377:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584322560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572292.761398:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788572292.761555:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572292.786171:0:194164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788572292.786976:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788572292.787020:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788572292.787035:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdabe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.787049:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdabe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572292.787061:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572292.787064:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a412c6800 from 332 10000000:01000000:3.0:1788572292.787067:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572292.787117:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.787125:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.787139:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.787173:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.787265:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.787328:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.788536:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584322688 00000100:00100000:1.0:1788572292.788553:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584322688 00000100:00100000:3.0:1788572292.788775:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788572292.788791:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584322688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572292.788815:0:194084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572292.788838:0:194084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdac5 expref: -99 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.788887:0:194084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdac5 expref: 13 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.788901:0:194084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdac5 expref: 13 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.788912:0:194084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616e800, rc 0) 00000100:00100000:3.0:1788572292.789006:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584322688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572292.789014:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788572292.789082:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572292.789104:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.789114:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.789186:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.789229:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.789274:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.789638:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584322816 00000100:00100000:1.0:1788572292.789645:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584322816 00000100:00100000:1.0:1788572292.789683:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788572292.789692:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584322816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788572292.789712:0:194080:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788572292.789743:0:194080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788572292.789748:0:194080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788572292.789750:0:194080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788572292.789753:0:194080:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 334 00000100:00100000:1.0:1788572292.789850:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584322816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.789857:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788572292.790070:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788572292.790153:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572292.790164:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.790175:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572292.790186:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788572292.790189:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1788572292.790192:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788572292.790218:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.790227:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.790238:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.790254:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.790286:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.790323:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.790831:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584322944 00000100:00100000:1.0:1788572292.790837:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584322944 00000100:00100000:1.0:1788572292.790882:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788572292.790889:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584322944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572292.790902:0:194084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572292.790916:0:194084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bdada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdad3 expref: -99 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.790939:0:194084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bdada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdad3 expref: 14 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.790951:0:194084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bdada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdad3 expref: 14 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.790962:0:194084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcfc00, rc 0) 00000100:00100000:1.0:1788572292.790996:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584322944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.791002:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788572292.791212:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584322944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572292.791228:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdada expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.791238:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdada expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.791316:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.791348:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.791392:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.792805:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584323072 00000100:00100000:1.0:1788572292.792823:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584323072 00000100:00100000:1.0:1788572292.792899:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788572292.792910:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584323072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572292.793150:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584323072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.793159:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788572292.793344:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.793413:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.793506:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.793546:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572292.793641:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584323200 00000100:00100000:0.0:1788572292.793648:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584323200 00000100:00100000:0.0:1788572292.793689:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788572292.793699:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584323200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.796607:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572292.798254:0:194166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1788572292.798739:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1788572292.798778:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788572292.798794:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdada expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.798807:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdada expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572292.798818:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788572292.798821:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a412c6800 from 1 10000000:01000000:0.0:1788572292.798825:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788572292.798946:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.798955:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.798973:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572292.799008:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572292.805039:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584323200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 11324us (11516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.805062:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788572292.805063:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572292.805129:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.805132:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584323328 00000100:00100000:1.0:1788572292.805143:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584323328 00000100:00100000:1.0:1788572292.805459:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788572292.805468:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584323328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572292.805506:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572292.805525:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dce000/0x265cfe11109bdae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdae1 expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.805555:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dce000/0x265cfe11109bdae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdae1 expref: 15 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.805765:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dce000/0x265cfe11109bdae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdae1 expref: 15 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.805776:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce000, rc 0) 00000100:00100000:1.0:1788572292.805821:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584323328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 356us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.805826:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788572292.810609:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572292.810651:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdae8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.810674:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdae8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572292.810701:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788572292.810708:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdae8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.810727:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdae8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572292.810739:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788572292.810743:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a412c6800 from 7 10000000:01000000:2.0:1788572292.810747:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572292.810799:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.810808:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.810820:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572292.810848:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.810938:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.810994:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.812206:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584323456 00000100:00100000:1.0:1788572292.812222:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584323456 00000100:00100000:1.0:1788572292.812688:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788572292.812704:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584323456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572292.812735:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572292.812759:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dce600/0x265cfe11109bdaf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdaef expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.812797:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dce600/0x265cfe11109bdaf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdaef expref: 16 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.812810:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dce600/0x265cfe11109bdaf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdaef expref: 16 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.812820:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce600, rc 0) 00000100:00100000:2.0:1788572292.813226:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572292.813253:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdaf6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.813271:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdaf6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572292.813373:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.813420:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.813468:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.813656:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584323456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.813666:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788572292.813698:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584323584 00000100:00100000:1.0:1788572292.813703:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584323584 00000100:00100000:1.0:1788572292.813749:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788572292.813757:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584323584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572292.813899:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584323584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.814373:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788572292.815796:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.815882:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.815989:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.816052:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.816176:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584323712 00000100:00100000:1.0:1788572292.816184:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584323712 00000100:00100000:1.0:1788572292.816246:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788572292.816258:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584323712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572292.816698:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584323712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 440us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.816706:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788572292.817102:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572292.832735:0:194168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788572292.834109:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788572292.834161:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572292.834176:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdaf6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.834190:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdaf6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572292.834202:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788572292.834205:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e59028fe800 from 52 10000000:01000000:2.0:1788572292.834209:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788572292.834262:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.834270:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.834299:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572292.834333:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.834428:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.834476:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572292.834522:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584323840 00000100:00100000:2.0:1788572292.834529:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584323840 00000100:00100000:2.0:1788572292.834595:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788572292.834606:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584323840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572292.834622:0:194084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572292.834638:0:194084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11255e00/0x265cfe11109bdb04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdafd expref: -99 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.834667:0:194084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11255e00/0x265cfe11109bdb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdafd expref: 17 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.834679:0:194084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11255e00/0x265cfe11109bdb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdafd expref: 17 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.834689:0:194084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255e00, rc 0) 00000100:00100000:2.0:1788572292.834741:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584323840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572292.834748:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788572292.834805:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572292.834822:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb04 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.834834:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdb04 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572292.836659:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.836770:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.836831:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572292.837754:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584323968 00000100:00100000:0.0:1788572292.837767:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584323968 00000100:00100000:0.0:1788572292.837836:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788572292.837849:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584323968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572292.838185:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584323968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572292.838193:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572292.838464:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584323968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.838555:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.839046:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.839087:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572292.839113:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584324096 00000100:00100000:2.0:1788572292.839119:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584324096 00000100:00100000:2.0:1788572292.839163:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572292.839174:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584324096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.839944:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584324096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 766us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572292.839955:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572292.840040:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572292.856148:0:194170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788572292.858983:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788572292.859067:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788572292.859082:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb04 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.859097:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb04 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572292.859108:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788572292.859111:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788572292.859115:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788572292.859171:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.859180:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.859193:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572292.859225:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.859317:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.859376:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572292.859438:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584324224 00000100:00100000:2.0:1788572292.859447:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584324224 00000100:00100000:2.0:1788572292.866899:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788572292.866922:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584324224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572292.866948:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572292.866972:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11255000/0x265cfe11109bdb12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdb0b expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.867006:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11255000/0x265cfe11109bdb12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdb0b expref: 18 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.867020:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11255000/0x265cfe11109bdb12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdb0b expref: 18 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.867036:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255000, rc 0) 00000100:00100000:2.0:1788572292.867140:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584324224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (7822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572292.867148:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788572292.867214:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572292.867238:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb12 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.867249:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdb12 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572292.867350:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.867392:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.867428:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572292.867446:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584324352 00000100:00100000:2.0:1788572292.867453:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584324352 00000100:00100000:2.0:1788572292.867530:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572292.867538:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584324352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.867705:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584324352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572292.867713:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572292.875626:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.875729:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.875831:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.875872:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572292.875898:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584324480 00000100:00100000:2.0:1788572292.875907:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584324480 00000100:00100000:2.0:1788572292.875958:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572292.875968:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584324480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.889793:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584324480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 13811us (13948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572292.889815:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572292.890212:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572292.892959:0:194171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788572292.906155:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788572292.906224:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788572292.906241:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb12 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.906258:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb12 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572292.906271:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788572292.906275:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e59028fe800 from 7 10000000:01000000:2.0:1788572292.906279:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572292.906329:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.906338:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.906352:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572292.906457:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.907062:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.908774:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572292.908845:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584324608 00000100:00100000:0.0:1788572292.908856:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584324608 00000100:00100000:0.0:1788572292.909506:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788572292.909522:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584324608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572292.909543:0:194080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572292.909801:0:194080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe0a00/0x265cfe11109bdb20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdb19 expref: -99 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.909840:0:194080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe0a00/0x265cfe11109bdb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdb19 expref: 19 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.909852:0:194080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe0a00/0x265cfe11109bdb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdb19 expref: 19 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.909868:0:194080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0a00, rc 0) 00000100:00100000:0.0:1788572292.912962:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584324608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3429us (5885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572292.912980:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788572292.914944:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572292.914985:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb20 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572292.915002:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdb20 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572292.915132:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.915218:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572292.915277:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572292.918011:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584324736 00000100:00100000:0.0:1788572292.918037:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584324736 00000100:00100000:0.0:1788572292.918120:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788572292.918140:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584324736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572292.918375:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584324736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572292.918383:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788572292.924545:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572292.924657:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572292.926168:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572292.927847:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a04528f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572292.934801:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584324864 00000100:00100000:2.0:1788572292.934822:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584324864 00000100:00100000:1.0:1788572292.935736:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788572292.935752:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584324864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572292.935992:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584324864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (9834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.936002:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788572292.936285:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572292.938267:0:194172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788572292.938685:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788572292.938738:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572292.938754:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb20 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.938768:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb20 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572292.938781:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788572292.938784:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e5a0efbb380 from 1 10000000:01000000:0.0:1788572292.938788:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788572292.938853:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.938862:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.938877:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572292.938911:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572292.939266:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572292.939371:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0b494d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572292.939666:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584324992 00000100:00100000:2.0:1788572292.939677:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584324992 00000100:00100000:0.0:1788572292.939799:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572292.939810:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584324992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572292.939827:0:194078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572292.939846:0:194078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdb2e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdb27 expref: -99 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.939878:0:194078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdb2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdb27 expref: 20 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.939892:0:194078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdb2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdb27 expref: 20 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572292.939902:0:194078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1a00, rc 0) 00000100:00100000:0.0:1788572292.939970:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584324992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572292.939978:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788572292.940085:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584324992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572292.940106:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb2e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.940116:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdb2e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572292.940141:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788572292.940147:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb2e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.940155:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb2e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572292.940170:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788572292.940173:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5a0efbb380 from 1 10000000:01000000:3.0:1788572292.940177:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788572292.940202:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.940210:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.940218:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.940237:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584325120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.940272:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.940306:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572292.940323:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584325120 00000100:00100000:1.0:1788572292.940329:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584325120 00000100:00100000:1.0:1788572292.940395:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788572292.940404:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584325120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572292.940411:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572292.940422:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcf000/0x265cfe11109bdb3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdb35 expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.940439:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcf000/0x265cfe11109bdb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdb35 expref: 21 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.940449:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dcf000/0x265cfe11109bdb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdb35 expref: 21 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572292.940456:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf000, rc 0) 00000100:00100000:1.0:1788572292.940532:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584325120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572292.940539:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788572292.940567:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584325120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572292.940579:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.940588:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572292.940667:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584325248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572292.940694:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572292.940730:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572292.940739:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584325248 00000100:00100000:2.0:1788572292.940744:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584325248 00000100:00100000:2.0:1788572292.940781:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788572292.940788:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584325248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572292.940880:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584325248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (185us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572292.940887:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788572292.940968:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584325248:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788572292.941005:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788572292.941012:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572292.941020:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572293.564669:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572294.013925:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572294.013957:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584325376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572294.014056:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572294.021096:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584325376 00000100:00100000:3.0:1788572294.021118:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584325376 00000100:00100000:3.0:1788572294.021198:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6292 00000100:00100000:3.0:1788572294.021213:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584325376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572294.021257:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572294.021381:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584325376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 173us (7326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572294.021390:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6292 00000100:00080000:3.0:1788572294.021420:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572294.021496:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584325376:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572294.594197:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572295.613648:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572296.486384:0:194354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788572296.572670:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584325504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572296.572738:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572296.572879:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572296.572884:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572296.572888:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572296.572896:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572296.572930:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb08700 x1875444584325760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572296.572953:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572296.572955:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572296.572957:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572296.572972:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572296.572985:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4132aa00 x1875444584326016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572296.572993:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572296.572996:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572296.572998:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572296.573001:0:186041:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9044 00000100:00080000:1.0:1788572296.573004:0:186041:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572296.573008:0:186041:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572296.573017:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4132ad80 x1875444584326144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572296.573037:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572296.573040:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572296.573042:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572296.573047:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572296.573059:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a41329c00 x1875444584326400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572296.573067:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788572296.573070:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572296.573072:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572296.573075:0:186041:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 9044 00000100:00080000:1.0:1788572296.573078:0:186041:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572296.573081:0:186041:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e59059d6800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572296.573089:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a41328000 x1875444584326528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572296.573103:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788572296.573105:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572296.573106:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5902899800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572296.573110:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e5902899800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572296.573122:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a2462ea00 x1875444584326784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572296.573143:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584325888:0@lo:400:kworker.0 00000100:00100000:1.0:1788572296.573175:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572296.573198:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572296.573203:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584325632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572296.573230:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572296.573283:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584325888 00000100:00100000:1.0:1788572296.573291:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584325888 00000100:00100000:1.0:1788572296.573358:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788572296.573367:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584325888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572296.573417:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584325888:12345-0@lo:400:kworker.0 Request processed in 51us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572296.573424:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:1.0:1788572296.573442:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572296.573454:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584326272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572296.573500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572296.573519:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572296.573524:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584326656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572296.573544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572296.573569:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584326272 00000100:00100000:1.0:1788572296.573572:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584326272 00000100:00100000:1.0:1788572296.573598:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584326656 00000100:00100000:1.0:1788572296.573601:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584326656 00000100:00100000:1.0:1788572296.573616:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7692 00000100:00100000:1.0:1788572296.573622:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584326272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572296.573652:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584326272:12345-0@lo:400:kworker.0 Request processed in 31us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572296.573658:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7692 00000100:00100000:1.0:1788572296.573670:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7693 00000100:00100000:1.0:1788572296.573675:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584326656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572296.573697:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584326656:12345-0@lo:400:kworker.0 Request processed in 22us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572296.573702:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7693 00000100:00080000:1.0:1788572296.573725:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572296.573750:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584326656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572296.573760:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584326272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572296.573803:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584325888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572296.574139:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584325760:0@lo:38:kworker.0 00000100:00100000:3.0:1788572296.574170:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572296.574187:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584326016:0@lo:38:kworker.0 00000100:00100000:3.0:1788572296.574209:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572296.574240:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584326144:0@lo:8:kworker.0 00000100:00100000:3.0:1788572296.574263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572296.574279:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584326400:0@lo:38:kworker.0 00000100:00100000:3.0:1788572296.574300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572296.574317:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584326528:0@lo:8:kworker.0 00000100:00100000:3.0:1788572296.574355:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572296.574371:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584326784:0@lo:38:kworker.0 00000100:00100000:3.0:1788572296.574391:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572296.574418:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584325504 00000100:00100000:3.0:1788572296.574422:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584325504 00000100:00100000:3.0:1788572296.574452:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584326016 00000100:00100000:3.0:1788572296.574455:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584326016 00000100:00100000:3.0:1788572296.574467:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788572296.574475:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584325504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572296.574530:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1788572296.574567:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584325504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572296.574573:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788572296.574589:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788572296.574594:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584326016:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788572296.574617:0:189111:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8e5903a24800, cookie 0x265cfe11109bda01 00010000:00080000:3.0:1788572296.574622:0:189111:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8e5903a24800 cur 9049 last 1788572291 00010000:02000400:3.0:1788572296.574630:0:189111:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00010000:00080000:3.0:1788572296.574636:0:189111:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1788572296.574649:0:189111:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572296.574830:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e5a3717b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572296.574875:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584326016:12345-0@lo:38:kworker.0 Request processed in 280us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572296.574883:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788572296.574906:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584325760 00000100:00100000:3.0:1788572296.574910:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584325760 00000100:00100000:3.0:1788572296.574925:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584326400 00000100:00100000:3.0:1788572296.574927:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584326400 00000100:00100000:3.0:1788572296.574933:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584326784 00000100:00100000:3.0:1788572296.574935:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584326784 00000100:00100000:3.0:1788572296.574945:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1788572296.574949:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584325760:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572296.575186:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584325632 00000100:00100000:0.0:1788572296.575191:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584325632 00000100:00100000:0.0:1788572296.575222:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788572296.575241:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3644:x1875444584325632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572296.575278:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3644:x1875444584325632:12345-0@lo:400:kworker.0 Request processed in 51us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572296.575285:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788572296.575314:0:194106:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:0.0:1788572296.575319:0:194106:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 339302416388 00000020:00080000:0.0:1788572296.575324:0:194106:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572296.575414:0:194106:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 339302416388 00000020:00080000:0.0:1788572296.575420:0:194106:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572296.575422:0:194106:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 339302416388 00000100:00100000:0.0:1788572296.575594:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584326144 00000100:00100000:0.0:1788572296.575599:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584326144 00000100:00100000:0.0:1788572296.575617:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584326528 00000100:00100000:0.0:1788572296.575620:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584326528 00000100:00100000:0.0:1788572296.575635:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22632 00000100:00100000:0.0:1788572296.575641:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3640:x1875444584326144:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572296.575655:0:177559:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572296.575684:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3640:x1875444584326144:12345-0@lo:8:kworker.0 Request processed in 43us (1420us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572296.575694:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22632 00000100:00100000:0.0:1788572296.575704:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22633 00000100:00100000:0.0:1788572296.575708:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3640:x1875444584326528:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572296.575717:0:177559:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572296.575744:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3640:x1875444584326528:12345-0@lo:8:kworker.0 Request processed in 34us (1389us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572296.575749:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22633 00000100:00080000:0.0:1788572296.575805:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 80 00000100:00080000:0.0:1788572296.575816:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788572296.575820:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788572296.575823:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 326417519069 gen 2 00000100:00080000:0.0:1788572296.575827:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a1f80e800 from lustre-MDT0000_UUID committed 326417519069 last 0 00000100:00080000:0.0:1788572296.575830:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788572296.575952:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584326016:0@lo:38:kworker.0 00000100:00080000:0.0:1788572296.576072:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572296.576078:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572296.576081:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584326144:0@lo:8:kworker.0 00000100:00080000:0.0:1788572296.576093:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572296.576096:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572296.576098:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584326528:0@lo:8:kworker.0 00010000:00080000:0.0:1788572296.576127:0:194358:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788572296.576131:0:194358:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788572296.576136:0:194358:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00100000:1.0:1788572296.576354:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:1.0:1788572296.576360:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584326400:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572296.576375:0:188833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9049 last 0 00000020:00000080:1.0:1788572296.576405:0:188833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x265cfe11109bdb43 00000004:00100000:1.0:1788572296.576416:0:188833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572296.576437:0:188833:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efdb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572296.576476:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875444584326400:12345-0@lo:38:kworker.0 Request processed in 115us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572296.576499:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:1.0:1788572296.576515:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1788572296.576519:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584326784:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572296.576530:0:188833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9049 last 0 00000020:00000080:1.0:1788572296.576549:0:188833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x265cfe11109bdb4a 00000004:00100000:1.0:1788572296.576555:0:188833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572296.576567:0:188833:0:(import.c:65:import_set_state_nolock()) ffff8e5a36e24800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572296.576592:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584326784:12345-0@lo:38:kworker.0 Request processed in 72us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572296.576598:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00010000:00080000:1.0:1788572296.576633:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5a41329c00 x1875444584326400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572296.576644:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 80 00010000:00080000:3.0:1788572296.577183:0:188049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9049 last 0 00000020:00000080:3.0:1788572296.577208:0:188049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x265cfe11109bdb51 00000004:00100000:3.0:1788572296.577216:0:188049:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572296.577306:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e5a372df800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572296.577407:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875444584325760:12345-0@lo:38:kworker.0 Request processed in 2455us (3235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572296.577413:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00080000:0.0:1788572296.577844:0:194358:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:1.0:1788572296.578849:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8e5a41329c00 x1875444584326400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572311 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572296.578865:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572296.578870:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572296.578874:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572296.578879:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584326400:0@lo:38:kworker.0 00010000:00080000:1.0:1788572296.578924:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5a2462ea00 x1875444584326784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572296.578940:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 80 00000100:00080000:1.0:1788572296.578948:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788572296.578952:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788572296.578955:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5902899800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572296.578959:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584326784:0@lo:38:kworker.0 00000100:00100000:1.0:1788572296.579168:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584326912:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788572296.579220:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788572296.579268:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e590cb08700 x1875444584325760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572296.579277:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 80 00000100:00100000:3.0:1788572296.580186:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584326912 00000100:00100000:3.0:1788572296.580195:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584326912 00000100:00100000:3.0:1788572296.580256:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788572296.580266:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584326912:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788572296.580284:0:189111:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e5a2462ea00 x1875444584326912/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:712/0 lens 224/0 e 0 to 0 dl 1788572307 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572296.580304:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584326912:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 41us (1084us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572296.580311:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000020:00080000:3.0:1788572296.580329:0:194106:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572296.580343:0:194106:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 339302416388 00010000:00080000:3.0:1788572296.580347:0:194106:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788572296.580350:0:194106:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572296.580356:0:194106:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788572296.580359:0:194106:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788572296.580461:0:194106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 80, last_transno is 343597383680 00000100:00100000:0.0:1788572296.582560:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584325504:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788572296.584550:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8e590cb08700 x1875444584325760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572311 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572296.584564:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572296.584569:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572296.584574:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572296.584579:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584325760:0@lo:38:kworker.0 00000100:00100000:1.0:1788572296.584651:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584325632:0@lo:400:kworker.0 00000001:00100000:3.0:1788572296.588347:0:194073:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1788572296.588455:0:194106:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788572296.588529:0:194106:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788572296.588546:0:194106:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8e5a2462ea00 x1875444584326912/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:712/0 lens 224/0 e 0 to 0 dl 1788572307 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788572296.588663:0:194106:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. 00000100:00080000:3.0:1788572296.593174:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788572296.593191:0:3640:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8e590cdf4700 x1875444584326912/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572312 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572296.593203:0:3640:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8e590cdf4700 x1875444584326912/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572312 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572296.593209:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788572296.593226:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788572296.593245:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008a9c660a): req@ffff8e5a4104df80 x1875444584309120/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572278 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572296.593269:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584326912:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788572296.593371:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584327040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572296.593435:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572296.593497:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584327040 00000100:00100000:3.0:1788572296.593502:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584327040 00000100:00100000:3.0:1788572296.593547:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788572296.593555:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584327040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572296.593588:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572296.593631:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584327040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572296.593638:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788572296.593669:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584327040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572296.594787:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572296.594872:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584309120 00000100:00100000:1.0:1788572296.594877:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584309120 00000100:00100000:1.0:1788572296.594922:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788572296.594930:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584309120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572296.594947:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1788572296.594996:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584309120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572296.595002:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788572296.595032:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584309120:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1788572296.668119:0:194106:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaac787c63e10 00100000:10000000:1.0:1788572296.668133:0:194106:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00010000:00010000:0.0:1788572296.670684:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572296.679162:0:194094:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1989:0x0] 00000100:00100000:0.0:1788572296.679228:0:194094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cdf7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:194094:1875444584327168:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788572296.679296:0:194094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572296.679326:0:194094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a12a56180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572296.679361:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584327168 00000100:00100000:0.0:1788572296.679368:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584327168 00000100:00100000:0.0:1788572296.679420:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22634 00000100:00100000:0.0:1788572296.679429:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:194094:x1875444584327168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788572296.679452:0:177561:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6657 -> diff = -120 00002000:02000040:0.0:1788572296.679457:0:177561:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6538 to 0x2c0000401:6657) 00002000:00010000:0.0:1788572296.700879:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572296.700894:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.700911:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a01:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:0.0:1788572296.700915:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572296.700938:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.700958:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.703111:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.703121:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.703309:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572296.703325:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572296.703330:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.704502:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572296.704508:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.704522:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.704542:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.704549:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e5f94c6/0x265cfe11109bdb58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572296.704579:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572296.704581:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572296.704584:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572296.704887:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.704895:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.704907:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a00:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.704912:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.704918:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.704929:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.704938:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.704952:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.710015:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572296.714011:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572296.714024:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.714038:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.714043:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.714054:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.714073:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.714080:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bdb5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.714100:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.714102:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.714103:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572296.714567:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.714575:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714588:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ff:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.714593:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.714601:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714613:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714622:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714630:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714656:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572296.714704:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.714709:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714717:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fe:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.714720:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.714723:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714732:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714740:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714748:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714763:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572296.714812:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.714817:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714825:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fd:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.714828:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.714831:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714839:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714847:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714854:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714867:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572296.714904:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.714920:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714930:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fc:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.714933:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.714936:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714945:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714953:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714960:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.714988:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788572296.715024:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.715029:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715036:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fb:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.715039:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.715042:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715052:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715059:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715066:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715080:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788572296.715114:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.715119:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715127:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fa:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.715130:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.715134:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715143:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715150:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715156:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715165:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788572296.715200:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.715205:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715212:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f9:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.715215:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.715219:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.715227:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716024:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572296.716032:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716042:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.716046:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716062:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716077:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716085:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bdb66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716103:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572296.716107:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716113:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.716117:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716124:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716134:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716141:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bdb6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716157:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572296.716161:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716167:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.716170:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716178:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716187:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716194:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bdb74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716205:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572296.716209:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716214:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.716218:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716229:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716238:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716461:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bdb7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716476:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572296.716501:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716509:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.716512:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716521:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716532:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716540:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bdb82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716558:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572296.716561:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716567:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.716570:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716578:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716588:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716596:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9fe0cf9/0x265cfe11109bdb89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.716607:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.716609:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.716611:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.716620:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572296.716901:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.717020:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.717078:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572296.717150:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.717156:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.717167:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f8:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.717171:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.717176:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.717186:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.717195:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.717202:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.719982:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572296.719995:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.720007:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.720013:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.720024:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.720043:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.720050:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bdb90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.720073:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572296.720077:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.720082:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.720085:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.720091:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.720100:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.720106:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.720109:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.720111:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572296.720375:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572296.720383:0:177561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bdb97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572296.720546:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.720553:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720564:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f7:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.720568:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.720574:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720587:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720594:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720601:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720615:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572296.720651:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.720657:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720664:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f6:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.720667:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.720672:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720681:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720689:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720695:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720703:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572296.720739:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.720744:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720750:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f5:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.720753:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.720756:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720764:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720772:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720800:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720810:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572296.720849:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.720854:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720862:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f4:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.720865:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.720869:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720876:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720883:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720890:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720898:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788572296.720946:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.720950:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720959:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f3:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.720961:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.720977:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720987:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.720995:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721003:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721012:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788572296.721046:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.721051:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721058:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f2:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.721061:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.721065:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721074:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721082:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721088:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721097:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788572296.721133:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.721138:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721144:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f1:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.721147:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.721151:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721160:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721168:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721176:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721190:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788572296.721226:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.721231:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721591:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f0:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.721594:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.721598:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721607:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721614:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721621:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721630:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788572296.721672:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.721676:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721684:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ef:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.721687:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.721691:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721699:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721706:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721713:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721720:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788572296.721752:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.721756:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721763:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ee:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.721766:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.721770:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721790:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721798:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721806:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721813:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1788572296.721849:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.721853:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721861:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ed:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.721863:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.721867:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721875:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721881:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721888:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721895:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1788572296.721940:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.721945:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721952:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ec:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.721955:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.721958:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721976:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721983:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721989:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.721996:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1788572296.722025:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.722030:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722037:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19eb:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.722040:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.722043:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722051:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722059:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722065:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722073:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1788572296.722106:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.722111:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722118:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ea:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.722120:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.722124:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722131:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722138:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722145:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722158:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1788572296.722189:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.722194:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722201:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e9:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.722203:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.722207:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722214:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722222:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722229:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722500:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:1.0:1788572296.722543:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.722548:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722556:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e8:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.722559:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.722563:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722572:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722579:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722586:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722593:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:1.0:1788572296.722626:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.722631:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722640:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e7:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.722643:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.722647:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722656:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722664:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722673:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722681:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:1.0:1788572296.722714:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.722718:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722726:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e6:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.722729:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.722733:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722742:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722750:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722758:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722766:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:1.0:1788572296.722812:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.722817:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722824:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e5:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.722828:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.722832:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722840:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722847:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722854:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.722862:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:1.0:1788572296.722897:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.722902:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723077:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:3.0:1788572296.723085:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723092:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.723097:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723106:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723121:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723128:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bdb9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723149:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:3.0:1788572296.723153:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723159:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.723162:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723173:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723181:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723189:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bdba5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723200:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1788572296.723203:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723209:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.723212:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723218:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723227:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723233:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bdbac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723318:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1788572296.723321:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723327:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.723330:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723456:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723467:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723474:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fd723ad/0x265cfe11109bdbb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723824:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1788572296.723829:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723836:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.723839:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723852:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723862:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723869:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aef32dc2/0x265cfe11109bdbba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723879:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1788572296.723883:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723889:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.723891:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.723900:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724030:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724041:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ec78c0d/0x265cfe11109bdbc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724061:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1788572296.724065:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724072:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.724075:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724084:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724094:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724102:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011436b15/0x265cfe11109bdbc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724112:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1788572296.724116:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724122:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.724125:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724139:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724148:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724531:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040170dd6/0x265cfe11109bdbcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724549:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1788572296.724553:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724559:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.724562:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724570:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724581:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724588:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074583276/0x265cfe11109bdbd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724604:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788572296.724608:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724614:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.724616:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724624:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724632:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724638:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094def872/0x265cfe11109bdbdd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724651:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788572296.724654:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724661:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.724664:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724676:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724686:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724694:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015ea975b/0x265cfe11109bdbe4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724707:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788572296.724710:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724717:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.724720:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724728:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724738:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724745:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034552887/0x265cfe11109bdbeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724762:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788572296.724765:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724772:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.724787:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724796:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724806:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724814:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014793408/0x265cfe11109bdbf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724827:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572296.724830:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724836:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.724839:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724851:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724860:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724866:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e61ead76/0x265cfe11109bdbf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724878:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572296.724881:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724887:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.724890:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724896:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.724904:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.725061:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e4:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.725065:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.725071:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.725082:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.725092:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.725100:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.725114:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788572296.725192:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.725198:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.725206:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e3:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.725209:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.725213:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.725221:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.725228:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.726626:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.726655:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788572296.726729:0:177561:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572296.726735:0:177561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.726745:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e2:0x0].0x0 since=9049s v=(0 0) 00010000:00010000:1.0:1788572296.726749:0:177561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572296.726754:0:177561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.726764:0:177561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.726772:0:177561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.726793:0:177561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572296.726802:0:177561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788572296.727072:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000062592c9/0x265cfe11109bdc00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.727102:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788572296.727107:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.727114:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.727118:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.727128:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.727145:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.727153:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002257d724/0x265cfe11109bdc07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728089:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572296.728094:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728103:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.728107:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728120:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728464:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728476:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2118e3c/0x265cfe11109bdc0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728506:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572296.728510:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728516:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.728520:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728527:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728538:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728545:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000624a967f/0x265cfe11109bdc15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728562:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572296.728565:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728571:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.728575:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728582:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728591:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728598:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f22be55/0x265cfe11109bdc1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728609:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572296.728612:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728618:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.728621:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728634:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728643:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728650:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023e5716b/0x265cfe11109bdc23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728661:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572296.728664:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728670:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.728673:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728680:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728688:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728695:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb10ae/0x265cfe11109bdc2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728710:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572296.728712:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728718:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572296.728721:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728728:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728735:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728742:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd2523d/0x265cfe11109bdc31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572296.728751:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.728753:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.728756:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572296.728806:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572296.730341:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572296.730356:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572296.730362:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788572296.733729:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00080000:3.0:1788572296.735876:0:177561:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6537 00000100:00100000:3.0:1788572296.736564:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:194094:x1875444584327168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 57130us (57262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572296.736576:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22634 00000100:00100000:1.0:1788572296.743111:0:194094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cdf7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:194094:1875444584327168:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788572296.747521:0:194094:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1a01:0x0] from OST, last_created [0x2c0000401:0x1a01:0x0]last_used is [0x2c0000401:0x1989:0x0] 00000100:00100000:3.0:1788572296.747714:0:194094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:194094:1875444584327424:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788572296.747790:0:194094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572296.747820:0:194094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572296.747835:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572296.747848:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584327296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572296.747875:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572296.747906:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584327424 00000100:00100000:3.0:1788572296.747925:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584327424 00000100:00100000:3.0:1788572296.747980:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22635 00000100:00100000:3.0:1788572296.747989:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:194094:x1875444584327424:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788572296.748032:0:43923:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6658 00000100:00100000:1.0:1788572296.751700:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584327296 00000100:00100000:1.0:1788572296.751713:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584327296 00000100:00100000:1.0:1788572296.751766:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6293 00000100:00100000:1.0:1788572296.751788:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584327296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572296.751814:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 896 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572296.751892:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584327296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (4016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572296.751900:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6293 00000100:00100000:1.0:1788572296.751981:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584327296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572296.754269:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:194094:x1875444584327424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6275us (6483us total) trans 4294975676 rc 0/0 00000100:00100000:3.0:1788572296.754281:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22635 00000100:00100000:1.0:1788572296.760007:0:194094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:194094:1875444584327424:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788572296.760032:0:194094:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1a01:0x0]-[0x2c0000401:0x1a21:0x0] 00000001:00100000:0.0:1788572297.109361:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:0.0:1788572297.662461:0:194408:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788572297.662770:0:194408:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788572297.725072:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572298.749923:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788572298.761917:0:194458:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572298.763662:0:194458:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788572299.048874:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572299.051033:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569485568 00000100:00100000:2.0:1788572299.051057:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569485568 00000100:00100000:2.0:1788572299.051130:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 51 00000100:00100000:2.0:1788572299.051140:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2396:x1875444569485568:12345-192.168.202.57@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788572299.051178:0:194084:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f79285ed-4685-45a8-8731-5e2522a143f3@192.168.202.57@tcp t0 exp 0000000000000000 cur 9052 last 0 00000020:00000080:2.0:1788572299.051214:0:194084:0:(genops.c:1385:class_connect()) connect: client f79285ed-4685-45a8-8731-5e2522a143f3, cookie 0x265cfe11109bdc38 00000100:00080000:2.0:1788572299.051405:0:194084:0:(import.c:65:import_set_state_nolock()) ffff8e590bb62800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572299.051519:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+5:2396:x1875444569485568:12345-192.168.202.57@tcp:250:mount.lustre.0 Request processed in 378us (2660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572299.051527:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 51 00000100:00100000:0.0:1788572299.060199:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572299.060400:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569485696 00000100:00100000:1.0:1788572299.060413:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569485696 00000100:00100000:1.0:1788572299.060621:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 52 00000100:00100000:1.0:1788572299.060634:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+5:160918:x1875444569485696:12345-192.168.202.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788572299.060658:0:194080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572299.060682:0:194080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd2600/0x265cfe11109bdc3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb2a9 expref: -99 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572299.060721:0:194080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd2600/0x265cfe11109bdc3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2a9 expref: 6 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572299.060735:0:194080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd2600/0x265cfe11109bdc3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2a9 expref: 6 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572299.060745:0:194080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd2600, rc 0) 00000100:00100000:1.0:1788572299.061768:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+6:160918:x1875444569485696:12345-192.168.202.57@tcp:101:mount.lustre.0 Request processed in 1126us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572299.061780:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 52 00000100:00100000:2.0:1788572299.068291:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.068388:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569485824 00000100:00100000:0.0:1788572299.068413:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569485824 00000100:00100000:0.0:1788572299.068528:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 53 00000100:00100000:0.0:1788572299.068542:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+6:160918:x1875444569485824:12345-192.168.202.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788572299.068692:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+6:160918:x1875444569485824:12345-192.168.202.57@tcp:501:mount.lustre.0 Request processed in 154us (418us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572299.068701:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 53 00000100:00100000:1.0:1788572299.075394:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.084466:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569485952 00000100:00100000:0.0:1788572299.084508:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569485952 00000100:00100000:1.0:1788572299.085297:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 54 00000100:00100000:1.0:1788572299.085312:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+6:160918:x1875444569485952:12345-192.168.202.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788572299.085335:0:194080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572299.085361:0:194080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd3800/0x265cfe11109bdc46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb2b0 expref: -99 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572299.085399:0:194080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd3800/0x265cfe11109bdc46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2b0 expref: 7 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572299.085412:0:194080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd3800/0x265cfe11109bdc46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2b0 expref: 7 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572299.085424:0:194080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3800, rc 0) 00000100:00100000:1.0:1788572299.085531:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+7:160918:x1875444569485952:12345-192.168.202.57@tcp:101:mount.lustre.0 Request processed in 222us (10151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572299.085539:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 54 00000100:00100000:3.0:1788572299.099059:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.099141:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569486080 00000100:00100000:0.0:1788572299.099157:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569486080 00000100:00100000:0.0:1788572299.099226:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 55 00000100:00100000:0.0:1788572299.099238:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+7:160918:x1875444569486080:12345-192.168.202.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788572299.099440:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+8:160918:x1875444569486080:12345-192.168.202.57@tcp:501:mount.lustre.0 Request processed in 203us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.099452:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 55 00000100:00100000:3.0:1788572299.101883:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.107051:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569486208 00000100:00100000:0.0:1788572299.107073:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569486208 00000100:00100000:0.0:1788572299.107177:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 56 00000100:00100000:0.0:1788572299.107191:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+8:160918:x1875444569486208:12345-192.168.202.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788572299.107404:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+8:160918:x1875444569486208:12345-192.168.202.57@tcp:503:mount.lustre.0 Request processed in 215us (5534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.107413:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 56 00000100:00100000:0.0:1788572299.112083:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572299.115019:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569486336 00000100:00100000:2.0:1788572299.115040:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569486336 00000100:00100000:2.0:1788572299.115138:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 57 00000100:00100000:2.0:1788572299.115153:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+8:160937:x1875444569486336:12345-192.168.202.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788572299.115385:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+8:160937:x1875444569486336:12345-192.168.202.57@tcp:502:llog_process_th.0 Request processed in 234us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572299.115395:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 57 00000100:00100000:2.0:1788572299.132896:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584327552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572299.133205:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572299.139740:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584327552 00000100:00100000:3.0:1788572299.139764:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584327552 00000100:00100000:3.0:1788572299.139895:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6294 00000100:00100000:3.0:1788572299.139911:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584327552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572299.139969:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141248 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572299.140099:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584327552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 194us (7009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572299.140108:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6294 00000100:00080000:1.0:1788572299.140248:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572299.143638:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584327552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572299.147383:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.148985:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569486464 00000100:00100000:0.0:1788572299.149013:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569486464 00000100:00100000:0.0:1788572299.149112:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 58 00000100:00100000:0.0:1788572299.149125:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+8:160937:x1875444569486464:12345-192.168.202.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788572299.149351:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+8:160937:x1875444569486464:12345-192.168.202.57@tcp:502:llog_process_th.0 Request processed in 228us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.149360:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 58 00000100:00100000:3.0:1788572299.160996:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572299.166566:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569486592 00000100:00100000:1.0:1788572299.166582:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569486592 00000100:00100000:1.0:1788572299.166664:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 59 00000100:00100000:1.0:1788572299.166675:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+8:160937:x1875444569486592:12345-192.168.202.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788572299.169134:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+8:160937:x1875444569486592:12345-192.168.202.57@tcp:502:llog_process_th.0 Request processed in 2451us (8139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572299.169151:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 59 00000100:00100000:3.0:1788572299.174336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.174452:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569486720 00000100:00100000:0.0:1788572299.174471:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569486720 00000100:00100000:0.0:1788572299.174596:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 60 00000100:00100000:0.0:1788572299.174608:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+8:160918:x1875444569486720:12345-192.168.202.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788572299.174628:0:194078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572299.174650:0:194078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb2e1 expref: -99 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572299.174694:0:194078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e1 expref: 9 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572299.174707:0:194078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e1 expref: 9 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572299.174718:0:194078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1400, rc 0) 00000100:00100000:0.0:1788572299.174804:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+9:160918:x1875444569486720:12345-192.168.202.57@tcp:101:mount.lustre.0 Request processed in 198us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.174812:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 60 00000100:00100000:3.0:1788572299.180051:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572299.180386:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569486848 00000100:00100000:2.0:1788572299.180398:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569486848 00000100:00100000:2.0:1788572299.180468:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 61 00000100:00100000:2.0:1788572299.180515:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+9:160918:x1875444569486848:12345-192.168.202.57@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788572299.180542:0:194084:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788572299.180569:0:194084:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788572299.180573:0:194084:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788572299.180576:0:194084:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788572299.180579:0:194084:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 334 00000100:00100000:2.0:1788572299.182596:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+9:160918:x1875444569486848:12345-192.168.202.57@tcp:256:mount.lustre.0 Request processed in 2107us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572299.182611:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 61 00000100:00100000:3.0:1788572299.187470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.187639:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569486976 00000100:00100000:0.0:1788572299.187658:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569486976 00000100:00100000:0.0:1788572299.187740:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 62 00000100:00100000:0.0:1788572299.187753:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+9:160918:x1875444569486976:12345-192.168.202.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788572299.187780:0:194078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572299.187812:0:194078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe0400/0x265cfe11109bdc54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb2e8 expref: -99 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572299.187868:0:194078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe0400/0x265cfe11109bdc54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e8 expref: 10 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572299.187882:0:194078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe0400/0x265cfe11109bdc54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e8 expref: 10 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572299.187893:0:194078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0400, rc 0) 00000100:00100000:0.0:1788572299.188005:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:160918:x1875444569486976:12345-192.168.202.57@tcp:101:mount.lustre.0 Request processed in 245us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.188017:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 62 00000100:00100000:3.0:1788572299.191738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572299.196581:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569487104 00000100:00100000:1.0:1788572299.196597:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569487104 00000100:00100000:1.0:1788572299.196732:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 63 00000100:00100000:1.0:1788572299.196744:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160918:x1875444569487104:12345-192.168.202.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788572299.196929:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160918:x1875444569487104:12345-192.168.202.57@tcp:501:mount.lustre.0 Request processed in 187us (5206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572299.196938:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 63 00000100:00100000:3.0:1788572299.200389:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.200569:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569487232 00000100:00100000:0.0:1788572299.200580:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569487232 00000100:00100000:0.0:1788572299.200636:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 64 00000100:00100000:0.0:1788572299.200647:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:160918:x1875444569487232:12345-192.168.202.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788572299.200812:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:160918:x1875444569487232:12345-192.168.202.57@tcp:503:mount.lustre.0 Request processed in 166us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.200821:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 64 00000100:00100000:3.0:1788572299.215173:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572299.215552:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569487360 00000100:00100000:2.0:1788572299.215563:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569487360 00000100:00100000:2.0:1788572299.215626:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 65 00000100:00100000:2.0:1788572299.215637:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:160944:x1875444569487360:12345-192.168.202.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788572299.215801:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:160944:x1875444569487360:12345-192.168.202.57@tcp:502:llog_process_th.0 Request processed in 165us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572299.215809:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 65 00000100:00100000:2.0:1788572299.217708:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572299.217791:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569487488 00000100:00100000:3.0:1788572299.217799:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569487488 00000100:00100000:3.0:1788572299.217861:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 66 00000100:00100000:3.0:1788572299.217870:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:160944:x1875444569487488:12345-192.168.202.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788572299.218010:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:160944:x1875444569487488:12345-192.168.202.57@tcp:502:llog_process_th.0 Request processed in 140us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572299.218018:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 66 00000100:00100000:3.0:1788572299.235719:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572299.235836:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.236253:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569487616 00000100:00100000:0.0:1788572299.236265:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569487616 00000100:00100000:0.0:1788572299.236310:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569487872 00000100:00100000:0.0:1788572299.236312:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569487872 00000100:00100000:0.0:1788572299.236344:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1022 00000100:00100000:0.0:1788572299.236353:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569487616:12345-192.168.202.57@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788572299.236386:0:188048:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9052 last 0 00000020:00000080:0.0:1788572299.236453:0:188048:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109bdc5b 00000004:00100000:0.0:1788572299.236514:0:188048:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788572299.236723:0:188048:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f903000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572299.236801:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569487616:12345-192.168.202.57@tcp:38:mount.lustre.0 Request processed in 448us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.236810:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1022 00000100:00100000:0.0:1788572299.236830:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1023 00000100:00100000:0.0:1788572299.236835:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569487872:12345-192.168.202.57@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788572299.236859:0:188048:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9052 last 0 00000020:00000080:0.0:1788572299.236892:0:188048:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109bdc62 00000004:00100000:0.0:1788572299.236904:0:188048:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788572299.236957:0:188048:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f905000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572299.236982:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569487872:12345-192.168.202.57@tcp:38:mount.lustre.0 Request processed in 145us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.236989:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1023 00000100:00100000:0.0:1788572299.243346:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.243392:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572299.245601:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569487744 00000100:00100000:3.0:1788572299.245616:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569487744 00000100:00100000:2.0:1788572299.245986:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569488128 00000100:00100000:2.0:1788572299.245992:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569488128 00000100:00100000:2.0:1788572299.246018:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1024 00000100:00100000:2.0:1788572299.246026:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:0:x1875444569487744:12345-192.168.202.57@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788572299.246076:0:188833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1788572299.246165:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:0:x1875444569487744:12345-192.168.202.57@tcp:41:mount.lustre.0 Request processed in 139us (2831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572299.246173:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1024 00000100:00100000:2.0:1788572299.246191:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1025 00000100:00100000:2.0:1788572299.246197:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:160918:x1875444569488128:12345-192.168.202.57@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788572299.246219:0:188833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1788572299.246237:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:160918:x1875444569488128:12345-192.168.202.57@tcp:41:mount.lustre.0 Request processed in 40us (2846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572299.246244:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1025 00000100:00080000:0.0:1788572299.246649:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572299.246731:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.247017:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569488000 00000100:00100000:0.0:1788572299.247024:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569488000 00000100:00100000:0.0:1788572299.247081:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1026 00000100:00100000:0.0:1788572299.247089:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:0:x1875444569488000:12345-192.168.202.57@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788572299.247111:0:188833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1788572299.247165:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:0:x1875444569488000:12345-192.168.202.57@tcp:41:mount.lustre.0 Request processed in 76us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.247302:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1026 00000100:00080000:0.0:1788572299.247328:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572299.252609:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572299.252709:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569488256 00000100:00100000:2.0:1788572299.252718:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569488256 00000100:00100000:2.0:1788572299.252779:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1027 00000100:00100000:2.0:1788572299.252790:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:160918:x1875444569488256:12345-192.168.202.57@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788572299.252888:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:160918:x1875444569488256:12345-192.168.202.57@tcp:40:mount.lustre.0 Request processed in 99us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572299.252896:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1027 00000100:00100000:2.0:1788572299.258291:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572299.258342:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572299.258421:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572299.258585:0:188059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569488640 00000100:00100000:0.0:1788572299.258596:0:188059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569488640 00000100:00100000:0.0:1788572299.258652:0:188059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 3 00000100:00100000:0.0:1788572299.258663:0:188059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:160918:x1875444569488640:12345-192.168.202.57@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788572299.258741:0:188059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:160918:x1875444569488640:12345-192.168.202.57@tcp:900:mount.lustre.0 Request processed in 80us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572299.258749:0:188059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 3 00000100:00100000:2.0:1788572299.264113:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569488384 00000100:00100000:2.0:1788572299.264127:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569488384 00000100:00100000:2.0:1788572299.264168:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569488512 00000100:00100000:2.0:1788572299.264171:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569488512 00000100:00100000:2.0:1788572299.264190:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22636 00000100:00100000:2.0:1788572299.264197:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:0+-99:2396:x1875444569488384:12345-192.168.202.57@tcp:8:mount.lustre.0 00010000:00020000:2.0:1788572299.264226:0:177557:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572299.264290:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:0+-99:2396:x1875444569488384:12345-192.168.202.57@tcp:8:mount.lustre.0 Request processed in 94us (5948us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572299.264295:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22636 00000100:00100000:2.0:1788572299.264311:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22637 00000100:00100000:2.0:1788572299.264314:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:0+-99:2396:x1875444569488512:12345-192.168.202.57@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788572299.264329:0:177557:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9052 last 0 00000020:00000080:2.0:1788572299.264360:0:177557:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109bdc69 00002000:00100000:2.0:1788572299.264371:0:177557:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e590bb61000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788572299.264379:0:177557:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788572299.264445:0:177557:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788572299.264466:0:177557:0:(import.c:65:import_set_state_nolock()) ffff8e590bb67800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572299.264506:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569488512:12345-192.168.202.57@tcp:8:mount.lustre.0 Request processed in 190us (6086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572299.264511:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22637 00000100:00100000:0.0:1788572299.270982:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572299.271286:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569488768 00000100:00100000:1.0:1788572299.271298:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569488768 00000100:00100000:1.0:1788572299.272916:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 3 00000100:00100000:1.0:1788572299.272940:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:160918:x1875444569488768:12345-192.168.202.57@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788572299.275604:0:188051:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2569us 00000004:00200000:2.0:1788572299.307204:0:188051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000100:00100000:2.0:1788572299.307334:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:160918:x1875444569488768:12345-192.168.202.57@tcp:33:mount.lustre.0 Request processed in 34399us (36356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572299.307344:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 3 00010000:00010000:0.0:1788572299.773332:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572300.803187:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572301.694340:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572301.694365:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584327680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572301.694438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572301.695538:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584327808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572301.695583:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572301.695764:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584327680 00000100:00100000:2.0:1788572301.695773:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584327680 00000100:00100000:2.0:1788572301.695826:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584327808 00000100:00100000:2.0:1788572301.695829:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584327808 00000100:00100000:2.0:1788572301.695845:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788572301.695854:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584327680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572301.695888:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446064128 avail 1299824640 00000100:00100000:2.0:1788572301.695948:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584327680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572301.695955:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788572301.695972:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788572301.695979:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584327808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572301.695996:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1788572301.696029:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584327808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572301.696035:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788572301.696128:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584327808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572301.696166:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584327680:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788572301.705263:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572301.705270:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572301.705273:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572301.705282:0:186041:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9049 00000100:00080000:2.0:1788572301.705287:0:186041:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572301.705295:0:186041:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572301.705320:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36efa680 x1875444584328320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572301.705347:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572301.705350:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572301.705352:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572301.705356:0:186041:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 9049 00000100:00080000:2.0:1788572301.705360:0:186041:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572301.705363:0:186041:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e59059d6800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572301.705377:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffab100 x1875444584328704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572301.705422:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584328064:0@lo:400:kworker.0 00000100:00100000:2.0:1788572301.705521:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572301.705558:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584328832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572301.705583:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572301.705608:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788572301.705614:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584328192:0@lo:400:kworker.0 00000100:00100000:2.0:1788572301.705636:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572301.705651:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584328960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572301.705678:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572301.705707:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584328064 00000100:00100000:2.0:1788572301.705716:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584328064 00000100:00100000:2.0:1788572301.705769:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584328192 00000100:00100000:2.0:1788572301.705773:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584328192 00000100:00100000:2.0:1788572301.705789:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584328960 00000100:00100000:2.0:1788572301.705791:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584328960 00000100:00100000:2.0:1788572301.705808:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788572301.705816:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584328064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572301.705868:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584328064:12345-0@lo:400:kworker.0 Request processed in 53us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572301.705875:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788572301.705892:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788572301.705898:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584328192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572301.705940:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584328192:12345-0@lo:400:kworker.0 Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572301.705946:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788572301.705957:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788572301.705962:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584328960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572301.705986:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584328960:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572301.705992:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1788572301.706012:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572301.706016:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572301.706046:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584328192:0@lo:400:kworker.0 00010000:00080000:2.0:1788572301.706056:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5a40f30380 x1875444584328960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572301.706066:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584328960:0@lo:400:kworker.0 00010000:00080000:2.0:1788572301.706076:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5a36ef9880 x1875444584328064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572301.706083:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584328064:0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.706230:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584328320:0@lo:8:kworker.0 00000100:00100000:3.0:1788572301.706264:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572301.706288:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584328704:0@lo:8:kworker.0 00000100:00100000:3.0:1788572301.706309:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572301.706340:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584328832 00000100:00100000:3.0:1788572301.706344:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584328832 00000100:00100000:3.0:1788572301.706377:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584328320 00000100:00100000:3.0:1788572301.706380:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584328320 00000100:00100000:3.0:1788572301.706393:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584328704 00000100:00100000:3.0:1788572301.706396:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584328704 00000100:00100000:3.0:1788572301.706412:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7694 00000100:00100000:3.0:1788572301.706418:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584328832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.706451:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584328832:12345-0@lo:400:kworker.0 Request processed in 33us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572301.706458:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7694 00000100:00100000:3.0:1788572301.706472:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22638 00000100:00100000:3.0:1788572301.706476:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3640:x1875444584328320:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788572301.706512:0:177558:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572301.706544:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3640:x1875444584328320:12345-0@lo:8:kworker.0 Request processed in 66us (279us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572301.706550:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22638 00000100:00100000:3.0:1788572301.706562:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22639 00000100:00100000:3.0:1788572301.706565:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3640:x1875444584328704:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788572301.706575:0:177558:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572301.706598:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3640:x1875444584328704:12345-0@lo:8:kworker.0 Request processed in 31us (289us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572301.706603:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22639 00000100:00080000:3.0:1788572301.706635:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572301.706652:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572301.706657:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572301.706661:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584328320:0@lo:8:kworker.0 00000100:00080000:3.0:1788572301.706669:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572301.706672:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572301.706674:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584328704:0@lo:8:kworker.0 00000100:00100000:3.0:1788572301.706695:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584328448:0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.706719:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572301.706742:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572301.706749:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584327936:0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.706774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572301.706798:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584328576:0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.706822:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572301.706848:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584328448 00000100:00100000:3.0:1788572301.706851:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584328448 00000100:00100000:3.0:1788572301.706880:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7695 00000100:00100000:3.0:1788572301.706887:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584328448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.706932:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584328448:12345-0@lo:400:kworker.0 Request processed in 46us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572301.706938:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7695 00000100:00080000:3.0:1788572301.706955:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572301.706971:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584328448:0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.706986:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584328576 00000100:00100000:3.0:1788572301.706989:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584328576 00000100:00100000:3.0:1788572301.707012:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788572301.707018:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584328576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.707048:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584328576:12345-0@lo:400:kworker.0 Request processed in 30us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572301.707054:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00080000:3.0:1788572301.707080:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5a36efaa00 x1875444584328576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572301.707090:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584328576:0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.708247:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584327936 00000100:00100000:3.0:1788572301.708256:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584327936 00000100:00100000:3.0:1788572301.708293:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788572301.708301:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3643:x1875444584327936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572301.708353:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3643:x1875444584327936:12345-0@lo:400:kworker.0 Request processed in 53us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572301.708360:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788572301.708398:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584327936:0@lo:400:kworker.0 00000100:00100000:2.0:1788572301.708684:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584328832:0@lo:400:kworker.0 00010000:00010000:2.0:1788572301.820708:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572302.210171:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584329088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572302.210256:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572302.210465:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584329088 00000100:00100000:3.0:1788572302.210474:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584329088 00000100:00100000:3.0:1788572302.210556:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6295 00000100:00100000:3.0:1788572302.210566:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584329088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572302.210598:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572302.210646:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584329088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572302.210654:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6295 00000100:00100000:0.0:1788572302.211571:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584329088:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788572302.730969:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:3.0:1788572302.730990:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975676 is committed 00010000:00010000:0.0:1788572302.849990:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572303.868877:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572304.253514:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584329216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572304.253716:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572304.257066:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584329216 00000100:00100000:2.0:1788572304.257081:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584329216 00000100:00100000:2.0:1788572304.257144:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6296 00000100:00100000:2.0:1788572304.257154:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584329216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572304.257186:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00080000:3.0:1788572304.257576:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572304.258862:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584329216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1704us (5141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572304.258874:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6296 00000100:00100000:0.0:1788572304.259084:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584329216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572304.755336:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572304.755385:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572304.755639:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569489024 00000100:00100000:0.0:1788572304.755648:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569489024 00000100:00100000:3.0:1788572304.759081:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569488896 00000100:00100000:3.0:1788572304.759094:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569488896 00000100:00100000:3.0:1788572304.759159:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 68 00000100:00100000:3.0:1788572304.759168:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569488896:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572304.759249:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569488896:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 82us (3922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572304.759260:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 68 00000100:00100000:0.0:1788572304.759556:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 267 00000100:00100000:0.0:1788572304.759566:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569489024:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572304.759611:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569489024:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 47us (4226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572304.759618:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 267 00000100:00080000:1.0:1788572304.760331:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788572304.771674:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00100000:2.0:1788572304.779849:0:194073:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000100:00100000:2.0:1788572304.781085:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572304.781127:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572304.781159:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572304.781449:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569489280 00000100:00100000:2.0:1788572304.781460:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569489280 00000100:00100000:2.0:1788572304.781678:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569489408 00000100:00100000:2.0:1788572304.781682:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569489408 00000100:00100000:2.0:1788572304.781720:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7696 00000100:00100000:2.0:1788572304.781728:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569489408:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572304.782077:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569489408:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 348us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572304.782085:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7696 00000100:00100000:2.0:1788572304.782102:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22640 00000100:00100000:2.0:1788572304.782106:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2396:x1875444569489280:12345-192.168.202.57@tcp:8:kworker.0 00010000:00020000:2.0:1788572304.782126:0:43922:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572304.782220:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569489152 00000100:00100000:3.0:1788572304.782225:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569489152 00000100:00100000:3.0:1788572304.782273:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 268 00000100:00100000:3.0:1788572304.782281:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569489152:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572304.782315:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569489152:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 36us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572304.782321:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 268 00000100:00080000:3.0:1788572304.787570:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572304.787580:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572304.832314:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2396:x1875444569489280:12345-192.168.202.57@tcp:8:kworker.0 Request processed in 50193us (51172us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572304.832331:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22640 00010000:00010000:2.0:1788572304.893709:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788572305.918380:0:194756:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788572305.918384:0:194756:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788572305.918385:0:194756:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788572305.918517:0:194756:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e5a0a158000 00000020:01000004:1.0:1788572305.918534:0:194756:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788572305.918549:0:194756:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788572305.918576:0:194756:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e5a37204d40) 00000020:00000080:1.0:1788572305.918594:0:194756:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788572305.919194:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788572306.043361:0:194756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788572306.047075:0:194756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788572306.048311:0:194756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788572306.048955:0:194756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788572306.049796:0:194756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788572306.050083:0:194756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788572306.050289:0:194756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1788572306.054079:0:194756:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788572306.054300:0:194756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788572306.054315:0:194756:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788572306.054327:0:194756:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x265cfe11109bdc77 00000020:01000004:1.0:1788572306.054333:0:194756:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788572306.054358:0:194756:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.157@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788572306.054363:0:194756:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788572306.054369:0:194756:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788572306.054399:0:194756:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788572306.054403:0:194756:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.157@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788572306.092023:0:194756:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.157@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788572306.092085:0:194756:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.157@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788572306.092090:0:194756:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788572306.092092:0:194756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572306.092093:0:194756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572306.092094:0:194756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572306.092095:0:194756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572306.092096:0:194756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572306.092098:0:194756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572306.092099:0:194756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572306.092101:0:194756:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788572306.092104:0:194756:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788572306.092106:0:194756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572306.092108:0:194756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572306.092109:0:194756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572306.092110:0:194756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572306.092111:0:194756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572306.092112:0:194756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572306.092113:0:194756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572306.092114:0:194756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572306.092115:0:194756:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788572306.092143:0:194756:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788572306.092163:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329344:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572306.092236:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.092419:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905274900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572306.094244:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584329344 00000100:00100000:3.0:1788572306.094257:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584329344 00000100:00100000:3.0:1788572306.094313:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788572306.094323:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:194756:x1875444584329344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788572306.094375:0:194084:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788572306.094379:0:194084:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788572306.094382:0:194084:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788572306.094386:0:194084:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788572306.103233:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:194756:x1875444584329344:12345-0@lo:253:mount.lustre.0 Request processed in 8901us (10986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.103250:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788572306.103375:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572306.103391:0:194756:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788572306.103394:0:194756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572306.103396:0:194756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572306.103397:0:194756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572306.103398:0:194756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572306.103400:0:194756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572306.103401:0:194756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572306.103403:0:194756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572306.103405:0:194756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572306.103406:0:194756:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788572306.103431:0:194756:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a0a158000 from lustre-OST0000 10000000:01000000:0.0:1788572306.103465:0:194756:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788572306.103469:0:194756:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788572306.103497:0:194756:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e5a0efbb380 local copy 00010000:00010000:0.0:1788572306.103508:0:194756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572306.103637:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572306.103897:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.103937:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905274c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572306.104000:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584329472 00000100:00100000:3.0:1788572306.104006:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584329472 00000100:00100000:3.0:1788572306.104134:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788572306.104145:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:194756:x1875444584329472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572306.104238:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:194756:x1875444584329472:12345-0@lo:501:mount.lustre.0 Request processed in 95us (341us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572306.104246:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788572306.104309:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329472:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788572306.104323:0:194756:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788572306.104341:0:194756:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788572306.104348:0:194756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.104357:0:194756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572306.104388:0:194756:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5a0a158000 10000000:01000000:0.0:1788572306.104393:0:194756:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788572306.104398:0:194756:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788572306.104400:0:194756:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572306.104404:0:194756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788572306.104407:0:194756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788572306.104429:0:194756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.104436:0:194756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.104446:0:194756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572306.104461:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572306.104524:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.116963:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584329600 00000100:00100000:1.0:1788572306.116979:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584329600 00000100:00100000:1.0:1788572306.117066:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788572306.117077:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:194756:x1875444584329600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572306.117095:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572306.117116:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd3000/0x265cfe11109bdc85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdc7e expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.117143:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd3000/0x265cfe11109bdc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdc7e expref: 22 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.117154:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd3000/0x265cfe11109bdc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdc7e expref: 22 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.117164:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3000, rc 0) 00000100:00100000:1.0:1788572306.117233:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584329600:12345-0@lo:101:mount.lustre.0 Request processed in 158us (12707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.117240:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788572306.117317:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905274c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572306.117343:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572306.117361:0:194756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdc85 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.117371:0:194756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdc85 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572306.121525:0:194756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 14 count 14 00000040:00080000:1.0:1788572306.122410:0:194756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572306.125051:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].1, 224 off8416 00000040:00080000:1.0:1788572306.125112:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].2, 128 off8544 00000040:00080000:1.0:1788572306.125127:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].3, 112 off8656 00000040:00080000:1.0:1788572306.125140:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].4, 224 off8880 00000040:00080000:1.0:1788572306.125152:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].5, 224 off9104 00000040:00080000:1.0:1788572306.125165:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].6, 80 off9184 00000040:00080000:1.0:1788572306.125178:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].7, 224 off9408 00000040:00080000:1.0:1788572306.125190:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].8, 224 off9632 00000040:00080000:1.0:1788572306.125205:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].9, 80 off9712 00000040:00080000:1.0:1788572306.125219:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].10, 224 off9936 00000040:00080000:1.0:1788572306.125234:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].11, 224 off10160 00000040:00080000:1.0:1788572306.125247:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].12, 120 off10280 00000040:00080000:1.0:1788572306.125270:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].13, 224 off10504 00000040:00080000:1.0:1788572306.125276:0:194756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 13 count 14 00000100:00100000:1.0:1788572306.125388:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572306.125460:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.125945:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572306.126074:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584329728 00000100:00100000:2.0:1788572306.126083:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584329728 00000100:00100000:2.0:1788572306.126202:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788572306.126212:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584329728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572306.126377:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584329728:12345-0@lo:501:mount.lustre.0 Request processed in 166us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.126384:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788572306.126456:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572306.126519:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572306.126577:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.134194:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572306.134273:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584329856 00000100:00100000:3.0:1788572306.134283:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584329856 00000100:00100000:3.0:1788572306.134355:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788572306.134367:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584329856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572306.139543:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584329856:12345-0@lo:503:mount.lustre.0 Request processed in 5170us (12956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.139558:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788572306.139806:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329856:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788572306.140277:0:194756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788572306.140362:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572306.140421:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.140466:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572306.140512:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584329984 00000100:00100000:1.0:1788572306.140518:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584329984 00000100:00100000:1.0:1788572306.140552:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788572306.140561:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584329984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572306.141156:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584329984:12345-0@lo:502:mount.lustre.0 Request processed in 592us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.141164:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788572306.141223:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584329984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572306.141400:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].1, 224 off8416 00000040:00080000:1.0:1788572306.141429:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].2, 128 off8544 00000040:00080000:1.0:1788572306.141443:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].3, 112 off8656 00000040:00080000:1.0:1788572306.141458:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].4, 224 off8880 00000040:00080000:1.0:1788572306.141472:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].5, 224 off9104 00000040:00080000:1.0:1788572306.141520:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].6, 80 off9184 00000040:00080000:1.0:1788572306.141537:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].7, 224 off9408 00000040:00080000:1.0:1788572306.141552:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].8, 224 off9632 00000040:00080000:1.0:1788572306.141566:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].9, 80 off9712 00000040:00080000:1.0:1788572306.141580:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].10, 224 off9936 00000040:00080000:1.0:1788572306.141615:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].11, 224 off10160 00000040:00080000:1.0:1788572306.141635:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].12, 120 off10280 00000100:00100000:1.0:1788572306.146062:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572306.146159:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.146210:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572306.146604:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584330112 00000100:00100000:2.0:1788572306.146614:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584330112 00000100:00100000:2.0:1788572306.146673:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788572306.146682:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584330112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572306.146834:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584330112:12345-0@lo:502:mount.lustre.0 Request processed in 153us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.146842:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788572306.147343:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572306.147435:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].13, 224 off10504 00000040:00080000:1.0:1788572306.147451:0:194756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788572306.162877:0:194760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788572306.162890:0:194760:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788572306.162897:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572306.162900:0:194760:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788572306.162908:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788572306.162924:0:194760:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e5a4014b380) 00000020:00000080:2.0:1788572306.162951:0:194760:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788572306.162956:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788572306.163024:0:194760:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a0a158000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788572306.163042:0:194760:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788572306.163049:0:194760:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x265cfe11109bdc93 00010000:00010000:2.0:1788572306.170460:0:194760:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:2.0:1788572306.171465:0:194760:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 34359738466 srv lr: 34359738473 lx: 1875444583695232 gen 0 00000001:00080000:2.0:1788572306.171532:0:194760:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 34359738473 srv lr: 34359738473 lx: 1875444584298240 gen 0 00000001:00000004:2.0:1788572306.171549:0:194760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 34359738473 00080000:10000000:2.0:1788572306.181543:0:194760:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x11:0x0] (8/32) registered 00000020:00000080:3.0:1788572306.185338:0:194760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788572306.185350:0:194760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572306.185357:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572306.185359:0:194760:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788572306.185362:0:194760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572306.185366:0:194760:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788572306.185368:0:194760:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572306.185370:0:194760:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572306.185371:0:194760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572306.185374:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572306.185375:0:194760:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572306.185377:0:194760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572306.185380:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572306.185382:0:194760:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788572306.185385:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788572306.185386:0:194760:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788572306.185388:0:194760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572306.185390:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572306.185391:0:194760:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788572306.185394:0:194760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572306.185396:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572306.185398:0:194760:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788572306.185401:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788572306.185431:0:194760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572306.185434:0:194760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572306.185435:0:194760:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788572306.185439:0:194760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x30:0x0] index 14 count 14 00000020:01000000:1.0:1788572306.187815:0:194756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788572306.187871:0:194756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788572306.187891:0:194756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdc85 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.187905:0:194756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdc85 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572306.187914:0:194756:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a0a158000 from 1 10000000:01000000:1.0:1788572306.187916:0:194756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572306.187952:0:194756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.187960:0:194756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.187971:0:194756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572306.187995:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572306.188072:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572306.188108:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584330240 00000100:00100000:1.0:1788572306.188111:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572306.188115:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584330240 00000100:00100000:2.0:1788572306.188172:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788572306.188182:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:194756:x1875444584330240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572306.188195:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572306.188207:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254000/0x265cfe11109bdcaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdca8 expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.188231:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254000/0x265cfe11109bdcaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdca8 expref: 23 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.188241:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254000/0x265cfe11109bdcaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdca8 expref: 23 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.188250:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254000, rc 0) 00000100:00100000:2.0:1788572306.188293:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330240:12345-0@lo:101:mount.lustre.0 Request processed in 113us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.188299:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788572306.188345:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572306.188359:0:194756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcaf expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.188369:0:194756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdcaf expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572306.190203:0:194756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 7 count 7 00000040:00080000:2.0:1788572306.191078:0:194756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572306.191289:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].1, 224 off8416 00000040:00080000:2.0:1788572306.191318:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].2, 112 off8528 00000040:00080000:2.0:1788572306.191335:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].3, 224 off8752 00000040:00080000:2.0:1788572306.191350:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].4, 224 off8976 00000040:00080000:2.0:1788572306.191362:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].5, 112 off9088 00000040:00080000:2.0:1788572306.191379:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].6, 224 off9312 00000040:00080000:2.0:1788572306.191384:0:194756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 6 count 7 00000100:00100000:2.0:1788572306.192184:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572306.192258:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572306.192305:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59064e3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572306.193002:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584330368 00000100:00100000:3.0:1788572306.193011:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584330368 00000100:00100000:3.0:1788572306.193071:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788572306.193080:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572306.193241:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330368:12345-0@lo:501:mount.lustre.0 Request processed in 161us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.193249:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788572306.193303:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572306.193346:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572306.193387:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.193415:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f0f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572306.193430:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584330496 00000100:00100000:3.0:1788572306.193434:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584330496 00000100:00100000:3.0:1788572306.193460:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788572306.193466:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572306.193568:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330496:12345-0@lo:503:mount.lustre.0 Request processed in 102us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.193575:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788572306.193629:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330496:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788572306.194075:0:194756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788572306.194131:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572306.194165:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.194183:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d30300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572306.194197:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584330624 00000100:00100000:3.0:1788572306.194201:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584330624 00000100:00100000:3.0:1788572306.194221:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788572306.194227:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572306.194292:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330624:12345-0@lo:502:mount.lustre.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.194298:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788572306.194333:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572306.194535:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].1, 224 off8416 00000040:00080000:3.0:1788572306.194561:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].2, 112 off8528 00000040:00080000:3.0:1788572306.194576:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].3, 224 off8752 00000040:00080000:3.0:1788572306.194588:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].4, 224 off8976 00000040:00080000:3.0:1788572306.194600:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].5, 112 off9088 00000100:00100000:3.0:1788572306.194618:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572306.200299:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.200366:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d30300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572306.200398:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584330752 00000100:00100000:3.0:1788572306.200407:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584330752 00000100:00100000:3.0:1788572306.200453:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788572306.200461:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572306.200616:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330752:12345-0@lo:502:mount.lustre.0 Request processed in 155us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.200624:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788572306.201004:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572306.201110:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].6, 224 off9312 00000040:00080000:3.0:1788572306.201126:0:194756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1788572306.201606:0:194764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572306.201629:0:194764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572306.201631:0:194764:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788572306.201638:0:194764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a0a158000 00000020:00000080:3.0:1788572306.201640:0:194764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788572306.205516:0:194764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572306.205541:0:194764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572306.205543:0:194764:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788572306.205547:0:194764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572306.205552:0:194764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572306.205553:0:194764:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788572306.205558:0:194764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a0a158000 00000020:00000080:3.0:1788572306.205561:0:194764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788572306.208077:0:194764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572306.208089:0:194764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572306.208091:0:194764:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788572306.208097:0:194764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x32:0x0] index 7 count 7 00000020:01000000:2.0:1788572306.210024:0:194756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788572306.210085:0:194756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572306.210107:0:194756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcaf expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.210121:0:194756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcaf expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572306.210190:0:194756:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788572306.210193:0:194756:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5a0a158000 10000000:01000000:2.0:1788572306.210196:0:194756:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5a0a158000 10000000:01000000:2.0:1788572306.210200:0:194756:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788572306.210207:0:194756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a0a158000 from 1 10000000:01000000:2.0:1788572306.210210:0:194756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788572306.210251:0:194756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.210260:0:194756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.210272:0:194756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572306.210299:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572306.210374:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572306.210417:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59064e30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572306.210455:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584330880 00000100:00100000:2.0:1788572306.210463:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584330880 00000100:00100000:2.0:1788572306.210542:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788572306.210551:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:194756:x1875444584330880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572306.210564:0:194079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572306.210578:0:194079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a00030200/0x265cfe11109bdcbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdcb6 expref: -99 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.211865:0:194079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a00030200/0x265cfe11109bdcbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdcb6 expref: 24 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.212711:0:194079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a00030200/0x265cfe11109bdcbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdcb6 expref: 24 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.212723:0:194079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00030200, rc 0) 00000100:00100000:2.0:1788572306.212813:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584330880:12345-0@lo:101:mount.lustre.0 Request processed in 2262us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.212820:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788572306.213280:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584330880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572306.213302:0:194756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcbd expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.213313:0:194756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdcbd expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572306.217185:0:194756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 52 count 51 00000040:00080000:0.0:1788572306.217555:0:194756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572306.220143:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].1, 224 off8416 00000040:00080000:0.0:1788572306.220795:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].2, 120 off8536 00000040:00080000:0.0:1788572306.220817:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].3, 168 off8704 00000040:00080000:0.0:1788572306.220830:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].4, 224 off8928 00000040:00080000:0.0:1788572306.220841:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].5, 224 off9152 00000040:00080000:0.0:1788572306.220852:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].6, 120 off9272 00000040:00080000:0.0:1788572306.220863:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].7, 168 off9440 00000040:00080000:0.0:1788572306.221132:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].8, 224 off9664 00000040:00080000:0.0:1788572306.221158:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].9, 224 off9888 00000040:00080000:0.0:1788572306.221170:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].10, 120 off10008 00000040:00080000:0.0:1788572306.221183:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].11, 224 off10232 00000040:00080000:0.0:1788572306.221195:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].12, 224 off10456 00000040:00080000:0.0:1788572306.221208:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].13, 88 off10544 00000040:00080000:0.0:1788572306.221221:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].14, 128 off10672 00000040:00080000:0.0:1788572306.221235:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].15, 144 off10816 00000040:00080000:0.0:1788572306.221247:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].16, 160 off10976 00000040:00080000:0.0:1788572306.221259:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].17, 224 off11200 00000040:00080000:0.0:1788572306.221271:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].18, 224 off11424 00000040:00080000:0.0:1788572306.221283:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].19, 80 off11504 00000040:00080000:0.0:1788572306.221296:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].20, 224 off11728 00000040:00080000:0.0:1788572306.221309:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].21, 224 off11952 00000040:00080000:0.0:1788572306.221320:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].22, 88 off12040 00000040:00080000:0.0:1788572306.221332:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].23, 128 off12168 00000040:00080000:0.0:1788572306.221346:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].24, 144 off12312 00000040:00080000:0.0:1788572306.221358:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].25, 160 off12472 00000040:00080000:0.0:1788572306.221370:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].26, 224 off12696 00000040:00080000:0.0:1788572306.221384:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].27, 224 off12920 00000040:00080000:0.0:1788572306.221400:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].28, 80 off13000 00000040:00080000:0.0:1788572306.221413:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].29, 224 off13224 00000040:00080000:0.0:1788572306.221978:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].30, 224 off13448 00000040:00080000:0.0:1788572306.222005:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].31, 88 off13536 00000040:00080000:0.0:1788572306.222019:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].32, 128 off13664 00000040:00080000:0.0:1788572306.222043:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].33, 144 off13808 00000040:00080000:0.0:1788572306.222067:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].34, 128 off13936 00000040:00080000:0.0:1788572306.222083:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].35, 224 off14160 00000040:00080000:0.0:1788572306.222095:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].36, 224 off14384 00000040:00080000:0.0:1788572306.222107:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].37, 80 off14464 00000040:00080000:0.0:1788572306.222121:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].38, 224 off14688 00000040:00080000:0.0:1788572306.222134:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].39, 224 off14912 00000040:00080000:0.0:1788572306.222148:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].40, 88 off15000 00000040:00080000:0.0:1788572306.222162:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].41, 128 off15128 00000040:00080000:0.0:1788572306.222178:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].42, 144 off15272 00000040:00080000:0.0:1788572306.222191:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].43, 128 off15400 00000040:00080000:0.0:1788572306.222205:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].44, 224 off15624 00000040:00080000:0.0:1788572306.222219:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].45, 224 off15848 00000040:00080000:0.0:1788572306.222232:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].46, 80 off15928 00000040:00080000:0.0:1788572306.222245:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].47, 224 off16152 00000040:00080000:0.0:1788572306.222259:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].48, 232 off16384 00000040:00080000:0.0:1788572306.222403:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].49, 224 off16608 00000040:00080000:0.0:1788572306.225071:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].50, 120 off16728 00000040:00080000:0.0:1788572306.225138:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].51, 224 off16952 00000040:00080000:0.0:1788572306.225145:0:194756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 51 count 51 00000100:00100000:0.0:1788572306.225264:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572306.225337:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.228057:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a2d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572306.229999:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584331008 00000100:00100000:1.0:1788572306.230012:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584331008 00000100:00100000:1.0:1788572306.230083:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788572306.230092:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572306.230262:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331008:12345-0@lo:501:mount.lustre.0 Request processed in 170us (4925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.230270:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788572306.230382:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572306.230456:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572306.230537:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.230569:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a2d6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572306.239898:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584331136 00000100:00100000:2.0:1788572306.239914:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584331136 00000100:00100000:2.0:1788572306.239987:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788572306.239998:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572306.240178:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331136:12345-0@lo:503:mount.lustre.0 Request processed in 182us (9640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.240187:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788572306.240367:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788572306.240855:0:194756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572306.240947:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572306.241002:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.241051:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a2d6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572306.241094:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584331264 00000100:00100000:2.0:1788572306.241099:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584331264 00000100:00100000:2.0:1788572306.241139:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788572306.241147:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572306.241238:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331264:12345-0@lo:502:mount.lustre.0 Request processed in 92us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.241245:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788572306.245161:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572306.245418:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].1, 224 off8416 00000040:00080000:0.0:1788572306.245453:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].2, 120 off8536 00000040:00080000:0.0:1788572306.245472:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].3, 168 off8704 00000040:00080000:0.0:1788572306.245506:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].4, 224 off8928 00000040:00080000:0.0:1788572306.245522:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].5, 224 off9152 00000040:00080000:0.0:1788572306.245533:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].6, 120 off9272 00000040:00080000:0.0:1788572306.245547:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].7, 168 off9440 00000040:00080000:0.0:1788572306.245559:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].8, 224 off9664 00000040:00080000:0.0:1788572306.245571:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].9, 224 off9888 00000040:00080000:0.0:1788572306.245585:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].10, 120 off10008 00000040:00080000:0.0:1788572306.245598:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].11, 224 off10232 00000040:00080000:0.0:1788572306.245611:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].12, 224 off10456 00000040:00080000:0.0:1788572306.245625:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].13, 88 off10544 00000040:00080000:0.0:1788572306.245637:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].14, 128 off10672 00000040:00080000:0.0:1788572306.245650:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].15, 144 off10816 00000040:00080000:0.0:1788572306.245664:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].16, 160 off10976 00000040:00080000:0.0:1788572306.245678:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].17, 224 off11200 00000040:00080000:0.0:1788572306.245693:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].18, 224 off11424 00000040:00080000:0.0:1788572306.245706:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].19, 80 off11504 00000040:00080000:0.0:1788572306.245720:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].20, 224 off11728 00000040:00080000:0.0:1788572306.245733:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].21, 224 off11952 00000040:00080000:0.0:1788572306.245746:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].22, 88 off12040 00000040:00080000:0.0:1788572306.245761:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].23, 128 off12168 00000040:00080000:0.0:1788572306.245774:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].24, 144 off12312 00000040:00080000:0.0:1788572306.245785:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].25, 160 off12472 00000040:00080000:0.0:1788572306.245798:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].26, 224 off12696 00000040:00080000:0.0:1788572306.245812:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].27, 224 off12920 00000040:00080000:0.0:1788572306.245826:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].28, 80 off13000 00000040:00080000:0.0:1788572306.245840:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].29, 224 off13224 00000040:00080000:0.0:1788572306.245854:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].30, 224 off13448 00000040:00080000:0.0:1788572306.245868:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].31, 88 off13536 00000040:00080000:0.0:1788572306.245881:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].32, 128 off13664 00000040:00080000:0.0:1788572306.245894:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].33, 144 off13808 00000040:00080000:0.0:1788572306.245908:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].34, 128 off13936 00000040:00080000:0.0:1788572306.245921:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].35, 224 off14160 00000040:00080000:0.0:1788572306.245935:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].36, 224 off14384 00000040:00080000:0.0:1788572306.245950:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].37, 80 off14464 00000040:00080000:0.0:1788572306.245966:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].38, 224 off14688 00000040:00080000:0.0:1788572306.245980:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].39, 224 off14912 00000040:00080000:0.0:1788572306.245993:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].40, 88 off15000 00000040:00080000:0.0:1788572306.246006:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].41, 128 off15128 00000040:00080000:0.0:1788572306.246020:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].42, 144 off15272 00000040:00080000:0.0:1788572306.246049:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].43, 128 off15400 00000040:00080000:0.0:1788572306.246066:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].44, 224 off15624 00000040:00080000:0.0:1788572306.246079:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].45, 224 off15848 00000040:00080000:0.0:1788572306.246090:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].46, 80 off15928 00000040:00080000:0.0:1788572306.246102:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].47, 224 off16152 00000040:00080000:0.0:1788572306.246116:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].48, 232 off16384 00000100:00100000:0.0:1788572306.246165:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572306.246242:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.246294:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a2d6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572306.247238:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584331392 00000100:00100000:3.0:1788572306.247248:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584331392 00000100:00100000:3.0:1788572306.247307:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788572306.247318:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572306.247503:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331392:12345-0@lo:502:mount.lustre.0 Request processed in 187us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572306.247506:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572306.247510:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000040:00080000:0.0:1788572306.248091:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].49, 224 off16608 00000040:00080000:0.0:1788572306.248125:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].50, 120 off16728 00000100:00100000:0.0:1788572306.248154:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572306.248194:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.248233:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a2d6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572306.252373:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584331520 00000100:00100000:2.0:1788572306.252390:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584331520 00000100:00100000:2.0:1788572306.252464:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788572306.252475:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572306.252891:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584331520:12345-0@lo:502:mount.lustre.0 Request processed in 417us (4694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.252900:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788572306.252948:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584331520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572306.253047:0:194756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].51, 224 off16952 00000040:00080000:3.0:1788572306.253061:0:194756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788572306.264113:0:194767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788572306.264131:0:194767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e5a37200000) 00000020:00000080:1.0:1788572306.264157:0:194767:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788572306.264231:0:194767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a0a158000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788572306.264235:0:194767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a0a158000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788572306.264237:0:194767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a0a158000 3 00010000:00080000:1.0:1788572306.264283:0:194767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e590cc70000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.157@tcp at head 00010000:00010000:0.0:1788572306.271370:0:194767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:0.0:1788572306.271626:0:194767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788572306.271682:0:194767:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788572306.271695:0:194767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x265cfe11109bdccb 00000100:00080000:0.0:1788572306.271706:0:194767:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572306.271712:0:194767:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572306.271750:0:194767:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffa5180 x1875444584331648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572306.271774:0:194767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788572306.272074:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572306.272078:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572306.272081:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572306.272086:0:177620:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 9054 00000100:00080000:2.0:1788572306.272090:0:177620:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788572306.272095:0:177620:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572306.272109:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f32300 x1875444584332160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572306.272133:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572306.272136:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572306.272138:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572306.272141:0:177620:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 9054 00000100:00080000:2.0:1788572306.272144:0:177620:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788572306.272147:0:177620:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e59059d6800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572306.272157:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f30000 x1875444584332672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572306.272199:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584331648:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788572306.272199:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584331904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572306.276020:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.276092:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584332160:0@lo:8:kworker.0 00000100:00100000:1.0:1788572306.276132:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.276149:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584332672:0@lo:8:kworker.0 00000100:00100000:1.0:1788572306.276172:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.276213:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584331648 00000100:00100000:1.0:1788572306.276219:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584331648 00000100:00100000:1.0:1788572306.276253:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1788572306.276259:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584331648:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788572306.276288:0:188049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 9059 last 0 00000020:00000080:1.0:1788572306.276325:0:188049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x265cfe11109bdcd2 00000004:00100000:1.0:1788572306.276340:0:188049:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572306.276371:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572306.276417:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875444584331648:12345-0@lo:38:llog_process_th.0 Request processed in 157us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.276425:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1788572306.276446:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584332160 00000100:00100000:1.0:1788572306.276449:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584332160 00000100:00100000:1.0:1788572306.276463:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584332672 00000100:00100000:1.0:1788572306.276465:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584332672 00000100:00100000:1.0:1788572306.276504:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22641 00000100:00100000:1.0:1788572306.276509:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3640:x1875444584332160:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788572306.276542:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3640:x1875444584332160:12345-0@lo:8:kworker.0 Request processed in 32us (409us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788572306.276548:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22641 00000100:00100000:1.0:1788572306.276558:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22642 00000100:00100000:1.0:1788572306.276561:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3640:x1875444584332672:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788572306.276584:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3640:x1875444584332672:12345-0@lo:8:kworker.0 Request processed in 21us (412us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788572306.276590:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22642 00010000:00080000:1.0:1788572306.276636:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5a1ffa5180 x1875444584331648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572306.277278:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584331776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572306.277318:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.277453:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584332416:0@lo:400:kworker.0 00000100:00100000:0.0:1788572306.277496:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.278267:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572306.278280:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 80 00000100:00080000:1.0:1788572306.278290:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788572306.278295:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788572306.278298:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572306.278307:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584331648:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788572306.278333:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572306.278338:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788572306.278341:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584332160:0@lo:8:kworker.0 00000100:00100000:1.0:1788572306.278351:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572306.278354:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572306.278356:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788572306.278359:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584332672:0@lo:8:kworker.0 00000100:00100000:3.0:1788572306.278537:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584331776 00000100:00100000:3.0:1788572306.278543:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584331776 00000100:00100000:3.0:1788572306.278594:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584332416 00000100:00100000:3.0:1788572306.278597:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584332416 00000100:00100000:3.0:1788572306.278630:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788572306.278639:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584331776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.278724:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584331776:12345-0@lo:400:kworker.0 Request processed in 86us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.278731:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788572306.278810:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788572306.278817:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584332416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.278849:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584332416:12345-0@lo:400:kworker.0 Request processed in 34us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.278855:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1788572306.278946:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788572306.278979:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5a40f32680 x1875444584331776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572306.278990:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584331776:0@lo:400:kworker.0 00010000:00080000:3.0:1788572306.279002:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5a40f31f80 x1875444584332416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572306.279010:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584332416:0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.280817:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584332288:0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.281051:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.281162:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584332928:0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.281191:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.281221:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572306.281228:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584332032:0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.281253:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.281276:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584332800:0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.281295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572306.283003:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572306.283060:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584332544:0@lo:400:kworker.0 00000100:00100000:2.0:1788572306.283102:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572306.283128:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584332032 00000100:00100000:2.0:1788572306.283135:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584332032 00000100:00100000:2.0:1788572306.283181:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584332544 00000100:00100000:2.0:1788572306.283185:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584332544 00000100:00100000:2.0:1788572306.283201:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788572306.283210:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584332032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.283212:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788572306.283220:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584332544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572306.283263:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584332032:12345-0@lo:400:kworker.0 Request processed in 53us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.283263:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584332544:12345-0@lo:400:kworker.0 Request processed in 43us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.283271:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788572306.283273:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788572306.283292:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584332928 00000100:00100000:3.0:1788572306.283296:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584332928 00000100:00100000:2.0:1788572306.283308:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584332544:0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.283320:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584331904 00000100:00100000:3.0:1788572306.283322:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584331904 00000100:00100000:3.0:1788572306.283349:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788572306.283354:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584332928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.283389:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584332928:12345-0@lo:400:kworker.0 Request processed in 35us (2198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.283395:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788572306.283409:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788572306.283414:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584331904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.283453:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584331904:12345-0@lo:400:kworker.0 Request processed in 38us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.283458:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788572306.283462:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584331904:0@lo:400:kworker.0 00000100:00080000:3.0:1788572306.283494:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572306.284900:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584332288 00000100:00100000:0.0:1788572306.284913:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584332288 00000100:00100000:3.0:1788572306.285091:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584332032:0@lo:400:kworker.0 00010000:00080000:3.0:1788572306.285118:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5a40f33480 x1875444584332928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572306.285129:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584332928:0@lo:400:kworker.0 00000100:00080000:3.0:1788572306.285164:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572306.286620:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584332800 00000100:00100000:1.0:1788572306.286633:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584332800 00000100:00080000:3.0:1788572306.286957:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572306.286986:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7697 00000100:00100000:1.0:1788572306.286998:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584332288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572306.287099:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584332288:12345-0@lo:400:kworker.0 Request processed in 104us (6048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.287106:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7697 00000100:00100000:1.0:1788572306.287126:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7698 00000100:00100000:1.0:1788572306.287132:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584332800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572306.287155:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584332800:12345-0@lo:400:kworker.0 Request processed in 24us (5858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.287160:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7698 00000100:00100000:3.0:1788572306.287235:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975676 gen 2 00000100:00100000:3.0:1788572306.287254:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584332800:0@lo:400:kworker.0 00000100:00100000:3.0:1788572306.287265:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584332288:0@lo:400:kworker.0 00000020:01000004:0.0:1788572306.292234:0:194767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788572306.292256:0:194767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8e590218cd40) 00000020:00000080:0.0:1788572306.292286:0:194767:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788572306.292375:0:194767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a0a158000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788572306.292379:0:194767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a0a158000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788572306.292381:0:194767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a0a158000 3 00010000:00080000:0.0:1788572306.292413:0:194767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a40ddc800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.157@tcp at head 00010000:00010000:0.0:1788572306.308109:0:194767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:0.0:1788572306.308331:0:194767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788572306.308382:0:194767:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788572306.308396:0:194767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x265cfe11109bdce0 00000100:00080000:0.0:1788572306.308407:0:194767:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572306.308413:0:194767:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572306.308451:0:194767:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffa5180 x1875444584333056/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572306.308494:0:194767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788572306.308621:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584333056:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572306.308695:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.308843:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584333056 00000100:00100000:3.0:1788572306.308851:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584333056 00000100:00100000:3.0:1788572306.308967:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1788572306.308975:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584333056:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788572306.309002:0:188833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 9059 last 0 00000020:00000080:3.0:1788572306.309053:0:188833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x265cfe11109bdce7 00000004:00100000:3.0:1788572306.309069:0:188833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572306.309101:0:188833:0:(import.c:65:import_set_state_nolock()) ffff8e59019dc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572306.309154:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875444584333056:12345-0@lo:38:llog_process_th.0 Request processed in 179us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.309162:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1788572306.309224:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572306.309233:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 5 00000100:00080000:3.0:1788572306.309240:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788572306.309244:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788572306.309246:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788572306.309252:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584333056:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788572306.310439:0:194767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x34:0x0] index 52 count 51 00000020:01000000:3.0:1788572306.310576:0:194756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788572306.310608:0:194756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788572306.310634:0:194756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcbd expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.310646:0:194756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcbd expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788572306.310930:0:194756:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788572306.310932:0:194756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572306.310934:0:194756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572306.310935:0:194756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572306.310937:0:194756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572306.310938:0:194756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572306.310939:0:194756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572306.310941:0:194756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572306.310942:0:194756:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572306.310946:0:194756:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788572306.310948:0:194756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788572306.310949:0:194756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572306.310950:0:194756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572306.310951:0:194756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572306.310952:0:194756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572306.310954:0:194756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572306.310955:0:194756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572306.310956:0:194756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572306.310956:0:194756:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572306.310981:0:194756:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788572306.311000:0:194756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584333184:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788572306.311070:0:194756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.311123:0:194756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d30000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572306.311277:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584333184 00000100:00100000:1.0:1788572306.311285:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584333184 00000100:00100000:1.0:1788572306.311332:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788572306.311342:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584333184:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788572306.311367:0:194079:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788572306.311381:0:194079:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788572306.322162:0:194079:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788572306.322185:0:194079:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788572306.322507:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:194756:x1875444584333184:12345-0@lo:253:mount.lustre.0 Request processed in 11135us (11405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.322522:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788572306.322663:0:194756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:194756:1875444584333184:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572306.322678:0:194756:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788572306.322681:0:194756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572306.322683:0:194756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572306.322684:0:194756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572306.322685:0:194756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572306.322687:0:194756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572306.322688:0:194756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572306.322689:0:194756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572306.322691:0:194756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572306.322692:0:194756:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788572306.322710:0:194756:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788572306.324010:0:194082:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788572306.324018:0:194082:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788572306.324052:0:194082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.324076:0:194082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdaa9 expref: 23 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.324085:0:194082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdac5 expref: 23 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.324095:0:194082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e1 expref: 9 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.324102:0:194082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.324138:0:194082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e1 expref: 9 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.324153:0:194082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e1 expref: 9 pid: 194078 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572306.324167:0:194082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:194082:1875444584333312:192.168.202.57@tcp:104: 00010000:00010000:3.0:1788572306.324259:0:194082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bdac5 expref: 23 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.324269:0:194082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109bdac5 expref: 23 pid: 194084 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572306.324278:0:194082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:194082:1875444584333440:0@lo:104: 00000100:00100000:3.0:1788572306.324310:0:194082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572306.324353:0:194082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bdaa9 expref: 23 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.324362:0:194082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109bdaa9 expref: 23 pid: 194079 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572306.324370:0:194082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:194082:1875444584333568:0@lo:104: 00000100:00100000:3.0:1788572306.324387:0:194082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.324403:0:194082:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572306.324421:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584333440 00000100:00100000:3.0:1788572306.324427:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584333440 00000100:00100000:3.0:1788572306.324457:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584333568 00000100:00100000:3.0:1788572306.324460:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584333568 00000100:00100000:3.0:1788572306.324472:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5394 00000100:00100000:3.0:1788572306.324503:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+4:194082:x1875444584333440:12345-0@lo:104: 00010000:00010000:3.0:1788572306.324515:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.324559:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572306.324565:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+4:194082:x1875444584333440:12345-0@lo:104: Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.324572:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5394 00000100:00100000:3.0:1788572306.324587:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5395 00000100:00100000:3.0:1788572306.324592:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:194082:x1875444584333568:12345-0@lo:104: 00010000:00010000:3.0:1788572306.325222:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.325280:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788572306.325286:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:194082:x1875444584333568:12345-0@lo:104: Request processed in 693us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.325296:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5395 00000100:00100000:3.0:1788572306.325341:0:194082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:194082:1875444584333440:0@lo:104: 00000100:00100000:3.0:1788572306.325349:0:194082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:194082:1875444584333568:0@lo:104: 00010000:00010000:1.0:1788572306.326385:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572306.326393:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326404:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e000 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:1.0:1788572306.326409:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326419:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572306.326426:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572306.326431:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572306.326501:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326509:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572306.326528:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326536:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e000/0x265cfe11109bdac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bdacc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326551:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572306.326555:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326561:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e400 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:1.0:1788572306.326564:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326570:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572306.326575:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572306.326580:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572306.326964:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326971:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572306.326978:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326984:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1616e400/0x265cfe11109bdaa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bdab0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.326999:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572306.327001:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572306.327003:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572306.327022:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584333696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572306.327092:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.327136:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572306.327142:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584333824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572306.327164:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.327202:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584333696 00000100:00100000:1.0:1788572306.327209:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584333696 00010000:00010000:1.0:1788572306.327235:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bdac5 expref: 24 pid: 194084 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572306.327259:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584333824 00000100:00100000:1.0:1788572306.327262:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584333824 00010000:00010000:1.0:1788572306.327272:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bdaa9 expref: 25 pid: 194079 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572306.327290:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12897 00000100:00100000:1.0:1788572306.327299:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+25:3641:x1875444584333696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572306.327313:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572306.327319:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bdac5 expref: 25 pid: 194084 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.327329:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109bdac5 expref: 25 pid: 194084 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.327344:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1616e800/0x265cfe11109bdacc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bdac5 expref: 25 pid: 194084 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.327358:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572306.327391:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584333696:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.327398:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12897 00000100:00100000:1.0:1788572306.327414:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12898 00000100:00100000:1.0:1788572306.327421:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3641:x1875444584333824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572306.327433:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572306.327437:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bdaa9 expref: 23 pid: 194079 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.327445:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109bdaa9 expref: 23 pid: 194079 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.327455:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bdaa9 expref: 23 pid: 194079 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572306.327464:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572306.327513:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3641:x1875444584333824:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.327520:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12898 00000100:00100000:1.0:1788572306.327558:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584333824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572306.327567:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584333696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572306.329161:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572306.329189:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572306.329259:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569489536 00000100:00100000:0.0:1788572306.329266:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569489536 00010000:00010000:0.0:1788572306.329294:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e1 expref: 10 pid: 194078 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572306.329326:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12899 00000100:00100000:0.0:1788572306.329335:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569489536:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572306.329347:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572306.329352:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e1 expref: 10 pid: 194078 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329363:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e1 expref: 10 pid: 194078 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329383:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329392:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788572306.329407:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005389395s 00010000:00010000:0.0:1788572306.329412:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329420:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329427:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329439:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329445:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572306.329450:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329458:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329467:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.329551:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572306.329608:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569489536:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 275us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572306.329627:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12899 00010000:00010000:3.0:1788572306.331170:0:194082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1400/0x265cfe11109bdc4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e1 expref: 9 pid: 194078 timeout: 9159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572306.331201:0:194082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:194082:1875444584333312:192.168.202.57@tcp:104: 00010000:00010000:3.0:1788572306.331313:0:194082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.331326:0:194082:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.331332:0:194082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.331339:0:194082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1616f600/0x265cfe11109bdcee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 194082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788572306.331584:0:194756:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 2 recoverable clients, last_transno 34359738473 00010000:00080000:0.0:1788572306.340304:0:194773:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 194773 00010000:02000000:0.0:1788572306.340324:0:194773:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1788572306.340328:0:194773:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788572306.340332:0:194773:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788572306.340424:0:194756:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788572306.340469:0:194756:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.157@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788572306.340516:0:194756:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788572306.340636:0:194756:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788572306.346112:0:194756:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788572306.346415:0:194756:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788572306.818495:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584333952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572306.818587:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.818667:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584333952 00000100:00100000:0.0:1788572306.818675:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584333952 00000100:00100000:0.0:1788572306.818726:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788572306.818735:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584333952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572306.818773:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1788572306.818820:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584333952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572306.818827:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788572306.819061:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584333952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572306.819620:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572306.819631:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584334080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572306.819667:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.819701:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584334080 00000100:00100000:1.0:1788572306.819706:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584334080 00000100:00100000:1.0:1788572306.819733:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788572306.819741:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584334080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572306.819763:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1788572306.819802:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584334080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.819808:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788572306.819840:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584334080:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788572306.956909:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572307.324846:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584334208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572307.324938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572307.325034:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584334208 00000100:00100000:0.0:1788572307.325044:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584334208 00000100:00100000:0.0:1788572307.325121:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6297 00000100:00100000:0.0:1788572307.325133:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584334208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572307.325168:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572307.325220:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584334208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572307.325227:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6297 00000100:00100000:0.0:1788572307.325275:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584334208:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1788572307.555737:0:194823:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788572307.556128:0:194823:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788572307.583042:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788572307.583053:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a10fc4800 from 335 10000000:01000000:2.0:1788572307.583060:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788572307.583134:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572307.583147:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572307.583159:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572307.583192:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584334336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572307.583393:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572307.583436:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590576c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788572307.586786:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584334336 00000100:00100000:1.0:1788572307.586803:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584334336 00000100:00100000:1.0:1788572307.586887:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788572307.586899:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584334336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572307.586916:0:194084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572307.586937:0:194084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd2c00/0x265cfe11109bdcfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdcf5 expref: -99 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572307.586967:0:194084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd2c00/0x265cfe11109bdcfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdcf5 expref: 23 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572307.586979:0:194084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd2c00/0x265cfe11109bdcfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdcf5 expref: 23 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572307.586989:0:194084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd2c00, rc 0) 00000100:00100000:1.0:1788572307.587062:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584334336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (3668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572307.587069:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788572307.587573:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584334336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572307.587596:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572307.587607:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572307.587691:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584334464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788572307.587731:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572307.587770:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590576c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788572307.591416:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584334464 00000100:00100000:1.0:1788572307.591433:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584334464 00000100:00100000:1.0:1788572307.591510:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788572307.591520:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584334464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788572307.591546:0:194078:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788572307.591571:0:194078:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788572307.591575:0:194078:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 335 00000100:00100000:1.0:1788572307.591717:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584334464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 198us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572307.591725:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788572307.591911:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584334464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788572307.591983:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572307.591993:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572307.592004:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572307.592014:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788572307.592017:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a412c6800 from 335 10000000:01000000:2.0:1788572307.592020:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788572307.592049:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572307.592057:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572307.592067:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572307.592098:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584334592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572307.592134:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572307.592173:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590576c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788572307.592402:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584334592 00000100:00100000:1.0:1788572307.592408:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584334592 00000100:00100000:1.0:1788572307.592446:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788572307.592454:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584334592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572307.592464:0:194084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572307.592498:0:194084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd2000/0x265cfe11109bdd0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdd03 expref: -99 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572307.592521:0:194084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd2000/0x265cfe11109bdd0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdd03 expref: 24 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572307.592531:0:194084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd2000/0x265cfe11109bdd0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdd03 expref: 24 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572307.592539:0:194084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd2000, rc 0) 00000100:00100000:1.0:1788572307.592576:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584334592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572307.592582:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788572307.592614:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584334592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572307.592639:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdd0a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572307.592648:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdd0a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572307.592696:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584334720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788572307.592728:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572307.592743:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a07dd1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572307.592756:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584334720 00000100:00100000:1.0:1788572307.592760:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584334720 00000100:00100000:1.0:1788572307.592783:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788572307.592790:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584334720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788572307.592803:0:194078:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788572307.592818:0:194078:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788572307.592821:0:194078:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 335 00000100:00100000:1.0:1788572307.592895:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584334720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572307.592903:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788572307.592935:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584334720:0@lo:256:ll_cfg_requeue.0 00000100:00080000:1.0:1788572307.592962:0:6515:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8e5a36d4d800 already not connected (conn 14, was 0): DISCONN 00010000:00080000:1.0:1788572307.592972:0:6515:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8e5a36d4d800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.202.157@tcp, moved to head 00000100:00080000:1.0:1788572307.592978:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572307.592985:0:6515:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a36d4d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572307.593008:0:6515:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104df80 x1875444584334848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1788572307.593050:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788572307.593056:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdd0a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572307.593064:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdd0a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572307.593426:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584334848:0@lo:8:ll_cfg_requeue.0 00000100:00100000:3.0:1788572307.593464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572307.593589:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584334848 00000100:00100000:1.0:1788572307.593594:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584334848 00000100:00100000:1.0:1788572307.595144:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22643 00000100:00100000:1.0:1788572307.595154:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875444584334848:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:1.0:1788572307.595189:0:8432:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8e5a0f312000, cookie 0x265cfe11109bdc9a 00010000:00080000:1.0:1788572307.595194:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8e5a0f312000 cur 9060 last 1788572306 00010000:02000400:1.0:1788572307.595204:0:8432:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788572307.595210:0:8432:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:1.0:1788572307.595227:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e5a0f312000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788572307.595231:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788572307.595234:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1788572307.595396:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8e590cc76000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572307.595476:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875444584334848:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 321us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572307.595497:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22643 00010000:00080000:3.0:1788572307.604514:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4104df80 x1875444584334848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788572322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572307.604542:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 9 00000100:00080000:3.0:1788572307.604557:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788572307.604563:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572307.604566:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 34359738466 gen 2 00000100:00080000:3.0:1788572307.604570:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a36d4d800 from lustre-OST0000_UUID committed 34359738466 last 0 00000100:00080000:3.0:1788572307.604574:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788572307.604744:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584334848:0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1788572307.604779:0:194825:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1788572307.604783:0:194825:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:3.0:1788572307.604788:0:194825:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:3.0:1788572307.604829:0:194825:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788572307.604864:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584334976:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788572307.604925:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572307.606192:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584334976 00000100:00100000:2.0:1788572307.606203:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584334976 00000100:00100000:2.0:1788572307.606261:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7699 00000100:00100000:2.0:1788572307.606272:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3640:x1875444584334976:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788572307.606291:0:177557:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e5a36a4f480 x1875444584334976/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:723/0 lens 224/0 e 0 to 0 dl 1788572318 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572307.606308:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3640:x1875444584334976:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 39us (1382us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572307.606314:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7699 00010000:00080000:0.0:1788572307.606987:0:194773:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788572307.964864:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572308.277459:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572308.281390:0:194084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569489664 00000100:00100000:2.0:1788572308.281409:0:194084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569489664 00000100:00100000:2.0:1788572308.281509:0:194084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 92 00000100:00100000:2.0:1788572308.281521:0:194084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569489664:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572308.281538:0:194084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572308.281557:0:194084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a00030c00/0x265cfe11109bdd11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb319 expref: -99 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572308.281585:0:194084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a00030c00/0x265cfe11109bdd11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb319 expref: 10 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572308.281597:0:194084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a00030c00/0x265cfe11109bdd11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb319 expref: 10 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572308.281612:0:194084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00030c00, rc 0) 00000100:00100000:2.0:1788572308.281691:0:194084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569489664:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 172us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572308.281699:0:194084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 92 00000100:00100000:3.0:1788572308.295710:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572308.295762:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569489792 00000100:00100000:3.0:1788572308.295771:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569489792 00000100:00100000:3.0:1788572308.295818:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 93 00000100:00100000:3.0:1788572308.295828:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569489792:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572308.295860:0:194079:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788572308.295888:0:194079:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572308.295891:0:194079:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 335 00000100:00100000:3.0:1788572308.299468:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569489792:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 Request processed in 3630us (3756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572308.299500:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 93 00000100:00100000:3.0:1788572308.305766:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572308.305859:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569489920 00000100:00100000:3.0:1788572308.305872:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569489920 00000100:00100000:3.0:1788572308.305924:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22644 00000100:00100000:3.0:1788572308.305936:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2396:x1875444569489920:12345-192.168.202.57@tcp:8:ll_cfg_requeue.0 00010000:00080000:3.0:1788572308.305996:0:41719:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp recovering/t0 exp 0000000000000000 cur 9061 last 0 00010000:02000400:3.0:1788572308.306006:0:41719:0:(ldlm_lib.c:1507:target_handle_connect()) lustre-OST0000: Denying connection for new client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b (at 192.168.202.57@tcp), waiting for 2 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 1:09 00000100:00100000:3.0:1788572308.329561:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2396:x1875444569489920:12345-192.168.202.57@tcp:8:ll_cfg_requeue.0 Request processed in 23612us (23799us total) trans 0 rc -16/-16 00000100:00100000:3.0:1788572308.329582:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22644 00010000:00010000:0.0:1788572308.989740:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572309.375391:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572309.375414:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584335104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572309.375507:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572309.385839:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584335104 00000100:00100000:1.0:1788572309.385854:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584335104 00000100:00100000:1.0:1788572309.386012:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6298 00000100:00100000:1.0:1788572309.386026:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584335104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572309.386064:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00080000:3.0:1788572309.386276:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572309.386411:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584335104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 389us (10903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572309.386420:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6298 00000100:00100000:1.0:1788572309.386491:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584335104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572309.869018:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572309.869069:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572309.869104:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572309.869184:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572309.869212:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572309.869241:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569490560 00000100:00100000:3.0:1788572309.869252:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569490560 00000100:00100000:3.0:1788572309.869313:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569490432 00000100:00100000:3.0:1788572309.869316:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569490432 00000100:00100000:3.0:1788572309.869348:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7700 00000100:00100000:3.0:1788572309.869359:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569490560:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572309.869442:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569490560:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572309.869450:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7700 00000100:00100000:3.0:1788572309.869469:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22645 00000100:00100000:3.0:1788572309.869474:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:2396:x1875444569490432:12345-192.168.202.57@tcp:8:kworker.0 00000100:00100000:1.0:1788572309.869592:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569490048 00000100:00100000:1.0:1788572309.869598:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569490048 00000100:00100000:1.0:1788572309.869632:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 94 00000100:00100000:1.0:1788572309.869639:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569490048:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572309.869668:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569490048:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572309.869674:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 94 00010000:00080000:3.0:1788572309.869855:0:177558:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp recovering/t0 exp 0000000000000000 cur 9062 last 0 00010000:02000400:3.0:1788572309.869865:0:177558:0:(ldlm_lib.c:1507:target_handle_connect()) lustre-OST0000: Denying connection for new client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b (at 192.168.202.57@tcp), waiting for 2 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 1:07 00000100:00100000:3.0:1788572309.869892:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:2396:x1875444569490432:12345-192.168.202.57@tcp:8:kworker.0 Request processed in 416us (679us total) trans 0 rc -16/-16 00000100:00100000:3.0:1788572309.869899:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22645 00000100:00080000:3.0:1788572309.869921:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572309.876505:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569490304 00000100:00100000:2.0:1788572309.876521:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569490304 00000100:00100000:3.0:1788572309.876733:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569490176 00000100:00100000:3.0:1788572309.876738:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569490176 00000100:00100000:3.0:1788572309.876788:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 273 00000100:00100000:3.0:1788572309.876799:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569490304:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572309.876900:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569490304:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 88us (7814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572309.876908:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 273 00000100:00100000:3.0:1788572309.876931:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 274 00000100:00100000:3.0:1788572309.876938:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569490176:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572309.876964:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569490176:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 27us (7859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572309.876970:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 274 00000100:00080000:2.0:1788572309.877314:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572309.877329:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788572310.012841:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.037648:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572311.420818:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572311.420825:0:105698:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1788572311.420842:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572311.420845:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572311.420849:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572311.420861:0:105698:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e59059d6800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572311.420882:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f31500 x1875444584336128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572311.421012:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584335360:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421080:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.421127:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584335872:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421148:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.421161:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584336512:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421220:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.421246:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572311.421252:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584335232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421278:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.421302:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584335744:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421336:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.421356:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584336384:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421377:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.421405:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584335360 00000100:00100000:0.0:1788572311.421412:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584335360 00000100:00100000:0.0:1788572311.421464:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584335872 00000100:00100000:0.0:1788572311.421468:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584335872 00000100:00100000:0.0:1788572311.421515:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584336512 00000100:00100000:0.0:1788572311.421520:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584336512 00000100:00100000:0.0:1788572311.421536:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584336384 00000100:00100000:0.0:1788572311.421538:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584336384 00000100:00100000:0.0:1788572311.421550:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788572311.421557:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584335360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421608:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584335360:12345-0@lo:400:kworker.0 Request processed in 51us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.421615:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788572311.421637:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788572311.421643:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584335872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421669:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584335872:12345-0@lo:400:kworker.0 Request processed in 27us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.421675:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788572311.421686:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788572311.421692:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584336512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421717:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584336512:12345-0@lo:400:kworker.0 Request processed in 26us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.421723:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788572311.421734:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788572311.421740:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584336384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421766:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584336384:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.421772:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788572311.421791:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584335232 00000100:00100000:0.0:1788572311.421795:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584335232 00000100:00100000:0.0:1788572311.421819:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788572311.421825:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584335232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421853:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584335232:12345-0@lo:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.421858:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788572311.421885:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584335744 00000100:00100000:0.0:1788572311.421889:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584335744 00000100:00100000:0.0:1788572311.421912:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7701 00000100:00100000:0.0:1788572311.421918:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584335744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.421946:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584335744:12345-0@lo:400:kworker.0 Request processed in 29us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.421951:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7701 00000100:00080000:0.0:1788572311.421970:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572311.421974:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572311.421998:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584335232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.422012:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584335744:0@lo:400:kworker.0 00010000:00080000:0.0:1788572311.422023:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a24547b80 x1875444584336384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572311.422033:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584336384:0@lo:400:kworker.0 00010000:00080000:0.0:1788572311.422043:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a40f30000 x1875444584335360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572311.422052:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584335360:0@lo:400:kworker.0 00010000:00080000:0.0:1788572311.422061:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a40f30380 x1875444584335872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572311.422068:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584335872:0@lo:400:kworker.0 00010000:00080000:0.0:1788572311.422077:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a24546a00 x1875444584336512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572311.422085:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584336512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.422708:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584335616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.422756:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572311.422779:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584336256:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.422801:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572311.422825:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788572311.422831:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584335488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.422855:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572311.422872:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584336000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.422891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572311.422907:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584336640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.422927:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572311.422957:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584336128:0@lo:8:kworker.0 00000100:00100000:3.0:1788572311.422981:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572311.423012:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584335488 00000100:00100000:3.0:1788572311.423017:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584335488 00000100:00100000:3.0:1788572311.423055:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584336640 00000100:00100000:3.0:1788572311.423058:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584336640 00000100:00100000:3.0:1788572311.423075:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788572311.423081:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584335488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.423128:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584335488:12345-0@lo:400:kworker.0 Request processed in 46us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572311.423134:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788572311.423150:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788572311.423156:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584336640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.423193:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584336640:12345-0@lo:400:kworker.0 Request processed in 37us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572311.423276:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788572311.423303:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584336256 00000100:00100000:3.0:1788572311.423306:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584336256 00000100:00100000:1.0:1788572311.423442:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584335616 00000100:00100000:1.0:1788572311.423447:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584335616 00000100:00100000:1.0:1788572311.423475:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584336000 00000100:00100000:1.0:1788572311.423497:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584336000 00000100:00100000:1.0:1788572311.423514:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788572311.423521:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584335616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572311.423558:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584335616:12345-0@lo:400:kworker.0 Request processed in 38us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572311.423564:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788572311.423577:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788572311.423583:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584336000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572311.423610:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584336000:12345-0@lo:400:kworker.0 Request processed in 28us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572311.423616:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788572311.423702:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584336128 00000100:00100000:3.0:1788572311.423708:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584336128 00000100:00100000:3.0:1788572311.423725:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7702 00000100:00100000:3.0:1788572311.423731:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584336256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.423761:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584336256:12345-0@lo:400:kworker.0 Request processed in 31us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572311.423768:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7702 00000100:00100000:3.0:1788572311.423779:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22646 00000100:00100000:3.0:1788572311.423783:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:0+-99:3640:x1875444584336128:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788572311.423807:0:177560:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8e5a0f312800, cookie 0x265cfe11109bdca1 00010000:00080000:3.0:1788572311.423812:0:177560:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8e5a0f312800 cur 9064 last 1788572306 00002000:00100000:3.0:1788572311.423828:0:177560:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e5a0f312800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788572311.423832:0:177560:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788572311.423835:0:177560:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1788572311.423866:0:177560:0:(import.c:65:import_set_state_nolock()) ffff8e59019db800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572311.423908:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584336128:12345-0@lo:8:kworker.0 Request processed in 123us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572311.423914:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22646 00010000:00080000:3.0:1788572311.423959:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a40f31500 x1875444584336128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788572336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572311.423970:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738473 gen 2 00000100:00080000:3.0:1788572311.423977:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:3.0:1788572311.423985:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788572311.423990:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788572311.423992:0:3640:0:(import.c:1277:ptlrpc_connect_interpret()) connect to lustre-OST0000_UUID during recovery 00000100:00080000:3.0:1788572311.423994:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY_LOCKS 00000100:00080000:3.0:1788572311.423998:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788572311.424018:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584336128:0@lo:8:kworker.0 00000100:00100000:3.0:1788572311.424042:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584336768:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1788572311.424068:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572311.424097:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584336768 00000100:00100000:3.0:1788572311.424100:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584336768 00000100:00100000:3.0:1788572311.424120:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7703 00000100:00100000:3.0:1788572311.424125:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584336768:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788572311.424136:0:8431:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e590c442300 x1875444584336768/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:727/0 lens 224/0 e 0 to 0 dl 1788572322 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572311.424145:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584336768:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 21us (77us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572311.424149:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7703 00000100:00100000:3.0:1788572311.424171:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584335488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.424204:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584336000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.424216:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584336640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.424226:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584335616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572311.424234:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584336256:0@lo:400:kworker.0 00010000:00080000:0.0:1788572311.424873:0:194773:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788572311.424880:0:194773:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 34359738474 00010000:00080000:0.0:1788572311.424886:0:194773:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 34359738474 00010000:00080000:0.0:1788572311.424890:0:194773:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:0.0:1788572311.424895:0:194773:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788572311.424898:0:194773:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788572311.425040:0:194773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705664 00000100:00080000:0.0:1788572311.425065:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572311.425070:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1788572311.433051:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788572311.433067:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:0.0:1788572311.433645:0:194773:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:0.0:1788572311.433661:0:194773:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8e5a36a4f480 x1875444584334976/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:723/0 lens 224/0 e 0 to 0 dl 1788572318 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788572311.433908:0:194773:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8e590c442300 x1875444584336768/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:727/0 lens 224/0 e 0 to 0 dl 1788572322 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788572311.433951:0:194773:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00002000:00080000:0.0:1788572311.434906:0:194773:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788572311.434915:0:194773:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00010000:00080000:3.0:1788572311.440453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36a4c700 x1875444584334976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572323 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572311.440474:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788572311.440814:0:3640:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8e5a36a4c700 x1875444584334976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572323 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572311.440824:0:3640:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8e5a36a4c700 x1875444584334976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572323 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572311.440830:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1788572311.440893:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1788572311.440896:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788572311.440904:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008a9c660a): req@ffff8e5a1ff85180 x1875444584306176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788572274 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572311.440927:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584334976:0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788572311.440962:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e590c443800 x1875444584336768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572327 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572311.440972:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788572311.440976:0:3640:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8e590c443800 x1875444584336768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572327 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572311.440984:0:3640:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8e590c443800 x1875444584336768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572327 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572311.440990:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1788572311.441014:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1788572311.441017:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788572311.441020:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584336768:0@lo:400:ptlrpcd_rcv.0 00000004:00080000:3.0:1788572311.441047:0:194091:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788572311.441149:0:194091:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 9064435668987ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788572311.441155:0:194091:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788572311.444926:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572311.445207:0:194092:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x19e2:0x0] 00000100:00100000:2.0:1788572311.445236:0:194092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24545c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:194092:1875444584337024:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788572311.445273:0:194092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572311.445295:0:194092:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a245170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572311.445318:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584337024 00000100:00100000:2.0:1788572311.445338:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584337024 00000100:00100000:2.0:1788572311.445390:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22647 00000100:00100000:2.0:1788572311.445401:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:194092:x1875444584337024:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788572311.446355:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584306176 00000100:00100000:3.0:1788572311.446363:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584306176 00000100:00100000:3.0:1788572311.446401:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6299 00000100:00100000:3.0:1788572311.446410:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584306176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572311.446426:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572311.446507:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584306176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572311.446518:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6299 00000100:00100000:0.0:1788572311.452598:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572311.452636:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584336896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572311.452719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572311.452931:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584336896 00000100:00100000:1.0:1788572311.452940:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584336896 00000100:00100000:1.0:1788572311.453004:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6300 00000100:00100000:1.0:1788572311.453015:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584336896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572311.453042:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572311.453094:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584336896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572311.453101:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6300 00000100:00100000:1.0:1788572311.453162:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584337152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572311.453216:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572311.453245:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584337152 00000100:00100000:1.0:1788572311.453249:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584337152 00000100:00100000:1.0:1788572311.453267:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6301 00000100:00100000:1.0:1788572311.453273:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584337152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572311.453284:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572311.453313:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584337152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572311.453319:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6301 00010000:00080000:0.0:1788572311.453446:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a24547100 x1875444584336896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572311.453503:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584336896:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788572311.453666:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4104df80 x1875444584337152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572311.453679:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584337152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572311.453717:0:188078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:188078:1875444584337280:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788572311.453860:0:188078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572311.453918:0:188078:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905c1c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572311.463313:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584337280 00000100:00100000:0.0:1788572311.463473:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584337280 00000100:00100000:1.0:1788572311.463659:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22648 00000100:00100000:1.0:1788572311.463670:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:188078:x1875444584337280:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:2.0:1788572311.465400:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1ff85180 x1875444584306176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572327 ref 1 fl Rpc:RQU/202/0 rc -107/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572311.465425:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584306176:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788572311.467017:0:194073:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788572311.471891:0:43920:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788572311.471904:0:43920:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6689 -> diff = -63 00002000:02000040:1.0:1788572311.471913:0:43920:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6627 to 0x280000401:6689) 00002000:00080000:3.0:1788572311.477543:0:179391:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788572311.477555:0:179391:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x261:0x0] 00000100:00100000:3.0:1788572311.477661:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:188078:x1875444584337280:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13988us (23796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572311.477671:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22648 00010000:00080000:0.0:1788572311.479896:0:188078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e590cb0a300 x1875444584337280/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788572327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572311.479915:0:188078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:188078:1875444584337280:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788572311.479929:0:188078:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x261:0x0] 00002000:00010000:1.0:1788572311.488141:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.488152:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.488168:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a21:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.488173:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.488191:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.488273:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.488286:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.488294:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.488402:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572311.491223:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.491235:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.491252:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a20:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.491257:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.491264:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.491279:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.491290:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.491298:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491667:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572311.491676:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491684:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572311.491689:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491698:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491720:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491728:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491759:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572311.491762:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491775:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572311.491779:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491787:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491796:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.491804:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572311.491806:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572311.491808:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.500220:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572311.500239:0:43920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572311.504062:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.504077:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.504097:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1f:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.504103:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.504109:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.504124:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.504134:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.504142:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.504287:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572311.504797:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.504804:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.504815:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1e:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.504818:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.504822:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.504832:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.504840:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.504849:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.505959:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572311.505970:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.505981:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572311.505985:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.505996:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.506014:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.506023:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bdd26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.506046:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572311.506049:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.506055:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572311.506058:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.506065:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.506074:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.506080:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572311.506082:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572311.506084:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.516318:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.518044:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572311.518056:0:43920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bdd2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572311.519861:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.519875:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.519894:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1d:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.519898:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.519905:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.519920:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.519931:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.519939:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.519971:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572311.520189:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572311.520196:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.520218:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572311.520223:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.520233:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.520257:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.520267:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bdd34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.520299:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.520302:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.520304:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.520513:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572311.520648:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.520655:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.520666:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1c:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.520670:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.520675:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.520686:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.520695:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.520704:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.520730:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572311.520957:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572311.520964:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.520973:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572311.520977:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.520986:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.521000:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.521008:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bdd3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.521026:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.521027:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.521029:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572311.521683:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.521691:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.521703:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1b:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.521707:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.521712:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.521722:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.521729:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.521736:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.521761:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572311.521899:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.521906:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.521915:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.521919:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.521935:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.521951:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.521959:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bdd42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.521977:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.521979:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.521981:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572311.522362:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.522551:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.522567:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1a:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.522571:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.522577:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.522593:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.522603:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.522612:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.522811:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572311.522842:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.522850:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.522859:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.522863:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.522875:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.522891:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.522904:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bdd49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.522924:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.522926:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.522928:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572311.524254:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.524264:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.524282:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a19:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.524287:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.524294:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.524313:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.524324:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.526788:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.526838:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572311.526877:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.526892:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.526908:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.526913:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.526924:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.526946:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.526954:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bdd50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.526982:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.526985:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.526987:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572311.529054:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.529072:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.529094:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a18:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.529174:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.529196:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.529216:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.529230:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.529238:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.529266:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572311.529316:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.529330:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.529356:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.529362:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.529376:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.529397:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.529406:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bdd57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.529436:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.529438:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.529441:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572311.530275:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.530285:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.530300:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a17:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.530304:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.530309:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.530321:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.530461:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.530470:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.530546:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572311.530780:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572311.530791:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.530804:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572311.530809:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.530826:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.530845:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.530854:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bdd5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.530877:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.530879:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.530882:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572311.531591:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.531601:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.531617:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a16:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.531622:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.531819:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.531837:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.531848:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.531855:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.532258:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572311.534266:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572311.534282:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.534298:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572311.534304:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.534317:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.534340:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.534347:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bdd65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.534379:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572311.534381:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572311.534383:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572311.539256:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572311.539273:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.539296:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a15:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:1.0:1788572311.539301:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572311.539308:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.539326:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.539350:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.539358:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.539391:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572311.539426:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.539442:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.539455:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.539460:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.539548:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.539576:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.539585:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109bdd6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.539608:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.539610:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.539612:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572311.543962:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572311.543977:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.543996:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a14:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:3.0:1788572311.544002:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572311.544010:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.544025:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.544041:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.544049:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.544075:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572311.544641:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.544649:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.544658:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.544663:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.544674:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.544692:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.544706:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001643ffa3/0x265cfe11109bdd73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.544727:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.544730:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.544731:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572311.544912:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572311.544918:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.544928:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a13:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:3.0:1788572311.544932:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572311.544937:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.544948:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.544957:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.544966:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.544993:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572311.545659:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572311.545665:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.545674:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a12:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:3.0:1788572311.545677:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572311.545682:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.545690:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.545698:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.545706:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.545728:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572311.546546:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572311.546562:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.546577:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572311.546584:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.546597:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.546621:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.546705:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d71f07e/0x265cfe11109bdd7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.546737:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572311.546741:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.546748:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572311.546751:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.546884:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.547022:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.547031:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031e81ab9/0x265cfe11109bdd81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.547050:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.547052:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.547054:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.547257:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572311.547511:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572311.547521:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.547535:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a11:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:3.0:1788572311.547540:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572311.547546:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.547559:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.547568:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.547575:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.547596:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572311.548506:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.548515:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.548526:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.548531:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.548541:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.548560:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.548570:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dea990b/0x265cfe11109bdd88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.548593:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.548596:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.548598:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572311.549404:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572311.549414:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.549426:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a10:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:3.0:1788572311.549430:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572311.549437:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.549449:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.549459:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.549467:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.549577:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572311.560027:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.560041:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.560054:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.560060:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.560071:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.560094:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.560102:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006754972b/0x265cfe11109bdd8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.560125:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.560127:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.560129:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572311.563494:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572311.563509:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563527:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0f:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:0.0:1788572311.563532:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572311.563539:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563553:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563564:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563571:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563589:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572311.563601:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.563606:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563613:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.563617:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563625:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563639:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563651:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009de7ff2e/0x265cfe11109bdd96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.563668:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.563669:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.563671:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572311.564952:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572311.564961:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.564976:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0e:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:0.0:1788572311.564981:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572311.564986:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.564998:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565007:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565014:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565028:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572311.565573:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572311.565580:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565589:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0d:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:0.0:1788572311.565592:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572311.565596:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565605:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565612:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565618:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565633:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572311.565641:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572311.565647:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565653:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.565657:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565669:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565683:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565690:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069e6032b/0x265cfe11109bdd9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565704:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572311.565707:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565712:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572311.565715:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565722:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565730:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565751:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1a13ef8/0x265cfe11109bdda4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.565769:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.565770:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572311.565772:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.567392:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572311.568694:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572311.568706:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.568723:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0c:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:0.0:1788572311.568728:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572311.568734:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.568760:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.568772:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.568780:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.568807:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572311.568881:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572311.568908:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.568924:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572311.568930:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.568943:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.568967:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.568977:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2272f1e/0x265cfe11109bddab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.569013:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.569015:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.569017:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572311.569356:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572311.569364:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.569379:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0b:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:0.0:1788572311.569382:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572311.569387:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.569396:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.569406:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.569413:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.569441:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572311.569989:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572311.569997:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.570007:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572311.570012:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.570022:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.570037:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.570044:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d879b5/0x265cfe11109bddb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.570063:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.570065:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.570067:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572311.570608:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572311.570615:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.570626:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0a:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:0.0:1788572311.570630:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a0a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572311.570636:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.570645:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.570655:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.570663:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572311.572594:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572311.581918:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572311.581931:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.581949:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a09:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:2.0:1788572311.581954:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a09:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572311.581961:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.581977:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.581989:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.581998:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.582170:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572311.582189:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.582206:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572311.582212:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.582222:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.582241:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.582249:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8f3f712/0x265cfe11109bddb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.588092:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572311.588130:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572311.588139:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.588154:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572311.588160:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.588173:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.588215:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.588224:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fc507e1/0x265cfe11109bddc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.588582:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.588586:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.588588:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.601663:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.601670:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.601674:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572311.604932:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572311.604949:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.604967:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a08:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:2.0:1788572311.604973:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a08:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572311.604980:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.604996:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.605008:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.605017:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.605048:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572311.606037:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572311.606048:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606059:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a07:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:2.0:1788572311.606063:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a07:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572311.606069:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606084:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606092:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606100:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606120:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572311.606130:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572311.606136:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606144:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572311.606148:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606157:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606172:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606190:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b511be74/0x265cfe11109bddc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606209:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572311.606213:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606219:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572311.606222:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606229:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606239:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606247:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a2ef00d/0x265cfe11109bddce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606262:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.606264:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.606266:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572311.606636:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572311.606643:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606653:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a06:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:2.0:1788572311.606657:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a06:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572311.606662:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606672:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606680:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606688:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.606703:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572311.608915:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572311.608927:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.608944:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a05:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:2.0:1788572311.608949:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a05:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572311.608955:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.608969:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.608979:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.608987:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.609009:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572311.610081:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572311.610092:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610104:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572311.610109:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610120:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610138:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610144:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0459297/0x265cfe11109bddd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610170:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572311.610174:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610193:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572311.610196:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610204:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610214:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610220:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052fb1079/0x265cfe11109bdddc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.610232:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.610234:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.610236:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.610242:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.610603:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572311.625132:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572311.625147:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.625163:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a04:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:3.0:1788572311.625167:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a04:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572311.625174:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.625198:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.625209:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.625217:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572311.625238:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572311.625575:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572311.625583:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.625591:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572311.625596:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.625605:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.625622:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.625628:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b524fb21/0x265cfe11109bdde3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.625646:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.625648:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572311.625649:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572311.634046:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572311.634060:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.634076:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a03:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:2.0:1788572311.634081:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a03:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572311.634087:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.634100:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.634111:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.634118:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.634145:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572311.634616:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572311.634625:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.634639:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572311.634644:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.634654:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.634670:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.634677:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf109a8f/0x265cfe11109bddea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.634697:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.634699:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.634700:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572311.636348:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572311.636362:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.636378:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a02:0x0].0x0 since=9064s v=(0 0) 00010000:00010000:2.0:1788572311.636383:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a02:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572311.636389:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.636410:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.636420:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.636429:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572311.636446:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788572311.636820:0:43920:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6626 00000100:00100000:2.0:1788572311.636916:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:194092:x1875444584337024:12345-0@lo:5:osp-pre-0-0.0 Request processed in 191514us (191640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572311.636926:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22647 00000100:00100000:2.0:1788572311.636983:0:194092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24545c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:194092:1875444584337024:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788572311.636998:0:194092:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x1a21:0x0] from OST, last_created [0x280000401:0x1a21:0x0]last_used is [0x280000401:0x19e2:0x0] 00000100:00100000:2.0:1788572311.637038:0:194092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24545c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:194092:1875444584337408:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788572311.637068:0:194092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572311.637089:0:194092:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a245170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572311.637117:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584337408 00000100:00100000:2.0:1788572311.637122:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584337408 00000100:00100000:2.0:1788572311.637156:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22649 00000100:00100000:2.0:1788572311.637163:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:194092:x1875444584337408:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788572311.637209:0:43920:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 6690 00000100:00100000:2.0:1788572311.638727:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:194092:x1875444584337408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1559us (1653us total) trans 38654705665 rc 0/0 00000100:00100000:2.0:1788572311.638737:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22649 00000100:00100000:2.0:1788572311.638788:0:194092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24545c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:194092:1875444584337408:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788572311.638800:0:194092:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1a21:0x0]-[0x280000401:0x1a41:0x0] 00010000:00010000:1.0:1788572311.639030:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572311.639038:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.639049:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572311.639054:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.639063:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.639083:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.639091:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f902fdbf/0x265cfe11109bddf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572311.639112:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.639113:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572311.639115:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572311.932691:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572311.932717:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584337536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572311.932794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.932889:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584337536 00000100:00100000:0.0:1788572311.932898:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584337536 00000100:00100000:0.0:1788572311.932961:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788572311.932971:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584337536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572311.933006:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1788572311.933058:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584337536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.933064:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788572311.933116:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584337536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572311.949630:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572311.949651:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584337664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572311.949724:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.974171:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584337664 00000100:00100000:0.0:1788572311.974223:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584337664 00000100:00100000:0.0:1788572311.974294:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788572311.974304:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584337664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572311.974357:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:0.0:1788572311.974459:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584337664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (24734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.974466:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788572311.974545:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584337664:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788572312.060581:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572312.445543:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584338176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.445624:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.445662:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584338688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.445685:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.445700:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584339200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.445726:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.445752:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788572312.445757:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584337792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.445784:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.445806:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584338304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.445842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.445861:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584338816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.445880:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.445895:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584339328:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.445919:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.445945:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584338048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446089:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584337920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572312.446142:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584338432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446163:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572312.446180:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584338944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446200:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572312.446245:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584338176 00000100:00100000:0.0:1788572312.446252:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584338176 00000100:00100000:0.0:1788572312.446299:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584338688 00000100:00100000:0.0:1788572312.446302:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584338688 00000100:00100000:0.0:1788572312.446318:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788572312.446328:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584338176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446388:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584338176:12345-0@lo:400:kworker.0 Request processed in 61us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572312.446396:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788572312.446416:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1788572312.446423:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584338688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446456:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584338688:12345-0@lo:400:kworker.0 Request processed in 34us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572312.446463:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1788572312.446509:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584338304 00000100:00100000:0.0:1788572312.446513:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584338304 00000100:00100000:0.0:1788572312.446540:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584338816 00000100:00100000:0.0:1788572312.446543:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584338816 00000100:00100000:0.0:1788572312.446558:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584338432 00000100:00100000:0.0:1788572312.446561:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584338432 00000100:00100000:0.0:1788572312.446580:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584338944 00000100:00100000:0.0:1788572312.446583:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584338944 00000100:00100000:0.0:1788572312.446605:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7704 00000100:00100000:0.0:1788572312.446612:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584338304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446646:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584338304:12345-0@lo:400:kworker.0 Request processed in 35us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572312.446652:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7704 00000100:00100000:0.0:1788572312.446665:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7705 00000100:00100000:0.0:1788572312.446671:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584338816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446698:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584338816:12345-0@lo:400:kworker.0 Request processed in 27us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572312.446703:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7705 00000100:00100000:0.0:1788572312.446715:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7706 00000100:00100000:0.0:1788572312.446721:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584338432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446752:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584338432:12345-0@lo:400:kworker.0 Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572312.446758:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7706 00000100:00100000:0.0:1788572312.446767:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7707 00000100:00100000:0.0:1788572312.446772:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584338944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446794:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584338944:12345-0@lo:400:kworker.0 Request processed in 23us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572312.446800:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7707 00000100:00100000:0.0:1788572312.446818:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584339200 00000100:00100000:0.0:1788572312.446822:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584339200 00000100:00100000:0.0:1788572312.446846:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584339328 00000100:00100000:0.0:1788572312.446849:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584339328 00000100:00100000:0.0:1788572312.446859:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584337920 00000100:00100000:0.0:1788572312.446862:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584337920 00000100:00100000:0.0:1788572312.446872:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788572312.446878:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584339200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.446909:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584339200:12345-0@lo:400:kworker.0 Request processed in 32us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572312.446915:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788572312.446927:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788572312.446932:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584339328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.447043:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584339328:12345-0@lo:400:kworker.0 Request processed in 24us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572312.447052:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788572312.447065:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788572312.447071:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584337920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.447098:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584337920:12345-0@lo:400:kworker.0 Request processed in 28us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572312.447104:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00010000:00080000:0.0:1788572312.447165:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a3f8f2d80 x1875444584337920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572312.447181:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584337920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.447193:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584338432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.447216:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584338944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.447253:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584338304:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.447265:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584338816:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.447279:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584339328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.447288:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584338176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572312.447297:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584338688:0@lo:400:kworker.0 00010000:00080000:0.0:1788572312.447306:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a31c4c000 x1875444584339200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572312.447314:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584339200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.447475:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.447521:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584338560:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.447546:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.447563:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584339072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.447581:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572312.447611:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584338048 00000100:00100000:2.0:1788572312.447615:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584338048 00000100:00100000:2.0:1788572312.447638:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584338560 00000100:00100000:2.0:1788572312.447641:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584338560 00000100:00100000:2.0:1788572312.447652:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584339072 00000100:00100000:2.0:1788572312.447654:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584339072 00000100:00100000:2.0:1788572312.447665:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788572312.447670:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584338048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.447704:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584338048:12345-0@lo:400:kworker.0 Request processed in 34us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572312.447711:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788572312.447721:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788572312.447727:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584338560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.447749:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584338560:12345-0@lo:400:kworker.0 Request processed in 23us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572312.447754:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788572312.447763:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788572312.447768:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584339072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572312.447792:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584339072:12345-0@lo:400:kworker.0 Request processed in 24us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572312.447798:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788572312.447826:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584338048:0@lo:400:kworker.0 00010000:00080000:2.0:1788572312.447837:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36b91f80 x1875444584338560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572312.447845:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584338560:0@lo:400:kworker.0 00010000:00080000:2.0:1788572312.447854:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a31c7e680 x1875444584339072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572312.447860:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584339072:0@lo:400:kworker.0 00000100:00100000:1.0:1788572312.448558:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584337792 00000100:00100000:1.0:1788572312.448565:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584337792 00000100:00100000:1.0:1788572312.448600:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788572312.448609:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584337792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572312.448660:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584337792:12345-0@lo:400:kworker.0 Request processed in 52us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572312.448667:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788572312.448703:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584339456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572312.448728:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572312.448779:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584339456 00000100:00100000:1.0:1788572312.448783:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584339456 00000100:00100000:1.0:1788572312.448808:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6302 00000100:00100000:1.0:1788572312.448814:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584339456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572312.448848:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572312.448886:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584339456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572312.448892:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6302 00000100:00100000:1.0:1788572312.448927:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584339456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572312.448952:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584337792:0@lo:400:kworker.0 00010000:00010000:1.0:1788572313.084599:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572314.109889:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572314.495608:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584339584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572314.495681:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572314.495748:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584339584 00000100:00100000:1.0:1788572314.495755:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584339584 00000100:00100000:1.0:1788572314.495807:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6303 00000100:00100000:1.0:1788572314.495831:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584339584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572314.495861:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572314.495908:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584339584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572314.495916:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6303 00000100:00080000:1.0:1788572314.495938:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572314.495976:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584339584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572314.994762:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572314.994805:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572314.994841:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572314.994866:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572314.994889:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572314.994918:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569490688 00000100:00100000:1.0:1788572314.994928:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569490688 00000100:00100000:1.0:1788572314.994982:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 97 00000100:00100000:1.0:1788572314.994992:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569490688:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572314.995065:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569490688:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572314.995072:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 97 00000100:00100000:1.0:1788572314.995103:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569491200 00000100:00100000:1.0:1788572314.995107:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569491200 00000100:00100000:1.0:1788572314.995141:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569491072 00000100:00100000:1.0:1788572314.995143:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569491072 00000100:00100000:1.0:1788572314.995159:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7708 00000100:00100000:1.0:1788572314.995165:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569491200:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572314.995193:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569491200:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572314.995199:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7708 00000100:00100000:1.0:1788572314.995210:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22650 00000100:00100000:1.0:1788572314.995214:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2396:x1875444569491072:12345-192.168.202.57@tcp:8:kworker.0 00010000:00080000:1.0:1788572314.995239:0:43921:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9067 last 0 00000020:00000080:1.0:1788572314.995284:0:43921:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109bddf8 00002000:00100000:1.0:1788572314.995504:0:43921:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e590cc74800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572314.995524:0:43921:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788572314.995685:0:43921:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788572314.995712:0:43921:0:(import.c:65:import_set_state_nolock()) ffff8e590cc73800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572314.995740:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569491072:12345-192.168.202.57@tcp:8:kworker.0 Request processed in 524us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572314.995747:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22650 00000100:00080000:1.0:1788572314.995865:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572314.996044:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569490816 00000100:00100000:2.0:1788572314.996049:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569490816 00000100:00100000:2.0:1788572314.996095:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569490944 00000100:00100000:2.0:1788572314.996098:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569490944 00000100:00100000:2.0:1788572314.996120:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 287 00000100:00100000:2.0:1788572314.996128:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569490816:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572314.996162:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569490816:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 36us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572314.996169:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 287 00000100:00100000:2.0:1788572314.996182:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 288 00000100:00100000:2.0:1788572314.996188:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569490944:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572314.996208:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569490944:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 21us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572314.996214:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 288 00000100:00080000:1.0:1788572314.996684:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572314.996688:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572315.134862:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572315.409012:0:195114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788572316.156692:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788572316.435957:0:195166:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788572316.436294:0:195166:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788572316.542275:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584339712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572316.542358:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572316.542422:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584339712 00000100:00100000:0.0:1788572316.542431:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584339712 00000100:00100000:0.0:1788572316.542510:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6304 00000100:00100000:0.0:1788572316.542521:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584339712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572316.542549:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572316.542598:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584339712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572316.542605:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6304 00000100:00080000:0.0:1788572316.542630:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572316.542667:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584339712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572316.549954:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584339840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572316.550038:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572316.550408:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584339840 00000100:00100000:2.0:1788572316.550417:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584339840 00000100:00100000:2.0:1788572316.550523:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6305 00000100:00100000:2.0:1788572316.550533:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584339840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572316.550557:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572316.550609:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584339840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572316.550616:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6305 00000100:00100000:2.0:1788572316.550668:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584339840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572316.550844:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572317.054455:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584339968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572317.054559:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572317.054627:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584339968 00000100:00100000:0.0:1788572317.054634:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584339968 00000100:00100000:0.0:1788572317.054689:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788572317.054699:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584339968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572317.054737:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1788572317.054783:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584339968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572317.054790:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788572317.054838:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584339968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572317.055104:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572317.055113:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590c443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584340096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572317.055143:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572317.055191:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584340096 00000100:00100000:3.0:1788572317.055195:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584340096 00000100:00100000:3.0:1788572317.055221:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788572317.055237:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584340096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572317.055258:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1788572317.055292:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584340096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572317.055298:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788572317.055341:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590c443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584340096:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788572317.060732:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:3.0:1788572317.060753:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705665 is committed 00010000:00010000:3.0:1788572317.180968:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788572317.494834:0:195216:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788572317.495413:0:195216:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788572317.566077:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584340224:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566149:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566184:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584340736:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566223:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584341248:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566242:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566262:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572317.566266:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584340352:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566282:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566294:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584340864:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566311:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566322:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584341376:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566337:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566374:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584340480:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566395:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566403:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584340992:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566421:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566435:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584341504:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566451:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566461:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572317.566465:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584340608:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566501:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566516:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584341120:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572317.566569:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584340736 00000100:00100000:2.0:1788572317.566576:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584340736 00000100:00100000:2.0:1788572317.566625:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584340992 00000100:00100000:2.0:1788572317.566628:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584340992 00000100:00100000:2.0:1788572317.566645:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584340608 00000100:00100000:2.0:1788572317.566647:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584340608 00000100:00100000:2.0:1788572317.566660:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584341120 00000100:00100000:2.0:1788572317.566662:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584341120 00000100:00100000:2.0:1788572317.566683:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7709 00000100:00100000:2.0:1788572317.566692:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584340736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566745:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584340736:12345-0@lo:400:kworker.0 Request processed in 54us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.566767:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7709 00000100:00100000:2.0:1788572317.566785:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7710 00000100:00100000:2.0:1788572317.566791:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584340992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566825:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584340992:12345-0@lo:400:kworker.0 Request processed in 35us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.566830:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7710 00000100:00100000:2.0:1788572317.566841:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7711 00000100:00100000:2.0:1788572317.566847:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584340608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566871:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584340608:12345-0@lo:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.566876:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7711 00000100:00100000:2.0:1788572317.566885:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7712 00000100:00100000:2.0:1788572317.566891:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584341120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.566914:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584341120:12345-0@lo:400:kworker.0 Request processed in 24us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.566919:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7712 00000100:00100000:2.0:1788572317.566935:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584341248 00000100:00100000:2.0:1788572317.566939:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584341248 00000100:00100000:2.0:1788572317.566956:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584340352 00000100:00100000:2.0:1788572317.566959:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584340352 00000100:00100000:2.0:1788572317.566969:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584340864 00000100:00100000:2.0:1788572317.566972:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584340864 00000100:00100000:2.0:1788572317.566981:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584341376 00000100:00100000:2.0:1788572317.566983:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584341376 00000100:00100000:2.0:1788572317.566993:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584340480 00000100:00100000:2.0:1788572317.566995:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584340480 00000100:00100000:2.0:1788572317.567006:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584341504 00000100:00100000:2.0:1788572317.567009:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584341504 00000100:00100000:2.0:1788572317.567020:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788572317.567026:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584341248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567056:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584341248:12345-0@lo:400:kworker.0 Request processed in 29us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.567062:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788572317.567074:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788572317.567079:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584340352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567107:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584340352:12345-0@lo:400:kworker.0 Request processed in 28us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.567112:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788572317.567121:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788572317.567126:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584340864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567149:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584340864:12345-0@lo:400:kworker.0 Request processed in 23us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.567155:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788572317.567164:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788572317.567168:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584341376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567193:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584341376:12345-0@lo:400:kworker.0 Request processed in 24us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.567199:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788572317.567208:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788572317.567212:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584340480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567237:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584340480:12345-0@lo:400:kworker.0 Request processed in 24us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.567242:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788572317.567252:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788572317.567257:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584341504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567279:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584341504:12345-0@lo:400:kworker.0 Request processed in 22us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.567283:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788572317.567353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584340608:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567367:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584341120:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567376:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584340480:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567384:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705665 gen 2 00000100:00080000:0.0:1788572317.567385:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572317.567399:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572317.567399:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584340992:0@lo:400:kworker.0 00000100:00080000:0.0:1788572317.567402:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572317.567409:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584341504:0@lo:400:kworker.0 00010000:00080000:2.0:1788572317.567441:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e590a84b100 x1875444584340352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572317.567452:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584340352:0@lo:400:kworker.0 00010000:00080000:2.0:1788572317.567461:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1ffab100 x1875444584340864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572317.567469:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584340864:0@lo:400:kworker.0 00010000:00080000:2.0:1788572317.567498:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36efaa00 x1875444584341376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572317.567507:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584341376:0@lo:400:kworker.0 00000100:00100000:2.0:1788572317.567518:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584340736:0@lo:400:kworker.0 00010000:00080000:2.0:1788572317.567526:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36ef9f80 x1875444584341248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572317.567534:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584341248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572317.567798:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584340224 00000100:00100000:1.0:1788572317.567804:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584340224 00000100:00100000:1.0:1788572317.567834:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788572317.567840:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584340224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572317.567883:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584340224:12345-0@lo:400:kworker.0 Request processed in 43us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572317.567889:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788572317.568014:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584340224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572317.577060:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572317.577092:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584341632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572317.577173:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572317.577287:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584341632 00000100:00100000:0.0:1788572317.577297:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584341632 00000100:00100000:0.0:1788572317.577367:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6306 00000100:00100000:0.0:1788572317.577377:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584341632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572317.577409:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572317.577470:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584341632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572317.577505:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6306 00000100:00100000:3.0:1788572317.577683:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584341632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572317.695529:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572317.695617:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569491328 00000100:00100000:2.0:1788572317.695627:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569491328 00000100:00100000:2.0:1788572317.695704:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1030 00000100:00100000:2.0:1788572317.695716:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161129:x1875444569491328:12345-192.168.202.57@tcp:101:touch.0 00010000:00010000:2.0:1788572317.695739:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572317.695780:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bddff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb320 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572317.695859:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bde06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572317.695873:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bde06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572317.695887:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bde06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572317.695949:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572317.695953:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572317.695988:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bde06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572317.696023:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bddff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb320 expref: 7 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572317.696042:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bde06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb320 expref: 6 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572317.696051:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a08147400) 00010000:00010000:2.0:1788572317.696054:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572317.696058:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4200, rc 0) 00000100:00100000:2.0:1788572317.696119:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161129:x1875444569491328:12345-192.168.202.57@tcp:101:touch.0 Request processed in 405us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572317.696130:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1030 00000100:00080000:3.0:1788572317.697355:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572317.703033:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572317.703089:0:188058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569491456 00000100:00100000:0.0:1788572317.703099:0:188058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569491456 00000100:00100000:0.0:1788572317.703156:0:188058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1 00000100:00100000:0.0:1788572317.703167:0:188058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161129:x1875444569491456:12345-192.168.202.57@tcp:700:touch.0 00000100:00100000:0.0:1788572317.703245:0:188058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161129:x1875444569491456:12345-192.168.202.57@tcp:700:touch.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572317.703254:0:188058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1 00000100:00100000:1.0:1788572317.718166:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572317.718287:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569491712 00000100:00100000:3.0:1788572317.718297:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569491712 00000100:00100000:3.0:1788572317.718385:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1031 00000100:00100000:3.0:1788572317.718397:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161129:x1875444569491712:12345-192.168.202.57@tcp:101:touch.0 00010000:00010000:3.0:1788572317.718421:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572317.718425:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788572317.718455:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bde06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb320 expref: 6 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.718474:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a08147400) 00010000:00010000:3.0:1788572317.718708:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572317.718727:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde0d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb327 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.719177:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.719192:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.719202:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.719215:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.719222:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.719229:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572317.719724:0:188050:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x19e3:0x0], count =63 00000004:00080000:3.0:1788572317.719733:0:188050:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x19e3:0x0]+63 in llog 00000004:00080000:3.0:1788572317.719749:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1a22:0x0], index 0: 0 00010000:00010000:3.0:1788572317.720365:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde22 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720377:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde22 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720386:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde22 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720425:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720433:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720439:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720446:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572317.720450:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720458:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720469:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b478a00) 00010000:00010000:3.0:1788572317.720472:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572317.720707:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720717:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572317.720739:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000596b9f7 reply state 000000000ad4c21c transno 343597383681 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720802:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.720812:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8e590b478300) 00010000:00010000:3.0:1788572317.721125:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572317.721129:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572317.721167:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde0d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb327 expref: 8 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.721188:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde22 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb327 expref: 7 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.721195:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x1:0x0].0x0 (ffff8e590b478200) 00010000:00010000:3.0:1788572317.721197:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572317.721199:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616e200, rc 0) 00000100:00100000:3.0:1788572317.721317:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:161129:x1875444569491712:12345-192.168.202.57@tcp:101:touch.0 Request processed in 2922us (3159us total) trans 343597383681 rc 0/0 00000100:00100000:3.0:1788572317.721326:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1031 00000100:00100000:3.0:1788572317.736289:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572317.736382:0:188060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569491840 00000100:00100000:1.0:1788572317.736392:0:188060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569491840 00000100:00100000:1.0:1788572317.736461:0:188060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4 00000100:00100000:1.0:1788572317.736472:0:188060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161129:x1875444569491840:12345-192.168.202.57@tcp:900:touch.0 00000100:00100000:1.0:1788572317.736581:0:188060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161129:x1875444569491840:12345-192.168.202.57@tcp:900:touch.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572317.736588:0:188060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4 00000100:00080000:3.0:1788572317.736828:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572317.743418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572317.743555:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569492096 00000100:00100000:3.0:1788572317.743567:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569492096 00000100:00100000:3.0:1788572317.743625:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1032 00000100:00100000:3.0:1788572317.743635:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:161129:x1875444569492096:12345-192.168.202.57@tcp:36:touch.0 00010000:00010000:3.0:1788572317.743690:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572317.743718:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde22 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb327 expref: 8 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.743737:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x1:0x0].0x0 (ffff8e590b478200) 00010000:00010000:3.0:1788572317.743747:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572317.744002:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.744017:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.744029:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572317.744133:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000797673cc reply state 000000005bc04dbc transno 343597383682 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.744146:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.744152:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x1:0x0].0x0 (ffff8e590b478a00) 00010000:00010000:3.0:1788572317.744155:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572317.744157:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572317.744956:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161129:x1875444569492096:12345-192.168.202.57@tcp:36:touch.0 Request processed in 1318us (1544us total) trans 343597383682 rc 0/0 00000100:00100000:3.0:1788572317.744966:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1032 00000100:00100000:0.0:1788572317.754898:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572317.755087:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569492224 00000100:00100000:3.0:1788572317.755097:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569492224 00000100:00100000:3.0:1788572317.755158:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1033 00000100:00100000:3.0:1788572317.755170:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161129:x1875444569492224:12345-192.168.202.57@tcp:101:touch.0 00010000:00010000:3.0:1788572317.755191:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572317.755210:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde37 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb32e expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.755271:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde37 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb32e expref: 10 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.755287:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde37 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb32e expref: 10 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.755306:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x1:0x0].0x0 (ffff8e590b478a00) 00010000:00010000:3.0:1788572317.755309:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572317.755313:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616e400, rc 0) 00000100:00100000:3.0:1788572317.755380:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:161129:x1875444569492224:12345-192.168.202.57@tcp:101:touch.0 Request processed in 211us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572317.755387:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1033 00000100:00100000:3.0:1788572317.758390:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572317.759046:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569492352 00000100:00100000:1.0:1788572317.759057:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569492352 00000100:00100000:1.0:1788572317.759136:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22651 00000100:00100000:1.0:1788572317.759147:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569492352:12345-192.168.202.57@tcp:2:touch.0 00000100:00100000:1.0:1788572317.759382:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569492352:12345-192.168.202.57@tcp:2:touch.0 Request processed in 236us (1001us total) trans 38654705666 rc 0/0 00000100:00100000:1.0:1788572317.759391:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22651 00000100:00080000:0.0:1788572317.760957:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572317.770414:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572317.770677:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569492608 00000100:00100000:2.0:1788572317.770688:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569492608 00000100:00100000:2.0:1788572317.770741:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4 00000100:00100000:2.0:1788572317.770752:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:161129:x1875444569492608:12345-192.168.202.57@tcp:35:touch.0 00000100:00100000:2.0:1788572317.771212:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:161129:x1875444569492608:12345-192.168.202.57@tcp:35:touch.0 Request processed in 461us (806us total) trans 343597383683 rc 0/0 00000100:00100000:2.0:1788572317.771221:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4 00000100:00100000:3.0:1788572317.792513:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572317.792646:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569492736 00000100:00100000:3.0:1788572317.792655:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569492736 00000100:00100000:3.0:1788572317.792708:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1034 00000100:00100000:3.0:1788572317.792718:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:161130:x1875444569492736:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572317.792741:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572317.792774:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f600/0x265cfe11109bde3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb335 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.792846:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.792861:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.792873:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572317.793052:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1788572317.793056:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572317.793098:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.793136:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f600/0x265cfe11109bde3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb335 expref: 13 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.793155:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb335 expref: 12 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.793164:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b478200) 00010000:00010000:3.0:1788572317.793166:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572317.793170:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616e200, rc 0) 00000100:00100000:3.0:1788572317.793227:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:161130:x1875444569492736:12345-192.168.202.57@tcp:101:rm.0 Request processed in 511us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572317.793235:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1034 00000100:00100000:3.0:1788572317.798096:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572317.798149:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569492864 00000100:00100000:3.0:1788572317.798160:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569492864 00000100:00100000:3.0:1788572317.798219:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1035 00000100:00100000:3.0:1788572317.798230:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:161130:x1875444569492864:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572317.798251:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572317.798273:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f800/0x265cfe11109bde4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb33c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.798343:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.798370:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.798382:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.798394:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.798401:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.798408:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.798521:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bde61 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.798530:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bde61 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800150:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bde61 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572317.800201:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x1:0x0]: returning size 0 00000004:00200000:3.0:1788572317.800206:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572317.800224:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bde61 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800238:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bde61 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800247:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800254:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800261:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800267:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572317.800272:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800280:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800291:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b478200) 00010000:00010000:3.0:1788572317.800295:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572317.800299:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800306:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bde53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800323:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800330:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800336:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800341:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572317.800344:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800362:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800368:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8e590b478300) 00010000:00010000:3.0:1788572317.800370:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572317.800373:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800379:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bde5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800412:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f800/0x265cfe11109bde4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb33c expref: 14 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800427:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bde61 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb33c expref: 13 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.800442:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x1:0x0].0x0 (ffff8e590b478a00) 00010000:00010000:3.0:1788572317.800444:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572317.800447:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670200, rc 0) 00000100:00100000:3.0:1788572317.800663:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:161130:x1875444569492864:12345-192.168.202.57@tcp:101:rm.0 Request processed in 2434us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572317.800674:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1035 00000100:00100000:1.0:1788572317.811575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572317.813469:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569492992 00000100:00100000:3.0:1788572317.813504:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569492992 00000100:00100000:3.0:1788572317.813576:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22652 00000100:00100000:3.0:1788572317.813586:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569492992:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572317.813605:0:179391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572317.813625:0:179391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb343 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572317.813651:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a22:0x0] initial LVB size: 0, mtime: 0x6a9b729e, atime: 0x6a9b729e, ctime: 0x6a9b729e, blocks: 0x0 00010000:00010000:3.0:1788572317.813671:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a22:0x0].0x0 since=9070s v=(0 0) 00010000:00010000:3.0:1788572317.813676:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572317.813686:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb343 expref: 7 pid: 179391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.813707:0:179391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb343 expref: 7 pid: 179391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572317.813719:0:179391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671600, rc 0) 00000100:00100000:3.0:1788572317.813800:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2397:x1875444569492992:12345-192.168.202.57@tcp:101:rm.0 Request processed in 215us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572317.813808:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22652 00000100:00100000:3.0:1788572317.831054:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572317.831194:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569493248 00000100:00100000:0.0:1788572317.831204:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569493248 00000100:00100000:0.0:1788572317.831263:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1036 00000100:00100000:0.0:1788572317.831274:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:161130:x1875444569493248:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572317.831330:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788572317.831368:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670200/0x265cfe11109bde61 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb33c expref: 13 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831392:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e400/0x265cfe11109bde37 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb32e expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831405:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x1:0x0].0x0 (ffff8e590b478a00) 00010000:00010000:0.0:1788572317.831415:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e200/0x265cfe11109bde45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb335 expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831423:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b478200) 00010000:00010000:0.0:1788572317.831431:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572317.831455:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831468:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831510:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831524:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831532:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831549:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831645:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 3/0,1 mode: --/EX res: [0x200027501:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831654:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831662:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572317.831887:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x140:0x0].2, 64 off8320 00000004:00080000:0.0:1788572317.831897:0:188048:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 9070826416915ns, next at 9071826414583ns, rc = 0 00010000:00010000:0.0:1788572317.831964:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831973:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831980:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831987:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.831997:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832003:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832026:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572317.832047:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832054:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832060:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832066:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572317.832070:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832078:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832086:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x1:0x0].0x0 (ffff8e590b478a00) 00010000:00010000:0.0:1788572317.832089:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572317.832093:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 2/0,0 mode: --/EX res: [0x200027501:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832099:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bde7d lrc: 0/0,0 mode: --/EX res: [0x200027501:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832121:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832127:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832132:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832137:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572317.832139:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832145:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832154:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a16272700) 00010000:00010000:0.0:1788572317.832157:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572317.832159:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832165:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bde6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572317.832178:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa363751 reply state 000000005e3a14b0 transno 343597383684 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832188:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832194:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8e590b478300) 00010000:00010000:0.0:1788572317.832197:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572317.832200:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572317.832271:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:161130:x1875444569493248:12345-192.168.202.57@tcp:36:rm.0 Request processed in 997us (1227us total) trans 343597383684 rc 0/0 00000100:00100000:0.0:1788572317.832279:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1036 00010000:00010000:0.0:1788572317.832309:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572317.832314:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832321:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572317.832324:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832330:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832339:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x1:0x0].0x0 (ffff8e590b478a00) 00010000:00010000:0.0:1788572317.832341:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572317.832344:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 1/0,0 mode: --/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832360:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bde84 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572317.832369:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572317.832370:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572317.832372:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572318.204742:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572319.230940:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572319.614510:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572319.614539:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584341760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572319.614622:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572319.614965:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584341760 00000100:00100000:1.0:1788572319.614975:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584341760 00000100:00100000:1.0:1788572319.615051:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6307 00000100:00100000:1.0:1788572319.615062:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584341760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572319.615102:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572319.615165:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584341760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572319.615180:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6307 00000100:00080000:0.0:1788572319.615251:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572319.616674:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584341760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572319.942998:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572319.943113:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569493376 00000100:00100000:1.0:1788572319.943124:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569493376 00000100:00100000:1.0:1788572319.943201:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1037 00000100:00100000:1.0:1788572319.943212:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:161158:x1875444569493376:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572319.943241:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572319.943269:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109bde8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb34a expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572319.943340:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce000/0x265cfe11109bde92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572319.943355:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce000/0x265cfe11109bde92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572319.943369:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce000/0x265cfe11109bde92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572319.943442:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572319.943446:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572319.943520:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce000/0x265cfe11109bde92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572319.943548:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109bde8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb34a expref: 14 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572319.943567:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce000/0x265cfe11109bde92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb34a expref: 13 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572319.943576:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabb00) 00010000:00010000:1.0:1788572319.943579:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572319.943583:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffce000, rc 0) 00000100:00100000:1.0:1788572319.943660:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:161158:x1875444569493376:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 450us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572319.943668:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1037 00000100:00080000:0.0:1788572319.943962:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572319.968302:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572319.971208:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569493504 00000100:00100000:0.0:1788572319.971226:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569493504 00000100:00100000:0.0:1788572319.971309:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1038 00000100:00100000:0.0:1788572319.971321:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:161158:x1875444569493504:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:0.0:1788572319.971364:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:0.0:1788572319.971466:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:161158:x1875444569493504:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 146us (3173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572319.971473:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1038 00000100:00100000:2.0:1788572319.975344:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572319.975527:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569493632 00000100:00100000:1.0:1788572319.975537:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569493632 00000100:00100000:1.0:1788572319.975611:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1039 00000100:00100000:1.0:1788572319.975622:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161158:x1875444569493632:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:1.0:1788572319.975660:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1788572319.975741:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161158:x1875444569493632:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 121us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572319.975748:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1039 00000100:00080000:0.0:1788572319.976964:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572319.986379:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572319.986518:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569493760 00000100:00100000:3.0:1788572319.986529:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569493760 00000100:00100000:3.0:1788572319.986608:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6308 00000100:00100000:3.0:1788572319.986619:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:161158:x1875444569493760:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572319.986655:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572319.986746:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:161158:x1875444569493760:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 128us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572319.986754:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6308 00000100:00080000:0.0:1788572319.986893:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572319.996980:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572319.997245:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569493888 00000100:00100000:1.0:1788572319.997257:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569493888 00000100:00100000:1.0:1788572319.997330:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6309 00000100:00100000:1.0:1788572319.997340:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161158:x1875444569493888:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:1.0:1788572319.997366:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572319.997439:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161158:x1875444569493888:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 99us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572319.997447:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6309 00000100:00080000:0.0:1788572319.997811:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572320.111255:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572320.114570:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569494016 00000100:00100000:0.0:1788572320.114583:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569494016 00000100:00100000:0.0:1788572320.114660:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 99 00000100:00100000:0.0:1788572320.114668:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569494016:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572320.114745:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569494016:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 77us (3502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572320.114752:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 99 00010000:00010000:1.0:1788572320.254179:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572321.277777:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572321.660892:0:194092:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 9074655410016ns, next at 9075655407030ns, rc = 0 00000100:00100000:3.0:1788572321.660918:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572321.661373:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2722b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584341888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572321.661440:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572321.661542:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584341888 00000100:00100000:3.0:1788572321.661551:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584341888 00000100:00100000:3.0:1788572321.661681:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6310 00000100:00100000:3.0:1788572321.661691:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584341888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572321.661723:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572321.661772:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584341888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572321.661780:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6310 00000100:00080000:3.0:1788572321.661805:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572321.661841:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2722b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584341888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572321.671522:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572321.671547:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584342016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572321.671626:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572321.671684:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584342016 00000100:00100000:0.0:1788572321.671691:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584342016 00000100:00100000:0.0:1788572321.671743:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6311 00000100:00100000:0.0:1788572321.671750:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584342016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572321.671771:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572321.671809:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584342016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572321.671815:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6311 00000100:00100000:0.0:1788572321.671860:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584342016:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788572321.671895:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572322.172829:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584342144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572322.172910:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572322.173162:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584342144 00000100:00100000:0.0:1788572322.173171:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584342144 00000100:00100000:0.0:1788572322.173231:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788572322.173251:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584342144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572322.173295:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1788572322.173345:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584342144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572322.173352:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788572322.173594:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584342144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572322.175502:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584342272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572322.175697:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572322.175845:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584342272 00000100:00100000:0.0:1788572322.175852:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584342272 00000100:00100000:0.0:1788572322.175908:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788572322.175919:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584342272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572322.175973:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:0.0:1788572322.176724:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584342272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 795us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572322.176734:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1788572322.176906:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584342272:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788572322.300815:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572322.687733:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572322.687757:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584342400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572322.687827:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572322.687943:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584342400 00000100:00100000:0.0:1788572322.687952:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584342400 00000100:00100000:0.0:1788572322.688025:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6312 00000100:00100000:0.0:1788572322.688036:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584342400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572322.688067:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572322.688118:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584342400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572322.688125:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6312 00000100:00100000:0.0:1788572322.688175:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584342400:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788572322.688246:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572322.690931:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584342912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.690997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572322.691031:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584343424:0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691056:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572322.691079:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572322.691086:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584342784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691107:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572322.691128:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584343296:0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691149:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572322.691178:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584342912 00000100:00100000:1.0:1788572322.691185:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584342912 00000100:00100000:1.0:1788572322.691220:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584343296 00000100:00100000:1.0:1788572322.691222:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584343296 00000100:00100000:1.0:1788572322.691237:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7713 00000100:00100000:1.0:1788572322.691243:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584342912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691289:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584342912:12345-0@lo:400:kworker.0 Request processed in 44us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572322.691296:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7713 00000100:00100000:1.0:1788572322.691309:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7714 00000100:00100000:1.0:1788572322.691314:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584343296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691338:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584343296:12345-0@lo:400:kworker.0 Request processed in 24us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572322.691343:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7714 00000100:00100000:1.0:1788572322.691359:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584343424 00000100:00100000:1.0:1788572322.691362:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584343424 00000100:00100000:1.0:1788572322.691382:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584342784 00000100:00100000:1.0:1788572322.691384:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584342784 00000100:00100000:1.0:1788572322.691405:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788572322.691410:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584343424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691432:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584343424:12345-0@lo:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572322.691438:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788572322.691449:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788572322.691454:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584342784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691474:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584342784:12345-0@lo:400:kworker.0 Request processed in 21us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572322.691521:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:1.0:1788572322.691544:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572322.691569:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584342784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691577:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584343296:0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691584:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584342912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.691594:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584343424:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.691720:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584342528:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.691753:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572322.691799:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584343040:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.691819:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572322.691834:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584343552:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.691853:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572322.691874:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572322.691880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584342656:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.691899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572322.691915:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584343168:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.691934:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572322.691953:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584343680:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.691974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572322.691994:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584343552 00000100:00100000:3.0:1788572322.691997:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584343552 00000100:00100000:3.0:1788572322.692024:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584342656 00000100:00100000:3.0:1788572322.692027:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584342656 00000100:00100000:3.0:1788572322.692041:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584343168 00000100:00100000:3.0:1788572322.692043:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584343168 00000100:00100000:3.0:1788572322.692055:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584343680 00000100:00100000:3.0:1788572322.692057:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584343680 00000100:00100000:3.0:1788572322.692071:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788572322.692077:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584343552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.692113:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584343552:12345-0@lo:400:kworker.0 Request processed in 36us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572322.692119:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788572322.692133:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788572322.692139:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584342656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.692165:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584342656:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572322.692170:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788572322.692181:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788572322.692187:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584343168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.692212:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584343168:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572322.692218:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788572322.692227:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788572322.692232:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584343680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.692261:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584343680:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572322.692267:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:3.0:1788572322.692283:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572322.692286:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572322.692306:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584342656:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.692316:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584343168:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.692326:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584343680:0@lo:400:kworker.0 00000100:00100000:3.0:1788572322.692335:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584343552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572322.692436:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584343040 00000100:00100000:0.0:1788572322.692441:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584343040 00000100:00100000:0.0:1788572322.692527:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7715 00000100:00100000:0.0:1788572322.692535:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584343040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572322.692577:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584343040:12345-0@lo:400:kworker.0 Request processed in 44us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572322.692583:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7715 00000100:00100000:0.0:1788572322.692621:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584343040:0@lo:400:kworker.0 00000100:00080000:3.0:1788572322.692975:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572322.693031:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584342528 00000100:00100000:1.0:1788572322.693036:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584342528 00000100:00100000:1.0:1788572322.693076:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788572322.693083:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584342528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572322.693133:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584342528:12345-0@lo:400:kworker.0 Request processed in 51us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572322.693140:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788572322.693256:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584342528:0@lo:400:kworker.0 00010000:00010000:2.0:1788572323.326315:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572323.716116:0:194073:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788572323.716154:0:194073:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383684 is committed 00000004:00080000:3.0:1788572323.716162:0:194073:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788572323.716582:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.716597:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.716605:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.716612:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572323.716618:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.716628:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.716649:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8e590b478300) 00010000:00010000:2.0:1788572323.716653:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572323.716660:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.716667:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e800/0x265cfe11109bde1b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.716689:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717377:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 2/0,0 mode: TXN/TXN res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717388:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717393:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572323.717397:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717404:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 4/0,0 mode: TXN/TXN res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717417:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x1:0x0].0x0 (ffff8e590b478a00) 00010000:00010000:2.0:1788572323.717419:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572323.717423:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 2/0,0 mode: --/TXN res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717429:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109bde30 lrc: 0/0,0 mode: --/TXN res: [0x200027501:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717463:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717469:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717475:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717518:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572323.717521:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717526:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717535:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8e590b478300) 00010000:00010000:2.0:1788572323.717537:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572323.717540:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.717545:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bde76 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572323.717960:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584343808:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572323.718033:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1788572323.718548:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705666 is committed 00000100:00100000:1.0:1788572323.718797:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584343808 00000100:00100000:1.0:1788572323.718806:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584343808 00000100:00100000:1.0:1788572323.718878:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22653 00000100:00100000:1.0:1788572323.718889:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584343808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572323.718922:0:41719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6690 count 1 00010000:00010000:1.0:1788572323.718949:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572323.718972:0:41719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb343 expref: 5 pid: 179391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572323.718981:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a22:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1788572323.718985:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572323.718990:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572323.719020:0:41719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb343 expref: 5 pid: 179391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572323.719034:0:41719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb343 expref: 5 pid: 179391 timeout: 9176 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572323.719049:0:41719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:41719:1875444584343936:192.168.202.57@tcp:104: 00000100:00100000:1.0:1788572323.719130:0:41719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a115c9900 going to sleep for 11 seconds 00000100:00080000:2.0:1788572323.719618:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572323.731386:0:41719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:41719:1875444584343936:192.168.202.57@tcp:104: 00010000:00010000:1.0:1788572323.731419:0:41719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572323.750434:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572323.757034:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569494144 00000100:00100000:2.0:1788572323.757053:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569494144 00010000:00010000:2.0:1788572323.757133:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb343 expref: 6 pid: 179391 timeout: 9176 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572323.757183:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12900 00000100:00100000:2.0:1788572323.757193:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a04f37050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569494144:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00080000:3.0:1788572323.757301:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572323.757392:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572323.757401:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb343 expref: 6 pid: 179391 timeout: 9176 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.757416:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb343 expref: 6 pid: 179391 timeout: 9176 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.757442:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015ea975b/0x265cfe11109bde68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1a22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb343 expref: 6 pid: 179391 timeout: 9176 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.757457:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572323.757462:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572323.757469:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.757549:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572323.757622:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572323.757686:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a04f37050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569494144:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 494us (7259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572323.757705:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12900 00010000:00010000:3.0:1788572323.762553:0:41719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572323.762575:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572323.762588:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572323.762602:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572323.766958:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572323.767195:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584343808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48304us (49158us total) trans 38654705667 rc 0/0 00000100:00100000:1.0:1788572323.767455:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22653 00010000:00010000:0.0:1788572323.768265:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572323.768277:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572323.768293:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572323.768298:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572323.768310:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572323.768331:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572323.768340:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000111bc2ec/0x265cfe11109bde99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572323.768372:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572323.768374:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572323.768376:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572323.770602:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a3f99ea00/2, rc 0, transno 38654705667 00000100:00100000:3.0:1788572323.770618:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584343808:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572324.348596:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572324.733587:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572324.733613:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584344064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572324.733690:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572324.733733:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584344064 00000100:00100000:0.0:1788572324.733741:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584344064 00000100:00100000:0.0:1788572324.733814:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6313 00000100:00100000:0.0:1788572324.733827:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584344064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572324.733859:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572324.733919:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584344064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572324.733927:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6313 00000100:00080000:2.0:1788572324.733999:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572324.734270:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584344064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572325.227996:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572325.228035:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572325.228076:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572325.228097:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572325.228133:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572325.228161:0:194080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569494272 00000100:00100000:0.0:1788572325.228172:0:194080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569494272 00000100:00100000:0.0:1788572325.228238:0:194080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 101 00000100:00100000:0.0:1788572325.228248:0:194080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569494272:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572325.228356:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569494656 00000100:00100000:1.0:1788572325.228361:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569494656 00000100:00100000:1.0:1788572325.228402:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569494784 00000100:00100000:1.0:1788572325.228406:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569494784 00000100:00100000:1.0:1788572325.228428:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7716 00000100:00100000:1.0:1788572325.228436:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569494656:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572325.228532:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569494656:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 96us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572325.228539:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7716 00000100:00100000:1.0:1788572325.228568:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7717 00000100:00100000:1.0:1788572325.228575:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569494784:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572325.228598:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569494784:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572325.228604:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7717 00000100:00080000:1.0:1788572325.228626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572325.228629:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572325.229431:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569494400 00000100:00100000:3.0:1788572325.229439:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569494400 00000100:00100000:3.0:1788572325.229515:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569494528 00000100:00100000:3.0:1788572325.229519:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569494528 00000100:00100000:3.0:1788572325.229545:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 301 00000100:00100000:3.0:1788572325.229565:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569494400:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572325.229609:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569494400:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 48us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572325.229617:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 301 00000100:00100000:3.0:1788572325.229633:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 302 00000100:00100000:3.0:1788572325.229640:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569494528:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572325.229665:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569494528:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572325.229671:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 302 00000100:00100000:1.0:1788572325.229894:0:194080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569494272:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 1647us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572325.229902:0:194080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 101 00000100:00080000:0.0:1788572325.231524:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572325.231533:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788572325.376744:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572326.396710:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572326.781013:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572326.781036:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584344192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572326.781119:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572326.781297:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584344192 00000100:00100000:2.0:1788572326.781305:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584344192 00000100:00100000:2.0:1788572326.781371:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6314 00000100:00100000:2.0:1788572326.781381:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584344192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572326.781408:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572326.781453:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584344192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572326.781459:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6314 00000100:00100000:2.0:1788572326.781527:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584344192:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788572326.781648:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572326.784572:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572326.784604:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584344320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572326.784672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572326.785253:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584344320 00000100:00100000:3.0:1788572326.785262:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584344320 00000100:00100000:3.0:1788572326.785336:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6315 00000100:00100000:3.0:1788572326.785346:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584344320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572326.785369:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00080000:0.0:1788572326.785390:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572326.785434:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584344320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572326.785441:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6315 00000100:00100000:0.0:1788572326.785448:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584344320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572327.292824:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572327.292850:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584344448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572327.292922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572327.292977:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584344448 00000100:00100000:2.0:1788572327.292984:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584344448 00000100:00100000:2.0:1788572327.293045:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1788572327.293054:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584344448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572327.293085:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446064128 avail 1299824640 00000100:00100000:2.0:1788572327.293129:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584344448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572327.293135:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1788572327.293178:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584344448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572327.299253:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584344576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572327.299325:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572327.299444:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584344576 00000100:00100000:1.0:1788572327.299452:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584344576 00000100:00100000:1.0:1788572327.299518:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1788572327.299527:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584344576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572327.299560:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1788572327.304031:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584344576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4495us (4694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572327.304051:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788572327.313688:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584344576:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572327.420894:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572327.805793:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584345088:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.805865:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572327.805898:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584345600:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.805920:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572327.805945:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788572327.805951:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584344960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.805974:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572327.805991:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584345472:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806010:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572327.806027:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584345984:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806046:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572327.806081:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584345088 00000100:00100000:2.0:1788572327.806089:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584345088 00000100:00100000:2.0:1788572327.806131:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584345600 00000100:00100000:2.0:1788572327.806136:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584345600 00000100:00100000:2.0:1788572327.806165:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584345472 00000100:00100000:2.0:1788572327.806168:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584345472 00000100:00100000:2.0:1788572327.806186:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7718 00000100:00100000:2.0:1788572327.806194:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584345088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806243:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584345088:12345-0@lo:400:kworker.0 Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572327.806250:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7718 00000100:00100000:2.0:1788572327.806271:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7719 00000100:00100000:2.0:1788572327.806278:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584345600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806304:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584345600:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572327.806311:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7719 00000100:00100000:2.0:1788572327.806323:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7720 00000100:00100000:2.0:1788572327.806330:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584345472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806355:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584345472:12345-0@lo:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572327.806361:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7720 00000100:00100000:2.0:1788572327.806385:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584344960 00000100:00100000:2.0:1788572327.806388:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584344960 00000100:00100000:2.0:1788572327.806416:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584345984 00000100:00100000:2.0:1788572327.806419:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584345984 00000100:00100000:2.0:1788572327.806437:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788572327.806442:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584344960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806468:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584344960:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572327.806474:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788572327.806520:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788572327.806526:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584345984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806553:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584345984:12345-0@lo:400:kworker.0 Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572327.806559:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:2.0:1788572327.806586:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572327.806591:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572327.806644:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584344960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806657:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584345472:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806664:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584345984:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806671:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584345088:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.806679:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584345600:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.806762:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584344832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.806796:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572327.806824:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584345344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.806844:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572327.806861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584345856:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.806880:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572327.806898:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572327.806904:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584344704:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.806930:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572327.806957:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584345216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.806979:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572327.806996:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584345728:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807016:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572327.807042:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584344704 00000100:00100000:1.0:1788572327.807045:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584344704 00000100:00100000:1.0:1788572327.807072:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788572327.807079:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584344704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807113:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584344704:12345-0@lo:400:kworker.0 Request processed in 35us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572327.807120:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788572327.807147:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584345216 00000100:00100000:1.0:1788572327.807151:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584345216 00000100:00100000:1.0:1788572327.807182:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7721 00000100:00100000:1.0:1788572327.807188:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584345216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807217:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584345216:12345-0@lo:400:kworker.0 Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572327.807222:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7721 00000100:00100000:1.0:1788572327.807242:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584344832 00000100:00100000:1.0:1788572327.807246:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584344832 00000100:00100000:1.0:1788572327.807263:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584345344 00000100:00100000:1.0:1788572327.807265:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584345344 00000100:00100000:1.0:1788572327.807276:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584345856 00000100:00100000:1.0:1788572327.807278:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584345856 00000100:00100000:1.0:1788572327.807287:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584345728 00000100:00100000:1.0:1788572327.807290:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584345728 00000100:00100000:1.0:1788572327.807301:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788572327.807307:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584344832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807334:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584344832:12345-0@lo:400:kworker.0 Request processed in 28us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572327.807340:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788572327.807351:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788572327.807357:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584345344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807380:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584345344:12345-0@lo:400:kworker.0 Request processed in 24us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572327.807386:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788572327.807397:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788572327.807402:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584345856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807423:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584345856:12345-0@lo:400:kworker.0 Request processed in 22us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572327.807428:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788572327.807438:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788572327.807443:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584345728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807467:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584345728:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572327.807472:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:1.0:1788572327.807517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572327.807520:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572327.807537:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584344704:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807549:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584345216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807560:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584345728:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807568:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584344832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807577:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584345344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572327.807585:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584345856:0@lo:400:kworker.0 00000100:00100000:2.0:1788572327.807857:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584346112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572327.807887:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572327.807966:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584346112 00000100:00100000:0.0:1788572327.807971:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584346112 00000100:00100000:0.0:1788572327.808009:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6316 00000100:00100000:0.0:1788572327.808016:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584346112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572327.808037:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572327.808210:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584346112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 195us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572327.808217:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6316 00000100:00100000:2.0:1788572327.808265:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584346112:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788572328.035239:0:195412:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80a: DNE: create remote dir, drop update rep from MDT0, fail MDT0 ========================================================== 21:38:47 (1788572327) 00000100:00100000:1.0:1788572328.173562:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572328.174088:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569494912 00000100:00100000:3.0:1788572328.174100:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569494912 00000100:00100000:3.0:1788572328.174165:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1040 00000100:00100000:3.0:1788572328.174175:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161750:x1875444569494912:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572328.174208:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572328.174232:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670400/0x265cfe11109bdea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb351 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.174298:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.174312:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.174325:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.174340:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.174347:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.174365:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175234:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175245:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175252:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175258:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572328.175262:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175270:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175284:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabb00) 00010000:00010000:3.0:1788572328.175286:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572328.175292:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175298:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175312:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175318:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175324:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175329:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572328.175332:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175338:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175344:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8e5a2449d600) 00010000:00010000:3.0:1788572328.175347:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572328.175441:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175449:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdeae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175525:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670400/0x265cfe11109bdea0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb351 expref: 7 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175535:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabb00) 00010000:00010000:3.0:1788572328.175537:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572328.175542:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670400/0x265cfe11109bdea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb351 expref: 7 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572328.175551:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670400, rc 0) 00000100:00100000:3.0:1788572328.175625:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161750:x1875444569494912:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1451us (2072us total) trans 0 rc 301/301 00000100:00100000:3.0:1788572328.175644:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1040 00000100:00080000:2.0:1788572328.176687:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572328.195163:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572328.195294:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569495168 00000100:00100000:2.0:1788572328.195305:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569495168 00000100:00100000:2.0:1788572328.195455:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1041 00000100:00100000:2.0:1788572328.195467:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161750:x1875444569495168:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1788572328.195556:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572328.195585:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce000/0x265cfe11109bde92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb34a expref: 6 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.195601:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabb00) 00010000:00010000:2.0:1788572328.195611:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572328.195697:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.195709:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.195722:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.195733:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.195739:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.195745:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203202:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203223:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203235:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572328.203252:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005864416 reply state 00000000d3c616fd transno 343597383685 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203262:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203270:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:2.0:1788572328.203273:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572328.203277:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788572328.203283:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788572328.203291:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203297:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203304:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203310:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572328.203314:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203322:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203332:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a08147500) 00010000:00010000:2.0:1788572328.203334:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572328.203338:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.203344:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109bdeb5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572328.204057:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005864416 reply state 00000000d3c616fd transno 343597383685 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.204071:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572328.204078:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8e5a08147100) 00010000:00010000:2.0:1788572328.204080:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572328.204083:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788572328.204929:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:161750:x1875444569495168:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 9456us (9766us total) trans 343597383685 rc 0/0 00000100:00100000:2.0:1788572328.204939:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1041 00010000:00010000:0.0:1788572328.446598:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572329.178651:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572329.178758:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569495296 00000100:00100000:0.0:1788572329.178770:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569495296 00000100:00100000:0.0:1788572329.178845:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1042 00000100:00100000:0.0:1788572329.178856:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:161770:x1875444569495296:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572329.178884:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572329.178916:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdeca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb358 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.178985:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bded1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.179000:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bded1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.179015:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bded1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572329.179063:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1788572329.179067:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572329.179089:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bded1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.179117:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdeca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb358 expref: 9 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.179137:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bded1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb358 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.179146:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a16272900) 00010000:00010000:0.0:1788572329.179149:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572329.179153:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1e00, rc 0) 00000100:00100000:0.0:1788572329.179208:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:161770:x1875444569495296:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 354us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572329.179216:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1042 00000100:00100000:0.0:1788572329.191570:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572329.191609:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569495424 00000100:00100000:0.0:1788572329.192728:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569495424 00000100:00100000:0.0:1788572329.194526:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1043 00000100:00100000:0.0:1788572329.194550:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:161770:x1875444569495424:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572329.194573:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572329.194598:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bded8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb35f expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194703:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194720:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194732:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194745:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194759:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194766:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194881:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bdeed lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194891:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bdeed lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194903:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bdeed lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572329.194945:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1788572329.194949:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572329.194970:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bdeed lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194983:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.194990:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195001:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195007:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572329.195012:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195020:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195033:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a16272900) 00010000:00010000:0.0:1788572329.195036:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572329.195041:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195047:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdedf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195062:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195068:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195074:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195079:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572329.195082:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195093:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195101:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8e5a08147100) 00010000:00010000:0.0:1788572329.195103:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572329.195106:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195112:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdee6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195141:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bded8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb35f expref: 10 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195156:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bdeed lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb35f expref: 9 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.195164:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:0.0:1788572329.195166:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788572329.195168:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1800, rc 0) 00000100:00100000:0.0:1788572329.196247:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161770:x1875444569495424:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1699us (4680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572329.200999:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572329.203545:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569495552 00000100:00100000:3.0:1788572329.203561:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569495552 00000100:00100000:0.0:1788572329.207745:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1043 00000100:00100000:3.0:1788572329.207887:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1044 00000100:00100000:3.0:1788572329.207911:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161770:x1875444569495552:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572329.207936:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572329.207961:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670400/0x265cfe11109bdef4 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb366 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208026:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 3/1,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208041:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208052:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208067:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208074:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208080:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208125:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208133:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 2/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208141:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208148:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572329.208152:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208161:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208173:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:3.0:1788572329.208176:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572329.208181:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208187:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdefb lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208197:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208204:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208209:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208214:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572329.208217:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208227:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208236:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0xf7117594 (ffff8e5a2449d600) 00010000:00010000:3.0:1788572329.208238:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572329.208240:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208246:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf02 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208281:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670400/0x265cfe11109bdef4 lrc: 1/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb366 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208291:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:3.0:1788572329.208293:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572329.208296:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670400/0x265cfe11109bdef4 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb366 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.208304:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670400, rc 0) 00000100:00100000:3.0:1788572329.208379:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161770:x1875444569495552:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 480us (7390us total) trans 0 rc 301/301 00000100:00100000:3.0:1788572329.208386:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1044 00000100:00100000:3.0:1788572329.223169:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572329.223976:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569495680 00000100:00100000:2.0:1788572329.223987:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569495680 00000100:00100000:2.0:1788572329.224041:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1045 00000100:00100000:2.0:1788572329.224053:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161770:x1875444569495680:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572329.224073:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572329.224095:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdf09 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb36d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.224163:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 3/1,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.224178:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.224191:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.224207:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225208:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225236:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225279:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225287:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 2/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225294:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225300:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572329.225305:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225313:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225325:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:2.0:1788572329.225328:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572329.225333:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225339:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf10 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225350:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225357:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225363:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225368:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572329.225371:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225377:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225383:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0xf7117594 (ffff8e5a08147c00) 00010000:00010000:2.0:1788572329.225386:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572329.225389:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225394:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf17 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225432:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdf09 lrc: 1/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb36d expref: 10 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225443:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:2.0:1788572329.225446:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572329.225450:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdf09 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb36d expref: 10 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.225459:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4600, rc 0) 00000100:00100000:2.0:1788572329.225558:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161770:x1875444569495680:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1507us (2397us total) trans 0 rc 301/301 00000100:00100000:2.0:1788572329.225567:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1045 00000100:00100000:0.0:1788572329.234399:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572329.234518:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569495808 00000100:00100000:2.0:1788572329.234529:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569495808 00000100:00100000:2.0:1788572329.234589:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1046 00000100:00100000:2.0:1788572329.234600:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161770:x1875444569495808:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572329.234625:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572329.234648:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5800/0x265cfe11109bdf1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb374 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.234738:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.234754:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.234766:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572329.234810:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1788572329.234814:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572329.234835:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.234877:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5800/0x265cfe11109bdf1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb374 expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.234896:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb374 expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572329.234905:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:2.0:1788572329.234908:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572329.234912:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5600, rc 0) 00000100:00100000:2.0:1788572329.234974:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:161770:x1875444569495808:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 375us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572329.234981:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1046 00000100:00100000:2.0:1788572329.242288:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572329.242612:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569496064 00000100:00100000:1.0:1788572329.242623:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569496064 00000100:00100000:1.0:1788572329.242701:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1047 00000100:00100000:1.0:1788572329.242713:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:161770:x1875444569496064:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572329.242739:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572329.242763:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bdf2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb37b expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572329.242888:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788572329.243001:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bdf2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb37b expref: 12 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.243016:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a16272900) 00010000:00010000:1.0:1788572329.243019:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572329.243026:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bdf2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb37b expref: 12 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.243038:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf600, rc 0) 00000100:00100000:1.0:1788572329.243106:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:161770:x1875444569496064:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 395us (830us total) trans 343597383686 rc 301/301 00000100:00100000:1.0:1788572329.243115:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1047 00000100:00100000:3.0:1788572329.246124:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572329.246263:0:188057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569496192 00000100:00100000:0.0:1788572329.246273:0:188057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569496192 00000100:00100000:0.0:1788572329.246351:0:188057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2 00000100:00100000:0.0:1788572329.246364:0:188057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161770:x1875444569496192:12345-192.168.202.57@tcp:700:lfs.0 00000100:00100000:0.0:1788572329.246445:0:188057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161770:x1875444569496192:12345-192.168.202.57@tcp:700:lfs.0 Request processed in 84us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572329.246453:0:188057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2 00000100:00080000:3.0:1788572329.246883:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572329.249294:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572329.249420:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569496448 00000100:00100000:3.0:1788572329.249430:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569496448 00000100:00100000:3.0:1788572329.249517:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1048 00000100:00100000:3.0:1788572329.249527:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161770:x1875444569496448:12345-192.168.202.57@tcp:36:lfs.0 00000100:00100000:3.0:1788572329.249680:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584346240:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572329.249736:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572329.249781:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572329.249966:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584346240 00000100:00100000:1.0:1788572329.249971:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584346240 00000100:00100000:1.0:1788572329.250006:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1788572329.250013:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584346240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788572329.250082:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584346240:12345-0@lo:1000:mdt00_000.0 Request processed in 69us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572329.250089:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1788572329.250132:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584346240:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788572329.250191:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584346368:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788572329.250231:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572329.250249:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572329.250263:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584346368 00000100:00100000:1.0:1788572329.250267:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584346368 00000100:00100000:1.0:1788572329.250289:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788572329.250296:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584346368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788572329.250380:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584346368:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572329.250387:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788572329.250412:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584346368:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788572329.250449:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584346496:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788572329.250499:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572329.250515:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572329.250527:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584346496 00000100:00100000:1.0:1788572329.250531:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584346496 00000100:00100000:1.0:1788572329.250554:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1788572329.250560:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584346496:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788572329.250632:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584346496:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (154us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572329.250639:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1788572329.250678:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584346496:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788572329.250731:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 3/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.250742:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 3/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.250752:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 3/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572329.250765:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584346624:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1788572329.250795:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572329.250809:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572329.250820:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584346624 00000100:00100000:1.0:1788572329.250824:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584346624 00000100:00100000:1.0:1788572329.251036:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1788572329.251047:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584346624:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1788572329.251058:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572329.251074:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bdf41 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdf3a expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.251098:0:189111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 2/0,1 mode: TXN/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.251110:0:189111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb374 expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.251120:0:189111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bdf41 lrc: 5/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.251145:0:189111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb374 expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.251158:0:189111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb374 expref: 10 pid: 188048 timeout: 9182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572329.251170:0:189111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:189111:1875444584346752:192.168.202.57@tcp:104: 00010000:00010000:1.0:1788572329.251253:0:189111:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1788572329.251281:0:189111:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788572329.251314:0:189111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129f00 going to sleep for 11 seconds 00000001:00080000:3.0:1788572329.257679:0:194073:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383686 is committed 00010000:00010000:1.0:1788572329.257763:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257776:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257784:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257790:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572329.257795:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257804:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257820:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8e5a08147100) 00010000:00010000:1.0:1788572329.257823:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572329.257828:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257834:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5a00/0x265cfe11109bdebc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257864:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257870:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 2/0,0 mode: TXN/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257875:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257879:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572329.257882:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257887:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 4/0,0 mode: TXN/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257894:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:1.0:1788572329.257896:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572329.257904:0:3627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bdf41 lrc: 3/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257915:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 2/0,0 mode: --/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572329.257920:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5e00/0x265cfe11109bdec3 lrc: 0/0,0 mode: --/TXN res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572329.271246:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572329.271289:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569496576 00000100:00100000:0.0:1788572329.271299:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569496576 00010000:00010000:0.0:1788572329.271341:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 5/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb374 expref: 8 pid: 188048 timeout: 9182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572329.271380:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12901 00000100:00100000:0.0:1788572329.271390:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2398:x1875444569496576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572329.271406:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572329.271413:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 5/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb374 expref: 8 pid: 188048 timeout: 9182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271428:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb374 expref: 8 pid: 188048 timeout: 9182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271451:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:0.0:1788572329.271459:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bdf41 lrc: 3/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271471:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bdf41 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271498:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bdf41 lrc: 4/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271539:0:8447:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bdf41 lrc: 4/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572329.271553:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8447:1875444584346880:0@lo:105: 00000100:00100000:0.0:1788572329.271602:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572329.271636:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049ef240 going to sleep for 11 seconds 00000100:00100000:0.0:1788572329.271674:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788572329.271685:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584346880 00000100:00100000:0.0:1788572329.271688:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584346880 00000100:00100000:0.0:1788572329.271717:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5396 00000100:00100000:0.0:1788572329.271724:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0efe9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8447:x1875444584346880:12345-0@lo:105: 00010000:00010000:0.0:1788572329.271734:0:6501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 4/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdf41 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271743:0:6501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 4/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdf41 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271762:0:6501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 4/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdf41 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271770:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bdf41 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271777:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 5/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bdf41 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271787:0:6501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 5/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bdf41 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572329.271802:0:6501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a1ffcf200) 00000100:00100000:0.0:1788572329.271837:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0efe9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8447:x1875444584346880:12345-0@lo:105: Request processed in 114us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572329.272007:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5396 00000100:00100000:0.0:1788572329.272082:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8447:1875444584346880:0@lo:105: 00010000:00010000:0.0:1788572329.272098:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572329.272137:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2398:x1875444569496576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 749us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572329.272144:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12901 00010000:00010000:3.0:1788572329.273421:0:189111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5600/0x265cfe11109bdf25 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb374 expref: 7 pid: 188048 timeout: 9182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572329.273439:0:189111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:189111:1875444584346752:192.168.202.57@tcp:104: 00010000:00010000:3.0:1788572329.273462:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bdf41 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.273471:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a08147f00) 00010000:00010000:3.0:1788572329.273474:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572329.273501:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf800, rc 0) 00000100:00100000:3.0:1788572329.273572:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:188048:x1875444584346624:12345-0@lo:101:mdt00_000.0 Request processed in 22527us (22776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572329.273579:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1788572329.273617:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584346624:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788572329.273631:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdf41 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572329.273649:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x2:0x0] 00010000:00010000:3.0:1788572329.273700:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.273711:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.273719:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572329.273736:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347008:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1788572329.273939:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572329.273966:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572329.273984:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584347008 00000100:00100000:3.0:1788572329.273989:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584347008 00000100:00100000:3.0:1788572329.274028:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1788572329.274037:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:188048:x1875444584347008:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788572329.274053:0:188054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572329.274068:0:188054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf4f lrc: 2/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdf48 expref: -99 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.274092:0:188054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf4f lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdf48 expref: 8 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.274106:0:188054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf4f lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdf48 expref: 8 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.274113:0:188054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0xf7117594 (ffff8e5a2449d100) 00010000:00010000:3.0:1788572329.274116:0:188054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572329.274118:0:188054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670600, rc 0) 00000100:00100000:3.0:1788572329.274151:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347008:12345-0@lo:101:mdt00_000.0 Request processed in 115us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572329.274157:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1788572329.274186:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347008:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788572329.274197:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdf4f expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572329.274207:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdf4f expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572329.274925:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x2:0x0] 00000100:00100000:3.0:1788572329.274965:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347136:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572329.275001:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572329.275025:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572329.275041:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584347136 00000100:00100000:3.0:1788572329.275045:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584347136 00000100:00100000:3.0:1788572329.275073:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1788572329.275081:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572329.275158:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347136:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572329.275165:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1788572329.275200:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347136:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572329.275721:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347264:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572329.275748:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572329.276973:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572329.277283:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584347264 00000100:00100000:2.0:1788572329.277295:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584347264 00000100:00100000:2.0:1788572329.277346:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1788572329.277354:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.277460:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347264:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (1711us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572329.277467:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1788572329.277532:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347264:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.277624:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347392:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.277674:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572329.277690:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5902252e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572329.277703:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584347392 00000100:00100000:2.0:1788572329.277706:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584347392 00000100:00100000:2.0:1788572329.277729:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1788572329.277735:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a70450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.277786:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a70450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347392:12345-0@lo:1000:mdt00_000.0 Request processed in 50us (111us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572329.277792:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1788572329.279615:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347392:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.279705:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347520:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.279785:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572329.279811:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5902252e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572329.279826:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584347520 00000100:00100000:2.0:1788572329.279831:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584347520 00000100:00100000:2.0:1788572329.281098:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1788572329.281112:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.281199:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347520:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572329.281206:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1788572329.294406:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347520:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.294523:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347648:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.294584:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572329.294611:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5902252e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572329.294631:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584347648 00000100:00100000:2.0:1788572329.294637:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584347648 00000100:00100000:2.0:1788572329.294697:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1788572329.294708:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.294793:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347648:12345-0@lo:1000:mdt00_000.0 Request processed in 87us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572329.294802:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1788572329.296380:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347648:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.296463:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347776:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.296535:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572329.296565:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5902252e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572329.296587:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584347776 00000100:00100000:2.0:1788572329.296591:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584347776 00000100:00100000:2.0:1788572329.296628:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1788572329.296637:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.296724:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347776:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572329.296735:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1788572329.296775:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347776:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.299028:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347904:0@lo:700:mdt00_000.0 00000100:00100000:2.0:1788572329.299087:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572329.299123:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5902252240 going to sleep for 11 seconds 00000100:00100000:0.0:1788572329.299984:0:188057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584347904 00000100:00100000:0.0:1788572329.299993:0:188057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584347904 00000100:00100000:0.0:1788572329.300049:0:188057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572329.300059:0:188057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347904:12345-0@lo:700:mdt00_000.0 00000100:00100000:0.0:1788572329.300136:0:188057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584347904:12345-0@lo:700:mdt00_000.0 Request processed in 78us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572329.300144:0:188057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788572329.300371:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584347904:0@lo:700:mdt00_000.0 00000100:00100000:2.0:1788572329.300525:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584348032:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.300561:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572329.300581:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590520c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788572329.300595:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584348032 00000100:00100000:2.0:1788572329.300599:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584348032 00000100:00100000:2.0:1788572329.300625:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1788572329.300633:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584348032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572329.300707:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584348032:12345-0@lo:1000:mdt00_000.0 Request processed in 75us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572329.300713:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1788572329.300741:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584348032:0@lo:1000:mdt00_000.0 00000040:00080000:2.0:1788572329.300815:0:188048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572329.300835:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].7, 64 off33216 00000004:00080000:2.0:1788572329.300844:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5902252240 with version 1 00000040:00080000:2.0:1788572329.303069:0:188048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572329.303087:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].8, 64 off33280 00000004:00080000:2.0:1788572329.303097:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5905220180 with version 2 00000040:00080000:2.0:1788572329.305176:0:188048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788572329.306971:0:188074:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e590639b300 version 1 rpc_version 1 00000020:00100000:3.0:1788572329.307015:0:188074:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572329.307026:0:188074:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cb9f80 x1875444584348288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572329.307052:0:188074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584348288:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572329.307125:0:188074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572329.307173:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 11 seconds 00000040:00080000:2.0:1788572329.308041:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].4, 64 off33024 00000040:00080000:2.0:1788572329.308398:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x24000272a:0x1:0x0].1, 1096 off33864 00000100:00100000:3.0:1788572329.309889:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584348288 00000100:00100000:3.0:1788572329.309902:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584348288 00000100:00100000:3.0:1788572329.309963:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1788572329.309975:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188074:x1875444584348288:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:2.0:1788572329.322422:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027502:0x1:0x0].1, 1240 off34008 00000004:00080000:2.0:1788572329.322445:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5902252a80 with version 3 00000001:00080000:2.0:1788572329.331370:0:194073:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383687 is committed 00010000:02000000:2.0:1788572329.331549:0:188053:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00010000:00020000:2.0:1788572329.343962:0:188053:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8e5a31cb8000 x1875444584348288/t343597383687(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:745/0 lens 1312/4320 e 0 to 0 dl 1788572340 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572329.377981:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188074:x1875444584348288:12345-0@lo:1000:osp_up0-1.0 Request processed in 67999us (70846us total) trans 343597383687 rc 0/0 00000100:00100000:2.0:1788572329.377998:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00010000:00010000:1.0:1788572329.468644:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788572329.860023:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705667 is committed 00000100:00100000:1.0:1788572329.862121:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584348416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572329.862204:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572329.862314:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584348416 00000100:00100000:2.0:1788572329.862322:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584348416 00000100:00100000:2.0:1788572329.862386:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6317 00000100:00100000:2.0:1788572329.862398:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584348416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572329.862428:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572329.862472:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584348416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572329.862504:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6317 00000100:00080000:3.0:1788572329.862672:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572329.862773:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584348416:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1788572330.033029:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837476 is committed 00000100:00100000:0.0:1788572330.108033:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572330.108811:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569496704 00000100:00100000:2.0:1788572330.108824:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569496704 00000100:00100000:2.0:1788572330.110115:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1049 00000100:00100000:2.0:1788572330.110134:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:161779:x1875444569496704:12345-192.168.202.57@tcp:41:lfs.0 00000100:00080000:0.0:1788572330.110334:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1788572330.110650:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445654528 avail 1299415040 00000100:00100000:2.0:1788572330.110749:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:161779:x1875444569496704:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 620us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572330.110757:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1049 00000100:00100000:0.0:1788572330.132739:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572330.135986:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569496832 00000100:00100000:3.0:1788572330.136003:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569496832 00000100:00100000:3.0:1788572330.137270:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1050 00000100:00100000:3.0:1788572330.137286:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161779:x1875444569496832:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572330.137323:0:188049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:3.0:1788572330.137408:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161779:x1875444569496832:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 126us (4680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572330.137416:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1050 00000100:00100000:2.0:1788572330.154911:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572330.162875:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569496960 00000100:00100000:1.0:1788572330.162893:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569496960 00000100:00100000:1.0:1788572330.162982:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6318 00000100:00100000:1.0:1788572330.162994:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161779:x1875444569496960:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:1.0:1788572330.163029:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572330.163109:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161779:x1875444569496960:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 117us (8208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572330.163117:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6318 00000100:00080000:3.0:1788572330.163376:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572330.189721:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572330.190282:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569497088 00000100:00100000:1.0:1788572330.190293:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569497088 00000100:00100000:1.0:1788572330.190359:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6319 00000100:00100000:1.0:1788572330.190369:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161779:x1875444569497088:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:1.0:1788572330.190400:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572330.190468:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:161779:x1875444569497088:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 100us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572330.190491:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6319 00000100:00080000:1.0:1788572330.190616:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572330.280949:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572330.281840:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569497344 00000100:00100000:2.0:1788572330.281853:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569497344 00000100:00100000:2.0:1788572330.281933:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1051 00000100:00100000:2.0:1788572330.281945:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:161786:x1875444569497344:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00010000:2.0:1788572330.282004:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572330.282033:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1e00/0x265cfe11109bded1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb358 expref: 7 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.282051:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a16272900) 00010000:00010000:2.0:1788572330.282064:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572330.283170:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283190:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283201:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283215:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283222:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283229:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283713:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283726:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283734:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283739:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572330.283743:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283763:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283775:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e59019b4500) 00010000:00010000:2.0:1788572330.283778:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572330.283783:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283788:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf56 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572330.283803:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000442f2af9 reply state 00000000b38d7155 transno 343597383688 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283814:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.283820:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e59019b4a00) 00010000:00010000:2.0:1788572330.283821:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572330.283824:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572330.284201:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:161786:x1875444569497344:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 2255us (3259us total) trans 343597383688 rc 0/0 00000100:00100000:2.0:1788572330.284211:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1051 00000100:00100000:1.0:1788572330.319980:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572330.320137:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569497472 00000100:00100000:3.0:1788572330.320147:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569497472 00000100:00100000:3.0:1788572330.320207:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1052 00000100:00100000:3.0:1788572330.320220:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:161789:x1875444569497472:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572330.320245:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572330.320269:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdf64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb382 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.320340:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bdf6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.320353:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bdf6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.320364:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bdf6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572330.320409:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1788572330.320413:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572330.320432:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bdf6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.320456:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01671400/0x265cfe11109bdf64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb382 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.320473:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bdf6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb382 expref: 9 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.320543:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a2449df00) 00010000:00010000:3.0:1788572330.320546:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572330.320550:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670e00, rc 0) 00000100:00100000:3.0:1788572330.320609:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161789:x1875444569497472:12345-192.168.202.57@tcp:101:rm.0 Request processed in 391us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572330.320616:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1052 00000100:00100000:0.0:1788572330.323021:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572330.323424:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569497600 00000100:00100000:2.0:1788572330.323433:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569497600 00000100:00100000:2.0:1788572330.323512:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1053 00000100:00100000:2.0:1788572330.323522:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:161789:x1875444569497600:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:0.0:1788572330.323579:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572330.323668:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdf72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb389 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.323751:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.323765:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.323776:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.323788:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.323796:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.323803:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.323978:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bdf87 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.323987:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bdf87 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.323995:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bdf87 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572330.324039:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x3:0x0]: returning size 0 00000004:00200000:0.0:1788572330.324044:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572330.324063:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bdf87 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324079:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bdf87 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324088:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324095:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324102:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324107:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572330.324111:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324119:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324131:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a2449df00) 00010000:00010000:0.0:1788572330.324135:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572330.324139:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324146:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0200/0x265cfe11109bdf79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324159:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324165:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324172:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324177:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572330.324180:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324187:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324194:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e59019b4a00) 00010000:00010000:0.0:1788572330.324197:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572330.324200:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324206:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1400/0x265cfe11109bdf80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324234:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109bdf72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb389 expref: 11 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324263:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bdf87 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb389 expref: 10 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572330.324271:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x3:0x0].0x0 (ffff8e5a0a4b7b00) 00010000:00010000:0.0:1788572330.324274:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572330.324277:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0000, rc 0) 00000100:00100000:0.0:1788572330.324347:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:161789:x1875444569497600:12345-192.168.202.57@tcp:101:rm.0 Request processed in 826us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572330.324370:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1053 00000100:00100000:0.0:1788572330.332132:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572330.332284:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569497856 00000100:00100000:1.0:1788572330.332295:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569497856 00000100:00100000:3.0:1788572330.332409:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1054 00000100:00100000:3.0:1788572330.332424:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:161789:x1875444569497856:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572330.332533:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788572330.332561:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109bdf87 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb389 expref: 10 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.332583:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x3:0x0].0x0 (ffff8e5a0a4b7b00) 00010000:00010000:3.0:1788572330.332601:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670e00/0x265cfe11109bdf6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb382 expref: 9 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.332611:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a2449df00) 00010000:00010000:3.0:1788572330.332617:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572330.332699:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.332715:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.332726:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.332739:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.332746:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.332864:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333020:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 3/0,1 mode: --/EX res: [0x200027501:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333029:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333035:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333233:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333244:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333252:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333259:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333265:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333271:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333295:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572330.333314:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333321:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333327:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333333:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572330.333336:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572330.333337:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.333342:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.333349:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572330.333350:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.333352:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.333358:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.333368:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x3:0x0].0x0 (ffff8e59019b4200) 00010000:00010000:3.0:1788572330.333371:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572330.333375:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 1/0,0 mode: --/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.333380:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4600/0x265cfe11109bdfa3 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572330.333391:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572330.333394:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572330.333396:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572330.333426:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x3:0x0].0x0 (ffff8e59019b4200) 00010000:00010000:2.0:1788572330.333429:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572330.333432:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 2/0,0 mode: --/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333438:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5200/0x265cfe11109bdf9c lrc: 0/0,0 mode: --/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333457:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333463:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333469:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333474:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572330.333513:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333520:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333528:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e59019b4500) 00010000:00010000:2.0:1788572330.333530:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572330.333534:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333544:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb5000/0x265cfe11109bdf8e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572330.333556:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007347477 reply state 0000000017d24da4 transno 343597383689 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333566:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572330.333573:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e59019b4a00) 00010000:00010000:2.0:1788572330.333575:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572330.333579:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572330.333676:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:161789:x1875444569497856:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1254us (1553us total) trans 343597383689 rc 0/0 00000100:00100000:2.0:1788572330.333684:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1054 00000100:00100000:1.0:1788572330.367645:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572330.367808:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569497984 00000100:00100000:2.0:1788572330.367819:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569497984 00000100:00100000:2.0:1788572330.367880:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 103 00000100:00100000:2.0:1788572330.367892:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569497984:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572330.367971:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569497984:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 81us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572330.367980:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 103 00010000:00010000:2.0:1788572330.492797:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572331.516797:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572331.901953:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572331.901982:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584348544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572331.902054:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572331.902105:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584348544 00000100:00100000:2.0:1788572331.902112:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584348544 00000100:00100000:2.0:1788572331.902171:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6320 00000100:00100000:2.0:1788572331.902188:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584348544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572331.902212:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572331.902255:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584348544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572331.902261:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6320 00000100:00080000:2.0:1788572331.902282:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572331.902310:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 2 00000004:00080000:2.0:1788572331.902315:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a3f99ea00, transno 38654705667 00000100:00100000:2.0:1788572331.902332:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584348544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572331.902615:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584348672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572331.902644:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572331.902679:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584348672 00000100:00100000:2.0:1788572331.902683:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584348672 00000100:00100000:2.0:1788572331.902714:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6321 00000100:00100000:2.0:1788572331.902721:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584348672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572331.902742:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572331.902775:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584348672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572331.902781:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6321 00000100:00080000:2.0:1788572331.902794:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572331.902813:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584348672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572332.418409:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584348800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572332.418506:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572332.419039:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584348800 00000100:00100000:1.0:1788572332.419047:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584348800 00000100:00100000:1.0:1788572332.419095:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788572332.419105:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3642:x1875444584348800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572332.419144:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445654528 avail 1299415040 00010000:00000080:1.0:1788572332.419160:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104ed80 x1875444584348800/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:748/0 lens 224/368 e 0 to 0 dl 1788572343 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572332.419207:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3642:x1875444584348800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572332.419214:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788572332.419261:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584348800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572332.421139:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572332.421156:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584348928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572332.421210:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572332.421264:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584348928 00000100:00100000:3.0:1788572332.421271:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584348928 00000100:00100000:3.0:1788572332.422056:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1788572332.422069:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584348928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572332.422105:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:3.0:1788572332.422167:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584348928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572332.422174:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1788572332.422255:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584348928:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788572332.540763:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572332.924624:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584349056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572332.924697:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572332.924753:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584349056 00000100:00100000:2.0:1788572332.924774:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584349056 00000100:00100000:2.0:1788572332.924838:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6322 00000100:00100000:2.0:1788572332.924849:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584349056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572332.924888:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572332.924932:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584349056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572332.924939:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6322 00000100:00080000:2.0:1788572332.924958:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572332.924993:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584349056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572332.925173:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584349312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.925205:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572332.925241:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584349824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.925263:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572332.925282:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584350336:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.925304:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572332.925321:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788572332.925327:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584349184:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.925353:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572332.925380:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584349696:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.925405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572332.925426:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584350208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.925446:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572332.925466:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584349312 00000100:00100000:3.0:1788572332.925470:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584349312 00000100:00100000:3.0:1788572332.925527:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584349824 00000100:00100000:3.0:1788572332.925531:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584349824 00000100:00100000:3.0:1788572332.925543:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584350336 00000100:00100000:3.0:1788572332.925546:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584350336 00000100:00100000:3.0:1788572332.925558:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584350208 00000100:00100000:3.0:1788572332.925560:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584350208 00000100:00100000:3.0:1788572332.925575:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788572332.925582:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584349312:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572332.925598:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a24c57800 x1875444584349312/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:748/0 lens 224/224 e 0 to 0 dl 1788572343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572332.925633:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584349312:12345-0@lo:400:kworker.0 Request processed in 52us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572332.925640:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788572332.925655:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788572332.925661:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584349824:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572332.925671:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a24c55180 x1875444584349824/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:748/0 lens 224/224 e 0 to 0 dl 1788572343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572332.925698:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584349824:12345-0@lo:400:kworker.0 Request processed in 37us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572332.925705:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788572332.925716:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788572332.925722:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584350336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.925748:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584350336:12345-0@lo:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572332.925755:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788572332.925786:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788572332.925792:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584350208:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572332.925802:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a407e2300 x1875444584350208/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:748/0 lens 224/224 e 0 to 0 dl 1788572343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572332.925829:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584350208:12345-0@lo:400:kworker.0 Request processed in 37us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572332.925835:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788572332.925858:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584349184 00000100:00100000:3.0:1788572332.925861:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584349184 00000100:00100000:3.0:1788572332.925890:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788572332.925897:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584349184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.925928:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584349184:12345-0@lo:400:kworker.0 Request processed in 31us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572332.925934:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788572332.925962:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584349696 00000100:00100000:3.0:1788572332.925965:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584349696 00000100:00100000:3.0:1788572332.925992:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7722 00000100:00100000:3.0:1788572332.925999:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584349696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.926030:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584349696:12345-0@lo:400:kworker.0 Request processed in 32us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572332.926037:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7722 00000100:00100000:3.0:1788572332.926064:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584349184:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.926076:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584349696:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.926087:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584350208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.926096:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584349312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.926104:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584349824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572332.926113:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584350336:0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.928621:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584349440:0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.928712:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572332.928742:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584349952:0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.928782:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572332.928812:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572332.928820:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584349568:0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.928843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572332.928860:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584350080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.928880:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572332.928910:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584349952 00000100:00100000:2.0:1788572332.928917:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584349952 00000100:00100000:2.0:1788572332.928976:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584349568 00000100:00100000:2.0:1788572332.928979:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584349568 00000100:00100000:2.0:1788572332.929008:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7723 00000100:00100000:2.0:1788572332.929019:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584349952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.929079:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584349952:12345-0@lo:400:kworker.0 Request processed in 62us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572332.929086:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7723 00000100:00100000:2.0:1788572332.929104:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7724 00000100:00100000:2.0:1788572332.929111:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584349568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.929139:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584349568:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572332.929145:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7724 00000100:00100000:2.0:1788572332.929172:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584349440 00000100:00100000:2.0:1788572332.929176:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584349440 00000100:00100000:2.0:1788572332.929204:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584350080 00000100:00100000:2.0:1788572332.929207:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584350080 00000100:00100000:2.0:1788572332.929220:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788572332.929226:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584349440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.929258:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584349440:12345-0@lo:400:kworker.0 Request processed in 33us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572332.929264:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788572332.929275:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788572332.929280:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584350080:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572332.929294:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a2746d880 x1875444584350080/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:748/0 lens 224/224 e 0 to 0 dl 1788572343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572332.929333:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584350080:12345-0@lo:400:kworker.0 Request processed in 53us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572332.929339:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:2.0:1788572332.929359:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572332.929364:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572332.929367:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572332.929412:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584349568:0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.929423:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584350080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.929433:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584349440:0@lo:400:kworker.0 00000100:00100000:2.0:1788572332.929442:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584349952:0@lo:400:kworker.0 00010000:00010000:1.0:1788572333.564851:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572334.596736:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572334.972775:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572334.972799:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584350464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572334.972880:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572334.972964:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584350464 00000100:00100000:2.0:1788572334.972983:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584350464 00000100:00100000:2.0:1788572334.973054:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6323 00000100:00100000:2.0:1788572334.973066:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584350464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572334.973098:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572334.973145:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584350464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572334.973152:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6323 00000100:00080000:1.0:1788572334.973273:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572334.973308:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584350464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572335.470978:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572335.471035:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572335.471069:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572335.471089:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572335.471111:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572335.471205:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569498368 00000100:00100000:2.0:1788572335.471217:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569498368 00000100:00100000:2.0:1788572335.471285:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569498240 00000100:00100000:2.0:1788572335.471288:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569498240 00000100:00100000:2.0:1788572335.471308:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 315 00000100:00100000:2.0:1788572335.471318:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569498368:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572335.471401:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569498368:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 84us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572335.471408:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 315 00000100:00100000:2.0:1788572335.471427:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 316 00000100:00100000:2.0:1788572335.471434:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:2397:x1875444569498240:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:2.0:1788572335.471455:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36a4ca80 x1875444569498240/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:751/0 lens 224/224 e 0 to 0 dl 1788572346 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.471519:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:2397:x1875444569498240:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 84us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572335.471525:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 316 00000100:00080000:0.0:1788572335.471713:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572335.471717:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572335.471800:0:194079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569498112 00000100:00100000:1.0:1788572335.471808:0:194079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569498112 00000100:00100000:1.0:1788572335.471870:0:194079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 105 00000100:00100000:1.0:1788572335.471882:0:194079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569498112:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572335.471931:0:194079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569498112:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 55us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572335.471943:0:194079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 105 00000100:00100000:1.0:1788572335.471985:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569498624 00000100:00100000:1.0:1788572335.471993:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569498624 00000100:00100000:1.0:1788572335.472046:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569498496 00000100:00100000:1.0:1788572335.472050:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569498496 00000100:00100000:1.0:1788572335.472074:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7725 00000100:00100000:1.0:1788572335.472081:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569498624:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572335.472118:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569498624:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 37us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572335.472128:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7725 00000100:00100000:1.0:1788572335.472144:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7726 00000100:00100000:1.0:1788572335.472151:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569498496:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572335.472184:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569498496:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572335.472190:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7726 00000100:00080000:3.0:1788572335.472459:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572335.472463:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572335.614044:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788572336.000546:0:194073:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383689 is committed 00010000:00010000:3.0:1788572336.000576:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000589:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000598:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000605:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572336.000611:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000620:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000639:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e59019b4a00) 00010000:00010000:3.0:1788572336.000642:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572336.000647:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000659:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4400/0x265cfe11109bdf5d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000679:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000686:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000692:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000698:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572336.000701:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000707:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000715:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e59019b4a00) 00010000:00010000:3.0:1788572336.000717:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572336.000721:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.000727:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4200/0x265cfe11109bdf95 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.637795:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572337.020760:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584350592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572337.020842:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572337.020972:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584350720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572337.021015:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572337.021091:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584350592 00000100:00100000:3.0:1788572337.021103:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584350592 00000100:00100000:3.0:1788572337.021165:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584350720 00000100:00100000:3.0:1788572337.021169:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584350720 00000100:00100000:3.0:1788572337.021192:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6324 00000100:00100000:3.0:1788572337.021202:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584350592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572337.021244:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572337.021322:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6325 00000100:00100000:2.0:1788572337.021331:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584350720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572337.021343:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572337.021380:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584350720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572337.021386:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6325 00000100:00080000:0.0:1788572337.030641:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572337.035614:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584350592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 14397us (14755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572337.035630:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6324 00000100:00100000:3.0:1788572337.037426:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584350720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572337.045421:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584350592:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788572337.221894:0:195856:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1788572337.532782:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584350848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572337.532856:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572337.533083:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584350848 00000100:00100000:0.0:1788572337.533092:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584350848 00000100:00100000:0.0:1788572337.533150:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1788572337.533161:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3642:x1875444584350848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572337.533195:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445654528 avail 1299415040 00010000:00000080:0.0:1788572337.533212:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fafc380 x1875444584350848/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:753/0 lens 224/368 e 0 to 0 dl 1788572348 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572337.533265:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3642:x1875444584350848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572337.533272:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788572337.533420:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584350848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572337.536313:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584350976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572337.536391:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572337.540751:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584350976 00000100:00100000:2.0:1788572337.540767:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584350976 00000100:00100000:2.0:1788572337.540868:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1788572337.540880:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584350976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572337.540929:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:2.0:1788572337.541033:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584350976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (4642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572337.541039:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1788572337.541129:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584350976:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788572337.661429:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572338.045468:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584351104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572338.045570:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.045806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584351360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.045840:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.045876:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584351872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.045933:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.045955:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584352384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.045976:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.045998:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788572338.046003:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584351232:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.046060:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584351744:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046081:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.046115:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584352256:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.046168:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584351360 00000100:00100000:3.0:1788572338.046176:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584351360 00000100:00100000:3.0:1788572338.046231:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584352384 00000100:00100000:3.0:1788572338.046235:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584352384 00000100:00100000:3.0:1788572338.046255:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788572338.046264:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584351360:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572338.046292:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cba680 x1875444584351360/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1788572349 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572338.046339:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584351360:12345-0@lo:400:kworker.0 Request processed in 75us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.046346:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788572338.046364:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788572338.046370:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584352384:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572338.046380:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a805880 x1875444584352384/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1788572349 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572338.046408:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584352384:12345-0@lo:400:kworker.0 Request processed in 38us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.046414:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788572338.046432:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584351872 00000100:00100000:3.0:1788572338.046436:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584351872 00000100:00100000:3.0:1788572338.046465:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584351744 00000100:00100000:3.0:1788572338.046467:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584351744 00000100:00100000:3.0:1788572338.046508:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584352256 00000100:00100000:3.0:1788572338.046512:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584352256 00000100:00100000:3.0:1788572338.046532:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7727 00000100:00100000:3.0:1788572338.046539:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584351872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046571:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584351872:12345-0@lo:400:kworker.0 Request processed in 33us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.046577:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7727 00000100:00100000:3.0:1788572338.046589:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7728 00000100:00100000:3.0:1788572338.046596:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584351744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046628:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584351744:12345-0@lo:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.046633:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7728 00000100:00100000:3.0:1788572338.046644:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7729 00000100:00100000:3.0:1788572338.046651:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584352256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046679:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584352256:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.046685:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7729 00000100:00100000:3.0:1788572338.046707:0:194078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584351232 00000100:00100000:3.0:1788572338.046711:0:194078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584351232 00000100:00100000:3.0:1788572338.046736:0:194078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788572338.046742:0:194078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584351232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046773:0:194078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584351232:12345-0@lo:400:kworker.0 Request processed in 32us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.046778:0:194078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788572338.046830:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584351232:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046843:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584351744:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046852:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584352256:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046861:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584351360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046869:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584351872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046877:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584352384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046947:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584351616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.046977:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.047003:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584352128:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047027:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.047047:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584352640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047068:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.047088:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788572338.047095:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584351488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047115:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.047133:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584352000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047151:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.047168:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584352512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047187:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.047208:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584351616 00000100:00100000:3.0:1788572338.047212:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584351616 00000100:00100000:3.0:1788572338.047237:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584352128 00000100:00100000:3.0:1788572338.047240:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584352128 00000100:00100000:3.0:1788572338.047253:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1788572338.047259:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584351616:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572338.047274:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a807800 x1875444584351616/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1788572349 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572338.047308:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584351616:12345-0@lo:400:kworker.0 Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.047313:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1788572338.047326:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1788572338.047332:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584352128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047364:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584352128:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.047370:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1788572338.047390:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584352640 00000100:00100000:3.0:1788572338.047395:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584352640 00000100:00100000:3.0:1788572338.047413:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584351488 00000100:00100000:3.0:1788572338.047415:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584351488 00000100:00100000:3.0:1788572338.047425:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584352000 00000100:00100000:3.0:1788572338.047426:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584352000 00000100:00100000:3.0:1788572338.047433:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584352512 00000100:00100000:3.0:1788572338.047434:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584352512 00000100:00100000:3.0:1788572338.047443:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788572338.047446:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584352640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047503:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584352640:12345-0@lo:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.047510:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788572338.047524:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788572338.047530:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584351488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047562:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584351488:12345-0@lo:400:kworker.0 Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.047568:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788572338.047579:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788572338.047584:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584352000:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572338.047593:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a806680 x1875444584352000/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1788572349 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572338.047621:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584352000:12345-0@lo:400:kworker.0 Request processed in 37us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.047625:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788572338.047634:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788572338.047638:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584352512:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572338.047645:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cb8e00 x1875444584352512/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1788572349 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572338.047662:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584352512:12345-0@lo:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.047666:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788572338.047687:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584351488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047693:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584352000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584352512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047703:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584351616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047708:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584352128:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.047713:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584352640:0@lo:400:kworker.0 00000100:00080000:0.0:1788572338.047864:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572338.047869:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572338.047872:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572338.049215:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584351104 00000100:00100000:2.0:1788572338.049223:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584351104 00000100:00100000:2.0:1788572338.049283:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6326 00000100:00100000:2.0:1788572338.049290:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584351104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572338.049313:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572338.049372:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584351104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572338.049379:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6326 00000100:00080000:0.0:1788572338.049437:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572338.050193:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584351104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572338.692599:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788572339.428356:0:195954:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788572339.428422:0:195954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.428436:0:195954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.428443:0:195954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.428450:0:195954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.428503:0:195954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788572339.428509:0:195954:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788572339.428539:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572339.428544:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788572339.428550:0:195954:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788572339.428578:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e5902899800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788572339.428666:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572339.428675:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.428683:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572339.428687:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.428696:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572339.428703:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572339.428709:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572339.428712:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788572339.428714:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788572339.428743:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.428751:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572339.428777:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.428784:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11255800/0x265cfe11109bda86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bda8d expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.428798:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572339.428800:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572339.428802:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572339.429618:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572339.429639:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584352896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572339.429713:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572339.429965:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584352896 00000100:00100000:2.0:1788572339.429973:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584352896 00000100:00100000:2.0:1788572339.430030:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4655 00000100:00100000:2.0:1788572339.430049:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584352896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572339.430063:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572339.430079:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11254a00/0x265cfe11109bda8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bda86 expref: 24 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.430095:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572339.430135:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3642:x1875444584352896:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572339.430143:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4655 00000100:00100000:2.0:1788572339.430179:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584352896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572339.430328:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584352768:0@lo:39:umount.0 00000100:00100000:0.0:1788572339.430364:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572339.430649:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584352768 00000100:00100000:3.0:1788572339.430655:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584352768 00000100:00100000:3.0:1788572339.430839:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1788572339.430851:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584352768:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788572339.430876:0:188050:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdb4a 00000100:00080000:3.0:1788572339.430894:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a36e24800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1788572339.430929:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f8f1500 x1875444584352768/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:39/0 lens 224/224 e 0 to 0 dl 1788572389 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572339.431001:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875444584352768:12345-0@lo:39:umount.0 Request processed in 152us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572339.431008:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000020:00000080:3.0:1788572339.431017:0:188050:0:(genops.c:885:class_export_put()) final put ffff8e5a0efd8800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1788572339.431085:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5902899800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788572339.431098:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584352768:0@lo:39:umount.0 00000100:00080000:1.0:1788572339.431125:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572339.431129:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788572339.431134:0:195954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788572339.432017:0:195954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432031:0:195954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432038:0:195954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432045:0:195954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432064:0:195954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572339.432071:0:195954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432077:0:195954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432083:0:195954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432088:0:195954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432101:0:195954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572339.432107:0:195954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432113:0:195954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432119:0:195954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432125:0:195954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432135:0:195954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788572339.432140:0:195954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432146:0:195954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432152:0:195954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432159:0:195954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.432169:0:195954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788572339.432172:0:195954:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788572339.432203:0:195954:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788572339.432207:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788572339.432211:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788572339.432216:0:195954:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1788572339.432862:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572339.432870:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.432879:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1000 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572339.432883:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.432892:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572339.432900:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572339.432906:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572339.432909:0:82817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788572339.432911:0:82817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788572339.432958:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.432966:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572339.432989:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.432996:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1000/0x265cfe11109bd9b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd9bb expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433011:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572339.433014:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433020:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572339.433023:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433030:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572339.433036:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572339.433053:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572339.433056:0:82817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788572339.433058:0:82817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788572339.433070:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433080:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572339.433099:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433105:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a00031800/0x265cfe11109bdcf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bdcfc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433117:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572339.433120:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433125:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254200 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572339.433128:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433133:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572339.433140:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572339.433146:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788572339.433148:0:82817:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788572339.433149:0:82817:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788572339.433161:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433167:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572339.433173:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433184:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bda78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bda7f expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433194:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572339.433197:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433202:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254e00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572339.433205:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433211:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572339.433218:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572339.433224:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572339.433226:0:82817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788572339.433228:0:82817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788572339.433240:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433246:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572339.433251:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433257:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11254e00/0x265cfe11109bd9a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bd9ad expref: -99 pid: 194071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433269:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572339.433270:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572339.433272:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572339.433288:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584353408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572339.433345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572339.433390:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572339.433396:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584353024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572339.433416:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572339.433441:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584353152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572339.433463:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572339.433498:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572339.433504:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584353280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572339.433525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572339.433558:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584353408 00000100:00100000:2.0:1788572339.433564:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584353408 00000100:00100000:2.0:1788572339.433601:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584353024 00000100:00100000:2.0:1788572339.433604:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584353024 00000100:00100000:2.0:1788572339.433620:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584353152 00000100:00100000:2.0:1788572339.433623:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584353152 00000100:00100000:2.0:1788572339.433634:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584353280 00000100:00100000:2.0:1788572339.433636:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584353280 00000100:00100000:2.0:1788572339.433650:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4656 00000100:00100000:2.0:1788572339.433658:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+26:3641:x1875444584353408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572339.433670:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572339.433684:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11255600/0x265cfe11109bd9ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd9a6 expref: 26 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433701:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572339.433734:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+25:3641:x1875444584353408:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572339.433741:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4656 00000100:00100000:2.0:1788572339.433757:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4657 00000100:00100000:2.0:1788572339.433764:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584353024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572339.433772:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572339.433780:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1616fa00/0x265cfe11109bd9bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bd9b4 expref: 24 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433790:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572339.433813:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3641:x1875444584353024:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572339.433819:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4657 00000100:00100000:2.0:1788572339.433832:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4658 00000100:00100000:2.0:1788572339.433837:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3643:x1875444584353152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572339.433844:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572339.433852:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd2c00/0x265cfe11109bdcfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdcf5 expref: 22 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433861:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572339.433887:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3643:x1875444584353152:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572339.433893:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4658 00000100:00100000:2.0:1788572339.433906:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4659 00000100:00100000:2.0:1788572339.433913:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:3643:x1875444584353280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572339.433921:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572339.433929:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11254600/0x265cfe11109bda7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bda78 expref: 20 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572339.433951:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572339.433972:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3643:x1875444584353280:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572339.433977:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4659 00000100:00100000:2.0:1788572339.434025:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584353280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572339.434034:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584353152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572339.434055:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572339.434068:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584353024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572339.434075:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584353408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572339.435549:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1788572339.435816:0:195954:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1788572339.435951:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efd8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788572339.436010:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a36e24800 for lustre-MDT0000 00010000:00010000:3.0:1788572339.436021:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572339.436027:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572339.436986:0:195954:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1788572339.436995:0:195954:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e590cc71800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572339.437003:0:195954:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a3f907000 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 192.168.202.57@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 343597383689 stale:0 00000020:00080000:0.0:1788572339.437008:0:195954:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a3717a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572339.437013:0:195954:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a0efdc800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572339.437017:0:195954:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5903a24800 lustre-MDT0001-mdtlov_UUID 0@lo 7 (0 0 2) 0 0 0 0: 0000000000000000 343597383687 stale:0 00000020:00080000:0.0:1788572339.437022:0:195954:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8e5a413fb380) has exports, disconnecting them 00000020:00080000:0.0:1788572339.437027:0:195954:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e590cc71800), last request at 1788572338 00000020:00000080:0.0:1788572339.437034:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdcd2 00000100:00080000:0.0:1788572339.437126:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572339.437153:0:195954:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e590cc71800): rc 0 00000020:00000080:0.0:1788572339.437156:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e590cc71800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1788572339.437212:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788572339.437236:0:195954:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.57@tcp (ffff8e5a3f907000), last request at 1788572335 00000020:00000080:0.0:1788572339.437246:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdc5b 00000020:00010000:0.0:1788572339.437252:0:195954:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a3f907000: total 1 00000100:00080000:0.0:1788572339.437255:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f903000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572339.437318:0:195954:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e5a3f907000): rc 0 00000020:00080000:0.0:1788572339.437322:0:195954:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a3717a800), last request at 1788572338 00000020:00000080:0.0:1788572339.437326:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdb51 00000100:00080000:0.0:1788572339.437332:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e5a372df800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572339.437355:0:195954:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a3717a800): rc 0 00000020:00000080:0.0:1788572339.437357:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a3717a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00010000:1.0:1788572339.437391:0:10396:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a3f907000: total 2 00010000:00010000:1.0:1788572339.437435:0:10396:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a3f907000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788572339.437543:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1800/0x265cfe11109bdeed lrc: 0/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb35f expref: 2 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572339.437563:0:10396:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a3f907000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788572339.441187:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788572339.449529:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc71800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572339.449678:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590cc70800 for lustre-MDT0000 00000020:00080000:0.0:1788572339.450184:0:195954:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a0efdc800), last request at 1788572296 00000020:00000080:0.0:1788572339.450211:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdb43 00000100:00080000:0.0:1788572339.450249:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efdb000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788572339.450392:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3717a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572339.450437:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a372df800 for lustre-MDT0000 00000020:00080000:2.0:1788572339.450452:0:195954:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a0efdc800): rc 0 00000020:00000080:2.0:1788572339.450455:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a0efdc800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788572339.450464:0:195954:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5903a24800), last request at 1788572291 00000020:00000080:2.0:1788572339.450468:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda01 00000020:00010000:2.0:1788572339.450496:0:195954:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5903a24800: total 1 00000100:00080000:2.0:1788572339.450500:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e5a3717b800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788572339.450514:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efdc800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572339.450543:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0efdb000 for lustre-MDT0000 00000020:00080000:2.0:1788572339.450555:0:195954:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5903a24800): rc 0 00000004:00000080:2.0:1788572339.450562:0:195954:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaac78146bae0 00000100:00080000:2.0:1788572339.450582:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788572339.450585:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788572339.451352:0:195954:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788572339.451377:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e5904e06800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788572339.451553:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788572339.451557:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 3 00000004:00080000:2.0:1788572339.451567:0:195954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788572339.451621:0:195954:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788572339.451631:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788572339.451637:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788572339.451638:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975676 gen 3 00000004:00080000:2.0:1788572339.451648:0:195954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788572339.451709:0:195954:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788572339.451718:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e5a36c3b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788572339.451763:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e5a413fb380) has no exports 00000020:00010000:3.0:1788572339.451847:0:10395:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5903a24800: total 0 00010000:00010000:3.0:1788572339.451894:0:10395:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5903a24800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788572339.451928:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bdf41 lrc: 0/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 3 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572339.451968:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a01670600/0x265cfe11109bdf4f lrc: 0/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdf48 expref: 2 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572339.451984:0:10395:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5903a24800, canceled 2 locks, left on hash table 0. 00000100:00100000:0.0:1788572339.459313:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584353536:0@lo:39:umount.0 00000100:00100000:0.0:1788572339.459402:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572339.459460:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584353664:0@lo:9:umount.0 00000100:00100000:0.0:1788572339.459506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572339.459527:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584353792:0@lo:9:umount.0 00000100:00100000:0.0:1788572339.459547:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572339.459776:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584353536 00000100:00100000:2.0:1788572339.459785:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584353536 00000100:00100000:2.0:1788572339.459837:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1788572339.459846:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584353536:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788572339.459878:0:188053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda40 00000100:00080000:2.0:1788572339.459886:0:188053:0:(import.c:65:import_set_state_nolock()) ffff8e5a40f53000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572339.459907:0:188053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474837476 00000100:00100000:2.0:1788572339.460081:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3640:x1875444584353536:12345-0@lo:39:umount.0 Request processed in 235us (679us total) trans 21474837477 rc 0/0 00000100:00100000:2.0:1788572339.460090:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00010000:00010000:2.0:1788572339.460113:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572339.460144:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5904e06800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788572339.460153:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584353536:0@lo:39:umount.0 00000100:00100000:2.0:1788572339.461274:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584353664 00000100:00100000:2.0:1788572339.461283:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584353664 00000100:00100000:2.0:1788572339.461341:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584353792 00000100:00100000:2.0:1788572339.461345:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584353792 00000100:00100000:2.0:1788572339.461366:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22654 00000100:00100000:2.0:1788572339.461374:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584353664:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788572339.461398:0:43918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdca1 00000100:00080000:2.0:1788572339.461411:0:43918:0:(import.c:65:import_set_state_nolock()) ffff8e59019db800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572339.461450:0:43918:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705667 00000100:00100000:2.0:1788572339.461610:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3640:x1875444584353664:12345-0@lo:9:umount.0 Request processed in 236us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572339.461618:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22654 00000100:00100000:2.0:1788572339.461633:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22655 00000100:00100000:2.0:1788572339.461641:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584353792:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788572339.461653:0:43918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda71 00000100:00080000:2.0:1788572339.461659:0:43918:0:(import.c:65:import_set_state_nolock()) ffff8e5903a23000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572339.461681:0:43918:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975676 00000100:00100000:2.0:1788572339.461760:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3640:x1875444584353792:12345-0@lo:9:umount.0 Request processed in 119us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572339.461767:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22655 00010000:00010000:2.0:1788572339.461816:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572339.461823:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572339.461851:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788572339.461858:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788572339.461860:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572339.461864:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584353664:0@lo:9:umount.0 00000100:00080000:2.0:1788572339.461876:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36c3b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788572339.461884:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788572339.461885:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572339.461888:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584353792:0@lo:9:umount.0 00000100:00080000:0.0:1788572339.461986:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572339.471743:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788572339.472074:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e5a413fb380) has no exports 00000020:00000080:1.0:1788572339.512422:0:10396:0:(genops.c:885:class_export_put()) final put ffff8e5a3f907000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00010000:00010000:1.0:1788572339.512545:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572339.512549:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572339.512552:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788572339.522503:0:10395:0:(genops.c:885:class_export_put()) final put ffff8e5903a24800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788572339.526254:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f907000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-MDT0000 00000020:00000080:2.0:1788572339.526359:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a3f903000 for lustre-MDT0000 00010000:00010000:3.0:1788572339.529230:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572339.529237:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572339.529240:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572339.533593:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a24800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572339.533687:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a3717b800 for lustre-MDT0000 00000020:00000080:0.0:1788572339.551699:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda16 00000020:00000080:0.0:1788572339.551717:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a40e06000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788572339.551778:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788572339.551840:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a40e06000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788572339.551876:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572339.551892:0:195954:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788572339.551898:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8e5a401499c0) has no exports 00000020:00000080:2.0:1788572339.552271:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda0f 00000020:00000080:2.0:1788572339.552278:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e590bb65000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572339.552341:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590bb65000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788572339.552408:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572339.552416:0:195954:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788572339.552419:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e590bb63800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788572339.552421:0:195954:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590bb63800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788572339.552426:0:195954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1788572339.553116:0:195954:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e590686e8a0 - data ffff8e5a0f7ee870/ffff8e5905c4d000 00000020:01000000:3.0:1788572339.553300:0:195954:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e590548e4e0 - data ffff8e5a08a2a288/ffff8e59039b6800 00000100:00080000:3.0:1788572339.594637:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788572339.594646:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788572339.594660:0:195954:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e5905167100 x1875444584353536/t21474837477(21474837477) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572349 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572339.594685:0:195954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788572339.597076:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788572339.597083:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 4 00000004:00080000:3.0:1788572339.597103:0:195954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572339.597105:0:195954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788572339.597738:0:194091:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788572339.597742:0:194091:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x140:0x0] index 2 count 1 00000040:00080000:1.0:1788572339.597755:0:194091:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 80 count 2 00000100:00080000:3.0:1788572339.598358:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788572339.598362:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975676 gen 4 00000004:00080000:3.0:1788572339.598382:0:195954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572339.598385:0:195954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788572339.598731:0:194093:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788572339.598735:0:194093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x142:0x0] index 1 count 1 00000040:00080000:1.0:1788572339.598743:0:194093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 80 count 2 00000020:00000080:3.0:1788572339.599441:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd9d7 00000020:00000080:3.0:1788572339.599452:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e590b16f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788572339.600137:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd9ec 00000020:00000080:3.0:1788572339.600143:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a31e7a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788572339.600148:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788572339.600153:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572339.600165:0:195954:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572339.600169:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8e5a413f8000) has no exports 00000004:01000000:3.0:1788572339.600337:0:195954:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788572339.600347:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda5c 00000020:00000080:3.0:1788572339.600353:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a3717b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788572339.600357:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788572339.600361:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572339.600366:0:195954:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788572339.600370:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 19 (ffff8e5a0efbcd40) has no exports 00000020:00000080:3.0:1788572339.600375:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda55 00000020:00000080:3.0:1788572339.600379:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a36c3b800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788572339.600785:0:195954:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788572339.600791:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788572339.600795:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975676 gen 5 00000004:00080000:3.0:1788572339.600800:0:195954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572339.600803:0:195954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572339.600835:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572339.600845:0:195954:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572339.600852:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda47 00000020:00000080:3.0:1788572339.600858:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5904e00800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788572339.600862:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788572339.600867:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572339.600872:0:195954:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788572339.600874:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8e5a372019c0) has no exports 00000020:00000080:3.0:1788572339.600879:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda39 00000020:00000080:3.0:1788572339.600882:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e59059d5800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788572339.601243:0:195954:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788572339.601246:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788572339.601248:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 5 00000004:00080000:3.0:1788572339.601252:0:195954:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572339.601253:0:195954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572339.601278:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572339.601284:0:195954:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788572339.601293:0:195954:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788572339.601297:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda2b 00000020:00000080:3.0:1788572339.601302:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5904e04800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788572339.601305:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788572339.601309:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572339.601312:0:195954:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788572339.601314:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8e5a0efb99c0) has no exports 00000020:00000080:3.0:1788572339.601318:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda24 00000020:00000080:3.0:1788572339.601321:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5904e01000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572339.602661:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b16f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572339.602682:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a31e7a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788572339.602689:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3717b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788572339.602696:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36c3b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572339.602703:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a36c3b000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788572339.602711:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5904e03800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572339.602714:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e03800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788572339.602720:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572339.602824:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e00800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572339.602831:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59059d5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572339.602837:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59059d6800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572339.602843:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5904e06000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572339.602846:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e06000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788572339.602850:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572339.602888:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e04800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788572339.602894:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e01000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788572339.603601:0:195954:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788572339.603606:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788572339.603610:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788572339.603616:0:195954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788572339.603672:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572339.603685:0:195954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572339.603709:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572339.603713:0:195954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572339.603717:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e590b16a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572339.603720:0:195954:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b16a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788572339.603725:0:195954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572339.603794:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd9f3 00000020:00000080:0.0:1788572339.603801:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a31e79000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788572339.603806:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788572339.603809:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572339.603815:0:195954:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788572339.603818:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8e5a413fcd40) has no exports 00000020:00000080:0.0:1788572339.603837:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572339.603840:0:195954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788572339.603844:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd9fa 00000020:00000080:0.0:1788572339.603847:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e590b9aa000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788572339.603854:0:195954:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a10fc4800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788572339.603858:0:195954:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a10fc4800 3 00000020:01000004:0.0:1788572339.603861:0:195954:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5a10fc4800 from lustre-MDT0000 00000020:00000080:0.0:1788572339.603878:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572339.603882:0:195954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788572339.603885:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e590b16b800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788572339.603887:0:195954:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b16b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788572339.603893:0:195954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788572339.603922:0:195954:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788572339.603926:0:195954:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788572339.603928:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788572339.603931:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572339.603934:0:195954:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788572339.603953:0:195954:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e590bb66800 f79285ed-4685-45a8-8731-5e2522a143f3 192.168.202.57@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572339.603960:0:195954:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e59059d1800 e87131b0-4a60-4def-a26d-6e23dcfe5daa 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572339.603965:0:195954:0:(genops.c:1553:class_disconnect_exports()) OBD device 4 (ffff8e5a109f8000) has exports, disconnecting them 00000020:00080000:0.0:1788572339.603970:0:195954:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.57@tcp (ffff8e590bb66800), last request at 1788572299 00000020:00000080:0.0:1788572339.603992:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdc38 00000020:00010000:0.0:1788572339.603997:0:195954:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e590bb66800: total 2 00000100:00080000:0.0:1788572339.604001:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e590bb62800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572339.604015:0:195954:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e590bb66800): rc 0 00000020:00080000:0.0:1788572339.604018:0:195954:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e59059d1800), last request at 1788572290 00000020:00000080:0.0:1788572339.604058:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd998 00000020:00010000:0.0:1788572339.604061:0:195954:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e59059d1800: total 2 00000100:00080000:0.0:1788572339.604064:0:195954:0:(import.c:65:import_set_state_nolock()) ffff8e590b16d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572339.604072:0:195954:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e59059d1800): rc 0 00000020:00080000:0.0:1788572339.604076:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8e5a109f8000) has no exports 00000100:00100000:0.0:1788572339.604128:0:194080:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e5901aca200:194080] 2 exiting: rc = 0 00000100:00100000:1.0:1788572339.604261:0:194079:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e5901acac00:194079] 1 exiting: rc = 0 00000020:00000080:1.0:1788572339.604308:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5904e06800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788572339.604314:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5904e02000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572339.604316:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e02000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788572339.604323:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572339.604389:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a31e79000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788572339.604393:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5a12924000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788572339.604395:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a12924000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788572339.604398:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788572339.604426:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b9aa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788572339.607574:0:82817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e590bb66800: total 0 00010000:00010000:0.0:1788572339.607587:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572339.607647:0:82817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e590bb66800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788572339.607687:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a00030c00/0x265cfe11109bdd11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb319 expref: 5 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607716:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd2600/0x265cfe11109bdc3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2a9 expref: 4 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607728:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe0400/0x265cfe11109bdc54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2e8 expref: 3 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607739:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd3800/0x265cfe11109bdc46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb2b0 expref: 2 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607748:0:82817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e590bb66800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788572339.607768:0:82817:0:(genops.c:885:class_export_put()) final put ffff8e590bb66800/f79285ed-4685-45a8-8731-5e2522a143f3 00000020:00010000:0.0:1788572339.607791:0:82817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e59059d1800: total 1 00010000:00010000:0.0:1788572339.607809:0:82817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e59059d1800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788572339.607827:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11255e00/0x265cfe11109bdb04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdafd expref: 14 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607839:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd3000/0x265cfe11109bdc85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdc7e expref: 13 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607850:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dce600/0x265cfe11109bdaf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdaef expref: 12 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607861:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11254000/0x265cfe11109bdcaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdca8 expref: 11 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607874:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11255000/0x265cfe11109bdb12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdb0b expref: 10 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607884:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe0a00/0x265cfe11109bdb20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdb19 expref: 9 pid: 194080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607899:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdb2e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdb27 expref: 8 pid: 194078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607913:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1600/0x265cfe11109bdabe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdab7 expref: 7 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607923:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dcf000/0x265cfe11109bdb3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdb35 expref: 6 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607933:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a00030200/0x265cfe11109bdcbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdcb6 expref: 5 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607957:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd2000/0x265cfe11109bdd0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdd03 expref: 4 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607970:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dce000/0x265cfe11109bdae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdae1 expref: 3 pid: 194079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607981:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bdada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdad3 expref: 2 pid: 194084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572339.607991:0:82817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e59059d1800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788572339.608003:0:82817:0:(genops.c:885:class_export_put()) final put ffff8e59059d1800/e87131b0-4a60-4def-a26d-6e23dcfe5daa 00010000:00010000:0.0:1788572339.608008:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572339.608010:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572339.608012:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572339.608021:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788572339.608064:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590bb66800/f79285ed-4685-45a8-8731-5e2522a143f3 for MGS 00000020:00000080:1.0:1788572339.608106:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59059d1800/e87131b0-4a60-4def-a26d-6e23dcfe5daa for MGS 00000020:00000080:1.0:1788572339.608122:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590bb62800 for MGS 00000020:00000080:1.0:1788572339.608129:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590b16d000 for MGS 00000100:00100000:0.0:1788572339.611610:0:194084:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8e5a1d6b9e00:194084] 3 exiting: rc = 0 00000100:00100000:0.0:1788572339.611772:0:194078:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e59059fee00:194078] 0 exiting: rc = 1 00000100:00100000:1.0:1788572339.611861:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611869:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611876:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611881:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611887:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611893:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611899:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611904:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611910:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611916:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611923:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611928:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611933:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611950:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611956:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611963:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611968:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611973:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611978:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611983:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611991:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.611996:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612001:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612006:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612011:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612015:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612020:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612024:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612029:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612034:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612040:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612045:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612051:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612055:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612060:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612065:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612071:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612076:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612082:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612088:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612093:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612098:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612104:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612110:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612114:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612118:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612123:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612127:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612132:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612136:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612141:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612145:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612150:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612155:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612160:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612165:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612170:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612175:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612180:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612186:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612191:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612197:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612202:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572339.612207:0:195954:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788572339.613450:0:195954:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a2458d8a0 - data ffff8e5a08b8f5e8/ffff8e5903b3c000 00000020:01000000:1.0:1788572339.613607:0:195954:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5905987480 - data ffff8e5a08abb6c0/ffff8e5a1fadf800 00000020:00000080:1.0:1788572339.614041:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd991 00000020:00000080:1.0:1788572339.614050:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a24620800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788572339.614065:0:195954:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a10fc4800 from MGS, refs=2 00000020:01000004:1.0:1788572339.614069:0:195954:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a10fc4800 2 00000020:01000004:1.0:1788572339.614072:0:195954:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5a10fc4800 from MGS 00000020:00000080:1.0:1788572339.614097:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572339.614104:0:195954:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788572339.614107:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a08d20800/MGS 00000020:00000080:1.0:1788572339.614110:0:195954:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a08d20800/MGS for MGS 00000020:01000000:1.0:1788572339.614116:0:195954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788572339.614188:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788572339.614192:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572339.614198:0:195954:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788572339.614205:0:195954:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e590289f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572339.614210:0:195954:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8e5a109f99c0) has exports, disconnecting them 00000020:00080000:1.0:1788572339.614215:0:195954:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e590289f000), last request at 1788572291 00000020:00000080:1.0:1788572339.614219:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bda9b 00000020:00080000:1.0:1788572339.614228:0:195954:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e590289f000): rc 0 00000020:00000080:1.0:1788572339.614232:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e590289f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788572339.614917:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a24620800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572339.614928:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590289f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788572339.627629:0:195954:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788572339.627638:0:195954:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788572339.627643:0:195954:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788572339.627650:0:195954:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788572339.627678:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5902899800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788572339.627851:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572339.627862:0:195954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788572339.627868:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a372d9000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788572339.627872:0:195954:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a372d9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788572339.627881:0:195954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788572339.627974:0:195954:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a10fc4800 1 00000020:00000080:0.0:1788572339.627980:0:195954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bd983 00000020:00000080:0.0:1788572339.627986:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a08d22800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788572339.627994:0:195954:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788572339.628002:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a08d22800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572339.628011:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572339.628016:0:195954:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788572339.628020:0:195954:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8e5a40148000) has no exports 00000020:00000080:3.0:1788572339.703901:0:195954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572339.703915:0:195954:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788572339.703921:0:195954:0:(genops.c:885:class_export_put()) final put ffff8e5a10fc6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788572339.703926:0:195954:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a10fc6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788572339.703950:0:195954:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788572339.704082:0:195954:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e5a10fc3000 00000020:02000400:3.0:1788572339.704150:0:195954:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788572339.736338:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572340.093214:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572340.093239:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584353920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572340.093318:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572340.093391:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584353920 00000100:00100000:2.0:1788572340.093399:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584353920 00000100:00100000:2.0:1788572340.093448:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6327 00000100:00100000:2.0:1788572340.093456:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584353920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572340.093501:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572340.093543:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584353920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572340.093548:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6327 00000100:00080000:0.0:1788572340.093630:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572340.093662:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584353920:0@lo:13:osp-pre-1-1.0 00000400:00000100:2.0:1788572340.591565:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569498752 offset 0 length 224: 4 00000100:00100000:2.0:1788572340.591616:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572340.591666:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572340.591838:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569498880 00000100:00100000:3.0:1788572340.591848:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569498880 00000100:00100000:3.0:1788572340.591900:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1056 00000100:00100000:3.0:1788572340.591908:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1875444569498880:12345-192.168.202.57@tcp:400:kworker.0 00000020:00080000:3.0:1788572340.591918:0:188833:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.57@tcp 00000100:00100000:3.0:1788572340.591990:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1875444569498880:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 81us (373us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788572340.591998:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1056 00000100:00100000:1.0:1788572340.594348:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569499136 00000100:00100000:1.0:1788572340.594364:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569499136 00000100:00100000:1.0:1788572340.594451:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7730 00000100:00100000:1.0:1788572340.594463:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569499136:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572340.594559:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569499136:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 98us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572340.594566:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7730 00000100:00080000:2.0:1788572340.594620:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572340.599292:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572340.599501:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569499008 00000100:00100000:3.0:1788572340.599511:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569499008 00000100:00080000:2.0:1788572340.599683:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572340.600041:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 323 00000100:00100000:3.0:1788572340.600055:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569499008:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572340.600148:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569499008:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 97us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572340.600165:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 323 00000100:00100000:1.0:1788572340.603632:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572340.603728:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569499264 00000100:00100000:2.0:1788572340.603747:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569499264 00000100:00100000:2.0:1788572340.603862:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7731 00000100:00100000:2.0:1788572340.603874:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569499264:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572340.603958:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569499264:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 86us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572340.603975:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7731 00000100:00080000:3.0:1788572340.604033:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572340.606572:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 1 seconds 00000100:00100000:2.0:1788572340.633516:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572340.633751:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569499392 00000100:00100000:0.0:1788572340.633763:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569499392 00000100:00100000:0.0:1788572340.633810:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1057 00000100:00100000:0.0:1788572340.633819:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569499392:12345-192.168.202.57@tcp:38:ptlrpcd_01_01.0 00010000:00020000:0.0:1788572340.633842:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572340.633920:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569499392:12345-192.168.202.57@tcp:38:ptlrpcd_01_01.0 Request processed in 101us (446us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572340.633928:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1057 00010000:00010000:1.0:1788572340.733778:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572341.628628:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 1 seconds 00010000:00010000:2.0:1788572341.760566:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572342.140912:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572342.140939:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584354048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572342.141021:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572342.141137:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584354048 00000100:00100000:1.0:1788572342.141147:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584354048 00000100:00100000:1.0:1788572342.141222:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6328 00000100:00100000:1.0:1788572342.141232:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584354048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572342.141266:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572342.141313:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584354048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572342.141320:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6328 00000100:00080000:3.0:1788572342.141380:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572342.141423:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584354048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572342.653035:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 1 seconds 00000100:00100000:2.0:1788572342.655890:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572342.655913:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584354176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572342.655988:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572342.656155:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584354176 00000100:00100000:3.0:1788572342.656164:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584354176 00000100:00100000:3.0:1788572342.656206:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1788572342.656214:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875444584354176:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788572342.656222:0:188054:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788572342.656323:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875444584354176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (335us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788572342.656330:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:02020000:2.0:1788572342.658200:0:3643:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788572342.680464:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572342.680500:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572342.680508:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572342.712906:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572342.712925:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9049 00000100:00080000:2.0:1788572342.712939:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572342.715088:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cb9880 x1875444584354304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572342.715246:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584354304:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788572342.715340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572342.715457:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584354304 00000100:00100000:3.0:1788572342.715466:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584354304 00000100:00100000:3.0:1788572342.716823:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1788572342.716851:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584354304:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788572342.716882:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572342.717001:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584354304:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 150us (1660us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572342.717008:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00080000:0.0:1788572342.717138:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572342.717145:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572342.717150:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584354304:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788572342.784996:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572343.164860:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572343.164870:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572343.164875:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572343.164887:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9095 00000100:00080000:2.0:1788572343.164894:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788572343.164904:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572343.164927:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584354432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.164934:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905165180 x1875444584354816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788572343.165002:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584354432 offset 0 length 224: 4 00000100:00100000:3.0:1788572343.165059:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584354560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.165076:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584355072:0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.165109:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572343.165109:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572343.165165:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584354560 00000100:00100000:3.0:1788572343.165165:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584355200:0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.165174:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584354560 00000100:00100000:3.0:1788572343.165188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572343.165216:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584355200 00000100:00100000:1.0:1788572343.165219:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584355200 00000100:00100000:3.0:1788572343.165229:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1788572343.165238:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875444584354560:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788572343.165248:0:188049:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572343.165274:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584354688:0@lo:400:kworker.0 00000100:00100000:3.0:1788572343.165296:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875444584354560:12345-0@lo:400:kworker.0 Request processed in 57us (186us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572343.165301:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572343.165304:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1788572343.165318:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584354688 00000100:00100000:1.0:1788572343.165321:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584354688 00000100:00100000:3.0:1788572343.165327:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1788572343.165330:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875444584355200:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788572343.165334:0:188049:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572343.165359:0:188833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788572343.165359:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875444584355200:12345-0@lo:400:kworker.0 Request processed in 26us (170us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788572343.165365:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1788572343.165368:0:188833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788572343.165376:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788572343.165384:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584354688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572343.165443:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584354688:12345-0@lo:400:kworker.0 Request processed in 61us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572343.165449:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:3.0:1788572343.165466:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572343.165515:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788572343.165520:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788572343.165524:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788572343.165529:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572343.165532:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9049 00000100:00080000:3.0:1788572343.165536:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572343.165552:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cb9880 x1875444584355584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572343.165566:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584354560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.165574:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584354688:0@lo:400:kworker.0 00000100:00080000:3.0:1788572343.165575:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788572343.165579:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1788572343.165581:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584355328:0@lo:400:kworker.0 00000100:02000400:3.0:1788572343.165582:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788572343.165585:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572343.165588:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9049 00000100:00080000:3.0:1788572343.165592:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572343.165603:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24c54700 x1875444584355712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572343.165605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572343.165613:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584355200:0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.165624:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584355328 00000100:00100000:1.0:1788572343.165626:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584355328 00000100:00100000:1.0:1788572343.165654:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1788572343.165659:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875444584355328:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788572343.165664:0:188050:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572343.165691:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875444584355328:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572343.165700:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00080000:1.0:1788572343.165755:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572343.165759:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572343.165762:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572343.165765:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572343.165768:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9059 00000100:00080000:1.0:1788572343.165773:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572343.165788:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1faff800 x1875444584355840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572343.165798:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584355328:0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.165814:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788572343.165820:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584354944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.165976:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584355072 00000100:00100000:2.0:1788572343.165981:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584355072 00000100:00100000:2.0:1788572343.166025:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7732 00000100:00100000:2.0:1788572343.166044:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584355072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.166092:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584355072:12345-0@lo:400:kworker.0 Request processed in 61us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572343.166099:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7732 00000100:00080000:2.0:1788572343.166178:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572343.166206:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584355072:0@lo:400:kworker.0 00000100:00100000:0.0:1788572343.166311:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584354816:0@lo:38:kworker.0 00000100:00100000:0.0:1788572343.166355:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572343.166410:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584355584:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788572343.166435:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572343.166458:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584355712:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788572343.166516:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572343.166534:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584355840:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788572343.166556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572343.166582:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584355584 00000100:00100000:0.0:1788572343.166586:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584355584 00000100:00100000:0.0:1788572343.166603:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584355712 00000100:00100000:0.0:1788572343.166605:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584355712 00000100:00100000:0.0:1788572343.166613:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584355840 00000100:00100000:0.0:1788572343.166615:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584355840 00000100:00100000:0.0:1788572343.166623:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1788572343.166628:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584355584:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788572343.166651:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572343.166685:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584355584:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 55us (248us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572343.166691:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1788572343.166843:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584354816 00000100:00100000:3.0:1788572343.166843:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1788572343.166847:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584354816 00000100:00100000:3.0:1788572343.166849:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584355712:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788572343.166860:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572343.166870:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1788572343.166874:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584354816:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572343.166885:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572343.166899:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584355712:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 49us (382us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572343.166905:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1788572343.166909:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584354816:12345-0@lo:38:kworker.0 Request processed in 35us (556us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572343.166918:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1788572343.166950:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:2.0:1788572343.166954:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584355840:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788572343.166960:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:2.0:1788572343.166964:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572343.166984:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584355456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.166987:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584355840:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 31us (430us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572343.166992:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1788572343.167014:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572343.167026:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584355456 00000100:00100000:0.0:1788572343.167029:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584355456 00000100:00080000:1.0:1788572343.167075:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788572343.167076:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00080000:1.0:1788572343.167080:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572343.167082:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584355456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.167085:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584354816:0@lo:38:kworker.0 00000100:00080000:1.0:1788572343.167093:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572343.167096:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572343.167099:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584355584:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1788572343.167106:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572343.167109:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572343.167113:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584355712:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1788572343.167121:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572343.167124:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572343.167127:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584355840:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788572343.167173:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572343.167198:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584355456:12345-0@lo:400:kworker.0 Request processed in 115us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572343.167205:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788572343.167209:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584355456:0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.168053:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584354944 00000100:00100000:1.0:1788572343.168063:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584354944 00000100:00100000:1.0:1788572343.168109:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7733 00000100:00100000:1.0:1788572343.168116:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584354944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.168186:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584354944:12345-0@lo:400:kworker.0 Request processed in 71us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572343.168192:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7733 00000100:00100000:1.0:1788572343.168245:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584354944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572343.678305:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 1 seconds 00010000:00010000:0.0:1788572343.811573:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572344.700666:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 1 seconds 00010000:00010000:1.0:1788572344.828743:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572345.213067:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584355968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572345.213214:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572345.217272:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584355968 00000100:00100000:0.0:1788572345.217291:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584355968 00000100:00100000:0.0:1788572345.217390:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6329 00000100:00100000:0.0:1788572345.217405:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584355968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572345.217457:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572345.217601:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584355968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 201us (4386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572345.217609:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6329 00000100:00080000:1.0:1788572345.217864:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572345.217926:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584355968:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788572345.219846:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788572345.219863:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837477 is committed 00000020:00000080:0.0:1788572345.219867:0:188042:0:(genops.c:885:class_export_put()) final put ffff8e5a40f57000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572345.219913:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a40f57000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788572345.219997:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a40f53000 for lustre-MDT0001 00000001:00100000:1.0:1788572345.220962:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572345.220973:0:194757:0:(genops.c:885:class_export_put()) final put ffff8e5a0f312800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572345.221052:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f312800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788572345.221106:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59019db800 for lustre-OST0000 00000001:00100000:3.0:1788572345.222175:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572345.222183:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5903a23800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572345.222252:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a23800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788572345.222300:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5903a23000 for lustre-OST0001 00000400:00000100:3.0:1788572345.709945:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569499520 offset 0 length 224: 4 00000100:00100000:3.0:1788572345.710024:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572345.710153:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572345.710339:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572345.710418:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569499776 00000100:00100000:0.0:1788572345.710435:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569499776 00000100:00100000:0.0:1788572345.710574:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 326 00000100:00080000:1.0:1788572345.710574:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572345.710601:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569499776:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572345.710734:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569499776:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 146us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572345.710743:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 326 00000100:00100000:3.0:1788572345.718417:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572345.723191:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569499648 00000100:00100000:1.0:1788572345.723215:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569499648 00000100:00100000:1.0:1788572345.723309:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1064 00000100:00100000:1.0:1788572345.723322:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569499648:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:1.0:1788572345.723355:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572345.723476:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569499648:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 154us (5074us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572345.723527:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1064 00000100:00100000:2.0:1788572345.724307:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569499904 00000100:00100000:2.0:1788572345.724319:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569499904 00000100:00100000:1.0:1788572345.724533:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569500032 00000100:00100000:1.0:1788572345.724537:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569500032 00000100:00080000:2.0:1788572345.724624:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572345.724629:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572345.726097:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7734 00000100:00100000:0.0:1788572345.726137:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569499904:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572345.726255:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569499904:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 133us (16232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572345.726264:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7734 00000100:00100000:0.0:1788572345.726287:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7735 00000100:00100000:0.0:1788572345.726295:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569500032:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572345.726323:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569500032:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (15985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572345.726329:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7735 00000100:00000400:2.0:1788572345.726421:0:188074:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572329/real 1788572329] req@ffff8e5a31cb9f80 x1875444584348288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 1 dl 1788572345 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572345.726454:0:188074:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8e5a1f80e800 already not connected (conn 31, was 29): DISCONN 00000100:00100000:2.0:1788572345.726460:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:1.0:1788572345.852809:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572346.748903:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:2.0:1788572346.876799:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572347.261083:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572347.261115:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584356096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572347.261221:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572347.261818:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584356096 00000100:00100000:2.0:1788572347.261831:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584356096 00000100:00100000:2.0:1788572347.261927:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6330 00000100:00100000:2.0:1788572347.261942:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584356096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572347.261987:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572347.262067:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584356096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572347.262075:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6330 00000100:00080000:1.0:1788572347.263626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572347.263719:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584356096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572347.774293:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:0.0:1788572347.901028:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572348.287897:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572348.287907:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572348.287912:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572348.287922:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9096 00000100:00080000:3.0:1788572348.287929:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572348.287937:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572348.287963:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905167100 x1875444584356352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572348.287999:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572348.288003:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572348.288005:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572348.288009:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9096 00000100:00080000:3.0:1788572348.288013:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572348.288017:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572348.288032:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905167800 x1875444584356608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572348.288072:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572348.288076:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572348.288078:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572348.288082:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9096 00000100:00080000:3.0:1788572348.288096:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572348.288102:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572348.288115:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a407e0e00 x1875444584356992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572348.288124:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572348.288128:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572348.288130:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572348.288134:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9096 00000100:00080000:3.0:1788572348.288137:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572348.288142:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572348.288157:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905161180 x1875444584357120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572348.288330:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584356480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.288441:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572348.288544:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584356352:0@lo:38:kworker.0 00000100:00100000:0.0:1788572348.288554:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572348.288566:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584356224:0@lo:400:kworker.0 00000100:00100000:1.0:1788572348.288587:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:0.0:1788572348.288602:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584356224 offset 0 length 224: 4 00000100:00100000:1.0:1788572348.288640:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584356608:0@lo:38:kworker.0 00000100:00100000:1.0:1788572348.288668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572348.288687:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584356736:0@lo:400:kworker.0 00000100:00100000:1.0:1788572348.288693:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584356992:0@lo:38:kworker.0 00000100:00100000:3.0:1788572348.288811:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584356864:0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.288883:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584357248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572348.298375:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.300470:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.300612:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584356608 00000100:00100000:3.0:1788572348.300626:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584356608 00000100:00100000:1.0:1788572348.300627:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584357120:0@lo:38:kworker.0 00000100:00100000:3.0:1788572348.300686:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1788572348.300691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.300700:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584356608:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572348.300730:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572348.300741:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584356480 00000100:00100000:1.0:1788572348.300747:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584356480 00000100:00100000:1.0:1788572348.300800:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584356352 00000100:00100000:1.0:1788572348.300805:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584356352 00000100:00100000:3.0:1788572348.300806:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584356608:12345-0@lo:38:kworker.0 Request processed in 106us (12134us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572348.300817:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1788572348.300820:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584356992 00000100:00100000:1.0:1788572348.300826:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584356992 00000100:00100000:1.0:1788572348.300836:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584357120 00000100:00100000:1.0:1788572348.300839:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584357120 00000100:00100000:3.0:1788572348.300857:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788572348.300867:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1788572348.300872:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584356480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572348.300878:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584356352:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572348.300892:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572348.300937:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584356352:12345-0@lo:38:kworker.0 Request processed in 60us (12350us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572348.300945:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584356480:12345-0@lo:400:kworker.0 Request processed in 80us (12505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572348.300946:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1788572348.300958:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788572348.300967:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1788572348.300973:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584356992:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788572348.300982:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00010000:00020000:1.0:1788572348.300985:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572348.300990:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584357120:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572348.301001:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572348.301023:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584356992:12345-0@lo:38:kworker.0 Request processed in 48us (2659us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572348.301031:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1788572348.301039:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584357120:12345-0@lo:38:kworker.0 Request processed in 48us (350us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572348.301049:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1788572348.301065:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584356864 00000100:00100000:1.0:1788572348.301070:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584356864 00000100:00100000:1.0:1788572348.301104:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7736 00000100:00100000:1.0:1788572348.301113:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584356864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.301121:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584356480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572348.301166:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584356864:12345-0@lo:400:kworker.0 Request processed in 55us (704us total) trans 0 rc 0/0 00000100:00080000:3.0:1788572348.301168:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572348.301187:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572348.301191:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7736 00000100:00100000:3.0:1788572348.301194:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584356352:0@lo:38:kworker.0 00000100:00080000:3.0:1788572348.301213:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572348.301216:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572348.301218:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572348.301223:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584356608:0@lo:38:kworker.0 00000100:00080000:1.0:1788572348.301224:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572348.301238:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572348.301243:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572348.301247:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584356992:0@lo:38:kworker.0 00000100:00100000:1.0:1788572348.301259:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584356864:0@lo:400:kworker.0 00000100:00080000:3.0:1788572348.301260:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572348.301268:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572348.301272:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584357120:0@lo:38:kworker.0 00000100:00100000:0.0:1788572348.305593:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.305845:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584356736 00000100:00100000:3.0:1788572348.305859:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584356736 00000100:00100000:3.0:1788572348.305937:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7737 00000100:00100000:3.0:1788572348.305950:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584356736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.306076:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584356736:12345-0@lo:400:kworker.0 Request processed in 129us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572348.306191:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7737 00000100:00100000:0.0:1788572348.306524:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584356736:0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.306647:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572348.306816:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584357248 00000100:00100000:1.0:1788572348.306823:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584357248 00000100:00100000:1.0:1788572348.306891:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788572348.306900:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584357248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572348.306955:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584357248:12345-0@lo:400:kworker.0 Request processed in 57us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572348.306962:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:2.0:1788572348.308024:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572348.308078:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584357248:0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.796674:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:0.0:1788572348.924817:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572349.820934:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:1.0:1788572349.948708:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572350.336536:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572350.336567:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584357376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572350.336648:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572350.336795:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584357376 00000100:00100000:0.0:1788572350.336804:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584357376 00000100:00100000:0.0:1788572350.336875:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6331 00000100:00100000:0.0:1788572350.336887:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584357376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572350.336922:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572350.336985:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584357376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572350.336991:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6331 00000100:00080000:2.0:1788572350.337127:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572350.337165:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584357376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572350.833636:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:3.0:1788572350.833679:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569500160 offset 0 length 224: 4 00000100:00100000:3.0:1788572350.833699:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572350.833734:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572350.833760:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572350.833790:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569500544 00000100:00100000:3.0:1788572350.833805:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569500544 00000100:00100000:3.0:1788572350.833864:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569500672 00000100:00100000:3.0:1788572350.833868:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569500672 00000100:00100000:3.0:1788572350.833907:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22656 00000100:00100000:3.0:1788572350.833917:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2396:x1875444569500544:12345-192.168.202.57@tcp:9:kworker.0 00000020:00000080:3.0:1788572350.833958:0:177557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bddf8 00000100:00080000:3.0:1788572350.833968:0:177557:0:(import.c:65:import_set_state_nolock()) ffff8e590cc73800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572350.834013:0:177557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705667 00000100:00100000:3.0:1788572350.834169:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+2:2396:x1875444569500544:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 252us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572350.834177:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22656 00000100:00100000:3.0:1788572350.834195:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22657 00000100:00100000:3.0:1788572350.834202:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2396:x1875444569500672:12345-192.168.202.57@tcp:9:kworker.0 00000020:00000080:3.0:1788572350.834214:0:177557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdc69 00000100:00080000:3.0:1788572350.834219:0:177557:0:(import.c:65:import_set_state_nolock()) ffff8e590bb67800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572350.834240:0:177557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975676 00000100:00100000:3.0:1788572350.834324:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+2:2396:x1875444569500672:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 122us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572350.834332:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22657 00010000:00010000:3.0:1788572350.834361:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572350.834469:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572350.834511:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572350.834515:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572350.834666:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569500416 00000100:00100000:1.0:1788572350.834671:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569500416 00000100:00100000:1.0:1788572350.834717:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569500288 00000100:00100000:1.0:1788572350.834720:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569500288 00000100:00100000:1.0:1788572350.834735:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 329 00000100:00100000:1.0:1788572350.834743:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569500416:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572350.834776:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569500416:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 35us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572350.834783:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 329 00000100:00100000:1.0:1788572350.834796:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1068 00000100:00100000:1.0:1788572350.834800:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569500288:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:1.0:1788572350.834820:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572350.834843:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569500288:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 41us (1143us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572350.834850:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1068 00000100:00080000:2.0:1788572350.835069:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572350.844608:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:0.0:1788572350.972731:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572351.870048:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:0.0:1788572351.996733:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572352.382180:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584357504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572352.382249:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572352.382319:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584357504 00000100:00100000:2.0:1788572352.382327:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584357504 00000100:00100000:2.0:1788572352.382381:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6332 00000100:00100000:2.0:1788572352.382390:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584357504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572352.382420:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572352.382463:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584357504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572352.382471:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6332 00000100:00080000:2.0:1788572352.382510:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572352.382552:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584357504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572352.895295:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572353.022993:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572353.405439:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572353.405447:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572353.405451:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572353.405460:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9101 00000100:00080000:2.0:1788572353.405467:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572353.405476:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572353.405521:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729ca80 x1875444584357760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572353.405550:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572353.405553:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572353.405555:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572353.405559:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9101 00000100:00080000:2.0:1788572353.405562:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788572353.405566:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572353.405579:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729e680 x1875444584358016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572353.405601:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572353.405604:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572353.405606:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572353.405609:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9101 00000100:00080000:2.0:1788572353.405611:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572353.405615:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572353.405626:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729ed80 x1875444584358400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572353.405636:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572353.405639:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572353.405640:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572353.405644:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9101 00000100:00080000:2.0:1788572353.405646:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572353.405650:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572353.405659:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729c700 x1875444584358528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572353.405705:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584358272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572353.405787:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584357632:0@lo:400:kworker.0 00000400:00000100:1.0:1788572353.405829:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584357632 offset 0 length 224: 4 00000100:00100000:1.0:1788572353.405895:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584358656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572353.405931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572353.405976:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584358656 00000100:00100000:1.0:1788572353.405984:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584358656 00000100:00100000:1.0:1788572353.406037:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788572353.406048:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584358656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572353.406101:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584358656:12345-0@lo:400:kworker.0 Request processed in 55us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572353.406108:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:1.0:1788572353.406128:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572353.406157:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584358656:0@lo:400:kworker.0 00000100:00100000:3.0:1788572353.406339:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584357888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572353.406379:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572353.406437:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572353.406444:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584358144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572353.406473:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572353.406532:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584357760:0@lo:38:kworker.0 00000100:00100000:3.0:1788572353.406558:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572353.406579:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584358016:0@lo:38:kworker.0 00000100:00100000:3.0:1788572353.406606:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572353.406626:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584358400:0@lo:38:kworker.0 00000100:00100000:3.0:1788572353.406647:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572353.406663:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584358528:0@lo:38:kworker.0 00000100:00100000:3.0:1788572353.406683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572353.406716:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584358144 00000100:00100000:3.0:1788572353.406721:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584358144 00000100:00100000:3.0:1788572353.406771:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7738 00000100:00100000:3.0:1788572353.406780:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584358144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572353.406835:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584358144:12345-0@lo:400:kworker.0 Request processed in 56us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572353.406841:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7738 00000100:00100000:3.0:1788572353.406861:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584357888 00000100:00100000:3.0:1788572353.406865:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584357888 00000100:00100000:3.0:1788572353.406895:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584357760 00000100:00100000:3.0:1788572353.406898:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584357760 00000100:00100000:3.0:1788572353.406907:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584358400 00000100:00100000:3.0:1788572353.406909:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584358400 00000100:00100000:3.0:1788572353.406917:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584358528 00000100:00100000:3.0:1788572353.406919:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584358528 00000100:00100000:3.0:1788572353.406928:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788572353.406934:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584357888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572353.406970:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584357888:12345-0@lo:400:kworker.0 Request processed in 36us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572353.406977:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788572353.406989:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1788572353.406993:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584357760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572353.407011:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572353.407045:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584357760:12345-0@lo:38:kworker.0 Request processed in 50us (485us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572353.407052:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1788572353.407065:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1788572353.407069:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584358400:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572353.407079:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572353.407104:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584358400:12345-0@lo:38:kworker.0 Request processed in 34us (457us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572353.407111:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1788572353.407123:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1788572353.407126:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584358528:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572353.407135:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572353.407159:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584358528:12345-0@lo:38:kworker.0 Request processed in 30us (474us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572353.407165:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1788572353.407183:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584358016 00000100:00100000:3.0:1788572353.407186:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584358016 00000100:00100000:3.0:1788572353.407205:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1788572353.407210:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584358016:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572353.407221:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572353.407247:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584358016:12345-0@lo:38:kworker.0 Request processed in 36us (641us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572353.407254:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00080000:3.0:1788572353.407289:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572353.407294:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572353.407297:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584357760:0@lo:38:kworker.0 00000100:00080000:3.0:1788572353.407306:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572353.407309:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572353.407326:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584358016:0@lo:38:kworker.0 00000100:00080000:3.0:1788572353.407335:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572353.407339:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572353.407342:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584358400:0@lo:38:kworker.0 00000100:00080000:3.0:1788572353.407349:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572353.407352:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572353.407355:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584358528:0@lo:38:kworker.0 00000100:00100000:3.0:1788572353.407391:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584358144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572353.407402:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584357888:0@lo:400:kworker.0 00000100:00080000:1.0:1788572353.407766:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572353.409010:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572353.409129:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584358272 00000100:00100000:1.0:1788572353.409138:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584358272 00000100:00100000:1.0:1788572353.409200:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7739 00000100:00100000:1.0:1788572353.409211:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584358272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572353.409271:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584358272:12345-0@lo:400:kworker.0 Request processed in 63us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572353.409278:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7739 00000100:00100000:1.0:1788572353.409329:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584358272:0@lo:400:kworker.0 00000100:00080000:2.0:1788572353.409395:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572353.918124:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572354.045799:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572354.942802:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572355.071579:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572355.455288:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572355.455308:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584358784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572355.455391:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572355.455457:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584358784 00000100:00100000:3.0:1788572355.455464:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584358784 00000100:00100000:3.0:1788572355.455544:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6333 00000100:00100000:3.0:1788572355.455554:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584358784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572355.455597:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141248 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572355.455648:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584358784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572355.455654:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6333 00000100:00080000:3.0:1788572355.455686:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572355.455720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584358784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572355.964296:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:2.0:1788572355.964336:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569500800 offset 0 length 224: 4 00000100:00100000:2.0:1788572355.964376:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572355.964901:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569501056 00000100:00100000:1.0:1788572355.964912:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569501056 00000100:00100000:1.0:1788572355.965003:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569500928 00000100:00100000:1.0:1788572355.965006:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569500928 00000100:00100000:1.0:1788572355.965027:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 332 00000100:00100000:1.0:1788572355.965036:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569501056:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572355.965109:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569501056:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 74us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572355.965117:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 332 00000100:00100000:1.0:1788572355.965135:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1072 00000100:00100000:1.0:1788572355.965140:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569500928:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:1.0:1788572355.965161:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572355.965185:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569500928:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 44us (809us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572355.965192:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1072 00000100:00100000:3.0:1788572355.966284:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00000100:00080000:2.0:1788572355.968863:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788572356.098605:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572356.977030:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:2.0:1788572356.977072:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569501184 offset 0 length 520: 4 00000100:00100000:2.0:1788572356.977098:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572356.977128:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569501440 00000100:00100000:2.0:1788572356.977137:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569501440 00000100:00100000:2.0:1788572356.977189:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569501312 00000100:00100000:2.0:1788572356.977192:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569501312 00000100:00100000:2.0:1788572356.977209:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 333 00000100:00100000:2.0:1788572356.977219:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569501440:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572356.977310:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569501440:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 92us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572356.977317:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 333 00000100:00100000:2.0:1788572356.977335:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1073 00000100:00100000:2.0:1788572356.977340:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569501312:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572356.977359:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572356.977385:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569501312:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 44us (287us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572356.977391:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1073 00000100:00100000:0.0:1788572356.988697:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00000001:00100000:0.0:1788572356.994942:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:0.0:1788572356.994952:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e590bb61000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:3.0:1788572356.995122:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590bb61000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-OST0001 00000020:00000080:3.0:1788572356.995174:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590bb67800 for lustre-OST0001 00000001:00100000:0.0:1788572356.995808:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:0.0:1788572356.995813:0:194757:0:(genops.c:885:class_export_put()) final put ffff8e590cc74800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:1.0:1788572356.996338:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc74800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-OST0000 00000020:00000080:1.0:1788572356.996388:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590cc73800 for lustre-OST0000 00010000:00010000:0.0:1788572357.118371:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572357.513141:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584358912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572357.513219:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572357.513409:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584358912 00000100:00100000:3.0:1788572357.513417:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584358912 00000100:00100000:3.0:1788572357.513492:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6334 00000100:00100000:3.0:1788572357.513502:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584358912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572357.513534:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572357.513578:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584358912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572357.513585:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6334 00000100:00080000:3.0:1788572357.513606:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572357.513641:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584358912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572358.025806:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:2.0:1788572358.156250:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572358.532391:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572358.532398:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572358.532402:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572358.532411:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9106 00000100:00080000:0.0:1788572358.532417:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572358.532424:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572358.532448:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4101ad80 x1875444584359168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572358.532531:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572358.532535:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572358.532537:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572358.532540:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9106 00000100:00080000:0.0:1788572358.532543:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572358.532547:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572358.532561:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4101a300 x1875444584359424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572358.532612:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572358.532615:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572358.532616:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572358.532619:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9106 00000100:00080000:0.0:1788572358.532622:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572358.532625:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572358.532635:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905f6c380 x1875444584359808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572358.532644:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572358.532647:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572358.532649:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572358.532652:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9106 00000100:00080000:0.0:1788572358.532654:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572358.532657:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572358.532666:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905f6fb80 x1875444584359936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572358.532708:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4101aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584359296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.532777:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572358.532836:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788572358.532842:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584359040:0@lo:400:kworker.0 00000400:00000100:0.0:1788572358.532863:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584359040 offset 0 length 224: 4 00000100:00100000:0.0:1788572358.532881:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584360064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.532900:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572358.533376:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4101ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584359168:0@lo:38:kworker.0 00000100:00100000:0.0:1788572358.533404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572358.533422:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4101a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584359424:0@lo:38:kworker.0 00000100:00100000:0.0:1788572358.533444:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572358.533498:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584359808:0@lo:38:kworker.0 00000100:00100000:0.0:1788572358.533531:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572358.533547:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584359936:0@lo:38:kworker.0 00000100:00100000:0.0:1788572358.533668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572358.533703:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584359296 00000100:00100000:0.0:1788572358.533711:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584359296 00000100:00100000:0.0:1788572358.533754:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584360064 00000100:00100000:0.0:1788572358.533757:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584360064 00000100:00100000:0.0:1788572358.533774:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584359168 00000100:00100000:0.0:1788572358.533776:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584359168 00000100:00100000:0.0:1788572358.533784:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584359808 00000100:00100000:0.0:1788572358.533786:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584359808 00000100:00100000:0.0:1788572358.533793:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584359936 00000100:00100000:0.0:1788572358.533795:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584359936 00000100:00100000:0.0:1788572358.533805:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788572358.533813:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584359296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.533867:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584359296:12345-0@lo:400:kworker.0 Request processed in 55us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572358.533874:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788572358.533892:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788572358.533897:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584360064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.533937:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584360064:12345-0@lo:400:kworker.0 Request processed in 40us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572358.533943:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788572358.533955:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1788572358.533960:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584359168:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572358.533978:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572358.534013:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584359168:12345-0@lo:38:kworker.0 Request processed in 52us (608us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572358.534019:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1788572358.534032:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1788572358.534036:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584359808:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572358.534044:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572358.534067:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584359808:12345-0@lo:38:kworker.0 Request processed in 30us (535us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572358.534072:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1788572358.534084:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1788572358.534087:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584359936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572358.534096:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572358.534118:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584359936:12345-0@lo:38:kworker.0 Request processed in 29us (552us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572358.534124:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1788572358.534151:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584359424 00000100:00100000:0.0:1788572358.534155:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584359424 00000100:00100000:0.0:1788572358.534176:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1788572358.534181:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584359424:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572358.534190:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572358.534213:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584359424:12345-0@lo:38:kworker.0 Request processed in 32us (768us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572358.534219:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00080000:0.0:1788572358.534237:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572358.534265:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572358.534269:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572358.534273:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4101ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584359168:0@lo:38:kworker.0 00000100:00080000:0.0:1788572358.534283:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572358.534286:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572358.534288:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4101a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584359424:0@lo:38:kworker.0 00000100:00080000:0.0:1788572358.534295:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572358.534297:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572358.534300:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584359808:0@lo:38:kworker.0 00000100:00080000:0.0:1788572358.534306:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572358.534308:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572358.534310:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584359936:0@lo:38:kworker.0 00000100:00100000:0.0:1788572358.534345:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584360064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.534354:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4101aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584359296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.537863:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584359552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.537955:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572358.537998:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572358.538005:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584359680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.538030:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572358.538076:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584359552 00000100:00100000:0.0:1788572358.538085:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584359552 00000100:00100000:0.0:1788572358.538135:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584359680 00000100:00100000:0.0:1788572358.538139:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584359680 00000100:00100000:0.0:1788572358.538171:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7740 00000100:00100000:0.0:1788572358.538180:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584359552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.538235:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584359552:12345-0@lo:400:kworker.0 Request processed in 56us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572358.538242:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7740 00000100:00100000:0.0:1788572358.538261:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7741 00000100:00100000:0.0:1788572358.538267:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584359680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.538290:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584359680:12345-0@lo:400:kworker.0 Request processed in 24us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572358.538296:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7741 00000100:00080000:0.0:1788572358.538319:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572358.538345:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584359680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572358.538355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584359552:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.052801:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572359.172067:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788572359.556893:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572343/real 1788572343] req@ffff8e5905165880 x1875444584354432/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572359.556924:0:3641:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8e5905165880 x1875444584354432/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572359.556933:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788572359.556937:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788572359.556946:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.157@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788572359.556948:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788572359.556952:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5905165880 x1875444584354432/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572359.556961:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5905165180 x1875444584356224/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572359.556980:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a3729d500 x1875444584357632/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572359.556998:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a41019f80 x1875444584359040/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788572359.557006:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788572359.557009:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788572359.557010:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788572359.557012:0:3641:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1788572359.557038:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584354432:0@lo:400:kworker.0 00000100:00100000:3.0:1788572359.557257:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584359040:0@lo:400:kworker.0 00000100:00100000:3.0:1788572359.557266:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584357632:0@lo:400:kworker.0 00000100:00080000:3.0:1788572359.557293:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572359.557299:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788572359.557302:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572359.557308:0:105698:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 9043 00000100:00080000:3.0:1788572359.557317:0:105698:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572359.557344:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a41328000 x1875444584360192/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572359.557365:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572359.557369:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572359.557371:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572359.557374:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9111 00000100:00080000:3.0:1788572359.557377:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572359.557381:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572359.557397:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f32300 x1875444584360320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572359.557418:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572359.557422:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572359.557424:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572359.557427:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9111 00000100:00080000:3.0:1788572359.557430:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572359.557433:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572359.557445:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104e300 x1875444584360576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572359.557466:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572359.557469:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572359.557471:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572359.557504:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9111 00000100:00080000:3.0:1788572359.557506:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572359.557510:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572359.557524:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36a4fb80 x1875444584360960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572359.557533:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572359.557537:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572359.557539:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572359.557541:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9111 00000100:00080000:3.0:1788572359.557544:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572359.557548:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572359.557558:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36a4df80 x1875444584361088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572359.557590:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584360192:0@lo:250:kworker.0 00000400:00000100:3.0:1788572359.557639:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584360192 offset 0 length 520: 4 00000100:00100000:0.0:1788572359.557775:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584360832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572359.560122:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584360704:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.560843:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584360448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.565946:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572359.566018:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584356224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572359.573898:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584360320:0@lo:38:kworker.0 00000100:00100000:3.0:1788572359.573967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572359.574014:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584360576:0@lo:38:kworker.0 00000100:00100000:3.0:1788572359.574040:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572359.574082:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584360576 00000100:00100000:3.0:1788572359.574090:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584360576 00000100:00100000:3.0:1788572359.574131:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1788572359.574138:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584360576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572359.574161:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572359.574202:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584360576:12345-0@lo:38:kworker.0 Request processed in 63us (161us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572359.574214:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1788572359.574244:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584361216:0@lo:400:kworker.0 00000100:00100000:3.0:1788572359.574271:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572359.574322:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572359.574327:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572359.574331:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584360576:0@lo:38:kworker.0 00000100:00100000:3.0:1788572359.574337:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584360960:0@lo:38:kworker.0 00000100:00100000:3.0:1788572359.574362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572359.574382:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584361088:0@lo:38:kworker.0 00000100:00100000:3.0:1788572359.574406:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572359.577826:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584360320 00000100:00100000:0.0:1788572359.577843:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584360320 00000100:00100000:0.0:1788572359.577881:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584361216 00000100:00100000:0.0:1788572359.577884:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584361216 00000100:00100000:0.0:1788572359.577908:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584360960 00000100:00100000:0.0:1788572359.577911:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584360960 00000100:00100000:0.0:1788572359.577918:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584361088 00000100:00100000:0.0:1788572359.577920:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584361088 00000100:00100000:0.0:1788572359.577934:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788572359.577944:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584361216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.578045:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584361216:12345-0@lo:400:kworker.0 Request processed in 102us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572359.578052:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788572359.578072:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1788572359.578076:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584360320:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572359.578096:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572359.578133:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584360320:12345-0@lo:38:kworker.0 Request processed in 55us (4166us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572359.578140:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1788572359.578155:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1788572359.578159:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584360960:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572359.578169:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572359.578191:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584360960:12345-0@lo:38:kworker.0 Request processed in 31us (3829us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572359.578197:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1788572359.578208:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1788572359.578212:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584361088:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572359.578220:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572359.578241:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584361088:12345-0@lo:38:kworker.0 Request processed in 29us (3834us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572359.578248:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1788572359.578303:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584361216:0@lo:400:kworker.0 00000100:00080000:0.0:1788572359.578340:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572359.578345:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572359.578348:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584360320:0@lo:38:kworker.0 00000100:00080000:0.0:1788572359.578358:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572359.578361:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572359.578364:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584360960:0@lo:38:kworker.0 00000100:00080000:0.0:1788572359.578373:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572359.578377:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572359.578380:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584361088:0@lo:38:kworker.0 00000100:00100000:0.0:1788572359.578540:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584360832 00000100:00100000:0.0:1788572359.578545:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584360832 00000100:00100000:0.0:1788572359.578576:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7742 00000100:00100000:0.0:1788572359.578582:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584360832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.578624:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584360832:12345-0@lo:400:kworker.0 Request processed in 41us (12685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572359.578630:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7742 00000100:00100000:0.0:1788572359.578659:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584360832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572359.578863:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572359.578979:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584360704 00000100:00100000:2.0:1788572359.578984:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584360704 00000100:00100000:2.0:1788572359.579030:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7743 00000100:00100000:2.0:1788572359.579038:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584360704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.579075:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584360704:12345-0@lo:400:kworker.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572359.579082:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7743 00000100:00100000:2.0:1788572359.579111:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572359.579135:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584360448 00000100:00100000:2.0:1788572359.579138:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584360448 00000100:00100000:2.0:1788572359.579160:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788572359.579166:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584360448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.579197:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584360448:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572359.579205:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788572359.579232:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584360448:0@lo:400:kworker.0 00000100:00080000:1.0:1788572359.579801:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572359.579828:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584360704:0@lo:400:kworker.0 00000100:00100000:0.0:1788572360.073583:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572360.190110:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572360.576691:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572360.576717:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584361344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572360.576793:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572360.576862:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584361344 00000100:00100000:3.0:1788572360.576872:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584361344 00000100:00100000:3.0:1788572360.576940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6335 00000100:00100000:3.0:1788572360.576951:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584361344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572360.576983:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141248 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572360.577030:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584361344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572360.577037:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6335 00000100:00080000:3.0:1788572360.577059:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572360.577094:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584361344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572361.087152:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572361.212717:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572362.092851:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572362.092893:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569501568 00000100:00100000:3.0:1788572362.092903:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569501568 00000100:00100000:3.0:1788572362.092949:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1080 00000100:00100000:3.0:1788572362.092958:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569501568:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:3.0:1788572362.092984:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572362.093042:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569501568:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 83us (202us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572362.093050:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1080 00000100:00100000:0.0:1788572362.101229:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572362.101305:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569501696 00000100:00100000:1.0:1788572362.101316:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569501696 00000100:00100000:1.0:1788572362.101389:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 338 00000100:00100000:1.0:1788572362.101400:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569501696:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572362.101500:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569501696:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572362.101509:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 338 00000100:00080000:0.0:1788572362.101784:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572362.116180:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:2.0:1788572362.242275:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572362.634247:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572362.634273:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584361472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572362.634347:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572362.634530:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584361472 00000100:00100000:2.0:1788572362.634547:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584361472 00000100:00100000:2.0:1788572362.634614:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6336 00000100:00100000:2.0:1788572362.634623:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584361472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572362.634653:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572362.634701:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584361472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572362.634708:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6336 00000100:00100000:2.0:1788572362.634764:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584361472:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788572362.634920:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572363.134015:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572363.261647:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572364.156847:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:2.0:1788572364.284992:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572364.674019:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572364.674039:0:186041:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788572364.674043:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572364.674048:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572364.674053:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572364.674061:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9112 00000100:00080000:3.0:1788572364.674066:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572364.674073:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572364.674111:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36a4ed80 x1875444584361600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572364.674167:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572364.674170:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572364.674172:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572364.674176:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9112 00000100:00080000:3.0:1788572364.674178:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572364.674183:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572364.674197:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584361728:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.674266:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.674868:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584361728 00000100:00100000:3.0:1788572364.674877:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584361728 00000100:00100000:3.0:1788572364.674935:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788572364.674945:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584361728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.675005:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584361728:12345-0@lo:400:kworker.0 Request processed in 63us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572364.675012:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00080000:3.0:1788572364.675036:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572364.675068:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584361728:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.675102:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104df80 x1875444584361856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572364.675159:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584361984:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.675190:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.675237:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584361984 00000100:00100000:3.0:1788572364.675241:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584361984 00000100:00100000:3.0:1788572364.675276:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7744 00000100:00100000:3.0:1788572364.675297:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584361984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.675338:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584361984:12345-0@lo:400:kworker.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572364.675345:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7744 00000100:00080000:3.0:1788572364.675365:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572364.675382:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584361984:0@lo:400:kworker.0 00000100:00080000:3.0:1788572364.675425:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572364.675428:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572364.675431:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572364.675435:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9112 00000100:00080000:3.0:1788572364.675438:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572364.675443:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572364.675451:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584362112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.675765:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.675805:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584362112 00000100:00100000:3.0:1788572364.675810:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584362112 00000100:00100000:3.0:1788572364.675843:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7745 00000100:00100000:3.0:1788572364.675851:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584362112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.675893:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584362112:12345-0@lo:400:kworker.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572364.675900:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7745 00000100:00080000:3.0:1788572364.675916:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572364.675933:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584362112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.675957:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590a804000 x1875444584362240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572364.675967:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572364.675971:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572364.675972:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572364.675976:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9112 00000100:00080000:3.0:1788572364.675978:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572364.675982:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572364.675993:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3f8f0000 x1875444584362368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572364.676024:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572364.676031:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584362496:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.676060:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.676090:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584362496 00000100:00100000:3.0:1788572364.676093:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584362496 00000100:00100000:3.0:1788572364.676122:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788572364.676129:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584362496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.676164:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584362496:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572364.676170:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:3.0:1788572364.676186:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572364.676201:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584362496:0@lo:400:kworker.0 00000100:00100000:0.0:1788572364.676418:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584361600:0@lo:38:kworker.0 00000100:00100000:0.0:1788572364.676452:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572364.676519:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584361856:0@lo:38:kworker.0 00000100:00100000:0.0:1788572364.676547:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572364.676585:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584362240:0@lo:38:kworker.0 00000100:00100000:0.0:1788572364.676611:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572364.676629:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584362368:0@lo:38:kworker.0 00000100:00100000:0.0:1788572364.676661:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572364.676691:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584361856 00000100:00100000:0.0:1788572364.676696:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584361856 00000100:00100000:0.0:1788572364.676722:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1788572364.676727:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584361856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572364.676745:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572364.676776:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584361856:12345-0@lo:38:kworker.0 Request processed in 49us (229us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572364.676786:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1788572364.676807:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584361600 00000100:00100000:0.0:1788572364.676811:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584361600 00000100:00100000:0.0:1788572364.676826:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584362240 00000100:00100000:0.0:1788572364.676828:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584362240 00000100:00100000:0.0:1788572364.676836:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584362368 00000100:00100000:0.0:1788572364.676838:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584362368 00000100:00100000:0.0:1788572364.676846:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788572364.676851:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584361600:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572364.676861:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572364.676887:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584361600:12345-0@lo:38:kworker.0 Request processed in 35us (434us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572364.676893:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788572364.676905:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788572364.676908:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584362240:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572364.676917:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572364.676937:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584362240:12345-0@lo:38:kworker.0 Request processed in 28us (326us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572364.676944:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788572364.676953:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788572364.676957:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584362368:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572364.676966:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572364.676986:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584362368:12345-0@lo:38:kworker.0 Request processed in 27us (324us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572364.676991:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00080000:0.0:1788572364.677017:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572364.677023:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572364.677025:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584361600:0@lo:38:kworker.0 00000100:00080000:0.0:1788572364.677034:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572364.677038:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572364.677040:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584361856:0@lo:38:kworker.0 00000100:00080000:0.0:1788572364.677047:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572364.677050:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572364.677052:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584362240:0@lo:38:kworker.0 00000100:00080000:0.0:1788572364.677059:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572364.677062:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572364.677064:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584362368:0@lo:38:kworker.0 00000020:01000004:2.0:1788572365.002636:0:196575:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788572365.002642:0:196575:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788572365.002644:0:196575:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788572365.002768:0:196575:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e5a0f05c800 00000020:01000004:2.0:1788572365.002786:0:196575:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788572365.002801:0:196575:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788572365.002815:0:196575:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e5a401499c0) 00000020:00000080:2.0:1788572365.002833:0:196575:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788572365.161182:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788572365.171772:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000100:00100000:0.0:1788572365.180578:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00100000:10000000:3.0:1788572365.193022:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788572365.194078:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788572365.201573:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788572365.202129:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788572365.202750:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788572365.203017:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788572365.203722:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788572365.203911:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788572365.204102:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788572365.204435:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788572365.211326:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788572365.212415:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.213271:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.213562:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788572365.213793:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.213971:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788572365.214228:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.214444:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.214652:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788572365.214849:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.216210:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788572365.218469:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788572365.219299:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.219667:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788572365.219938:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.220280:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.220676:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788572365.223992:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.224503:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788572365.224792:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788572365.225320:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788572365.225621:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788572365.226088:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.227924:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788572365.228842:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788572365.229099:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.230447:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788572365.231295:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788572365.232304:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.232628:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.234499:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788572365.235269:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788572365.235620:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.235882:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.240298:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.243863:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.244532:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.244809:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.246808:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.247280:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788572365.248328:0:196575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788572365.248901:0:196575:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788572365.249115:0:196575:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788572365.249123:0:196575:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788572365.249669:0:196575:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bdfb1 00000020:01000004:1.0:1788572365.249678:0:196575:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788572365.249691:0:196575:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788572365.249698:0:196575:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a0f05c800 from MGS 00000020:01000004:1.0:1788572365.249702:0:196575:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788572365.249712:0:196575:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e5a37203380) 00000020:00000080:1.0:1788572365.249725:0:196575:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:1.0:1788572365.249791:0:196575:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a0f05c800 from MGS, refs=2 00080000:01000000:1.0:1788572365.249796:0:196575:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788572365.249801:0:196575:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bdfbf 00010000:00010000:1.0:1788572365.249941:0:196575:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788572365.262472:0:196575:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788572365.271971:0:196580:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788572365.272046:0:196575:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788572365.272101:0:196575:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788572365.272920:0:196575:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788572365.273194:0:196575:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572365.273364:0:196575:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788572365.273372:0:196575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788572365.274760:0:196575:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788572365.274773:0:196575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788572365.277363:0:196575:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788572365.277375:0:196575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788572365.277886:0:196575:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788572365.277916:0:196575:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788572365.277918:0:196575:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.157@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788572365.277921:0:196575:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.157@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1788572365.277927:0:196575:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 260, was 0): CONNECTING 00000100:00100000:3.0:1788572365.277932:0:196575:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:3.0:1788572365.309980:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572365.692806:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572365.692826:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584362624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572365.692904:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572365.693077:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584362624 00000100:00100000:3.0:1788572365.693085:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584362624 00000100:00100000:3.0:1788572365.693143:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6337 00000100:00100000:3.0:1788572365.693163:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584362624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572365.693194:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141248 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572365.693263:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584362624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572365.693270:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6337 00000100:00100000:1.0:1788572365.693462:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584362624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572366.204635:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572366.332917:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572367.221076:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572367.221128:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572367.221171:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572367.221312:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569502080 00000100:00100000:0.0:1788572367.221322:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569502080 00000100:00100000:0.0:1788572367.221388:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569501952 00000100:00100000:0.0:1788572367.221392:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569501952 00000100:00100000:0.0:1788572367.221411:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 341 00000100:00100000:0.0:1788572367.221422:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569502080:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572367.221536:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569502080:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 116us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572367.221545:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 341 00000100:00100000:0.0:1788572367.221580:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1084 00000100:00100000:0.0:1788572367.221585:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569501952:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:0.0:1788572367.221607:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572367.221648:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569501952:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 60us (476us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572367.221655:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1084 00000100:00100000:2.0:1788572367.221969:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569501824 00000100:00100000:2.0:1788572367.221975:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569501824 00000100:00100000:2.0:1788572367.222010:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 0 00000100:00100000:2.0:1788572367.222015:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2396:x1875444569501824:12345-192.168.202.57@tcp:250:kworker.0 00010000:00080000:2.0:1788572367.222033:0:196581:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f79285ed-4685-45a8-8731-5e2522a143f3@192.168.202.57@tcp t0 exp 0000000000000000 cur 9120 last 0 00000020:00000080:2.0:1788572367.222060:0:196581:0:(genops.c:1385:class_connect()) connect: client f79285ed-4685-45a8-8731-5e2522a143f3, cookie 0x265cfe11109bdfc6 00000100:00080000:2.0:1788572367.222213:0:196581:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572367.222251:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+5:2396:x1875444569501824:12345-192.168.202.57@tcp:250:kworker.0 Request processed in 234us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572367.222260:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 0 00000100:00080000:3.0:1788572367.222434:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572367.229869:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:2.0:1788572367.356909:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572367.743630:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584362752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572367.743719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572367.743872:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584362752 00000100:00100000:2.0:1788572367.743881:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584362752 00000100:00100000:2.0:1788572367.743950:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6338 00000100:00100000:2.0:1788572367.743960:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584362752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572367.743991:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572367.744036:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584362752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572367.744044:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6338 00000100:00080000:3.0:1788572367.744106:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572367.744155:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584362752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572368.252674:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572368.382688:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572368.427663:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572368.429722:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569502208 00000100:00100000:0.0:1788572368.429739:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569502208 00000100:00100000:0.0:1788572368.429819:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1 00000100:00100000:0.0:1788572368.429830:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+5:160932:x1875444569502208:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572368.429848:0:196583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572368.429871:0:196583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb390 expref: -99 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572368.429900:0:196583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb390 expref: 6 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572368.429912:0:196583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb390 expref: 6 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572368.429922:0:196583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1a00, rc 0) 00000100:00100000:0.0:1788572368.429996:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+6:160932:x1875444569502208:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 167us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572368.430004:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1 00000100:00100000:1.0:1788572368.433991:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572368.434192:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569502336 00000100:00100000:0.0:1788572368.434208:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569502336 00000100:00100000:0.0:1788572368.434308:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2 00000100:00100000:0.0:1788572368.434323:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+6:160932:x1875444569502336:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788572368.434748:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+6:160932:x1875444569502336:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 Request processed in 427us (773us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572368.434758:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2 00000100:00100000:1.0:1788572368.462768:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572368.464691:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569502464 00000100:00100000:2.0:1788572368.464716:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569502464 00000100:00100000:2.0:1788572368.464889:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 3 00000100:00100000:2.0:1788572368.464914:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+6:160932:x1875444569502464:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572368.464940:0:196581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572368.464982:0:196581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb4e00/0x265cfe11109bdfd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb397 expref: -99 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572368.465022:0:196581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb4e00/0x265cfe11109bdfd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb397 expref: 7 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572368.465037:0:196581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb4e00/0x265cfe11109bdfd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb397 expref: 7 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572368.465048:0:196581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4e00, rc 0) 00000100:00100000:2.0:1788572368.465160:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+7:160932:x1875444569502464:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 260us (2407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572368.465169:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 3 00000100:00100000:3.0:1788572368.475902:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572368.483034:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569502592 00000100:00100000:0.0:1788572368.483055:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569502592 00000100:00100000:0.0:1788572368.483153:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4 00000100:00100000:0.0:1788572368.483167:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+7:160932:x1875444569502592:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788572368.487598:0:196584:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788572368.487895:0:196582:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 335 20000000:01000000:2.0:1788572368.497020:0:196585:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788572368.497033:0:196585:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788572368.497037:0:196585:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788572368.497040:0:196585:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788572368.498558:0:196585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788572368.502884:0:196582:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788572368.502997:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+8:160932:x1875444569502592:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 19825us (27103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572368.503009:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4 00000100:00100000:3.0:1788572368.504971:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572368.505251:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569502720 00000100:00100000:2.0:1788572368.505266:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569502720 00000100:00100000:2.0:1788572368.505341:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5 00000100:00100000:2.0:1788572368.505355:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+8:160932:x1875444569502720:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572368.505629:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+8:160932:x1875444569502720:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 Request processed in 276us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572368.505646:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5 00000100:00100000:1.0:1788572368.513612:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572368.513761:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569502848 00000100:00100000:0.0:1788572368.513775:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569502848 00000100:00100000:0.0:1788572368.513846:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6 00000100:00100000:0.0:1788572368.513859:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+8:160932:x1875444569502848:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572368.513884:0:196582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572368.513915:0:196582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe0a00/0x265cfe11109bdfdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb39e expref: -99 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572368.513953:0:196582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe0a00/0x265cfe11109bdfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb39e expref: 9 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572368.513968:0:196582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe0a00/0x265cfe11109bdfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb39e expref: 9 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572368.513978:0:196582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0a00, rc 0) 00000100:00100000:0.0:1788572368.514055:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569502848:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 199us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572368.514063:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6 00000100:00100000:0.0:1788572368.516908:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572368.517093:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569502976 00000100:00100000:1.0:1788572368.517111:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569502976 00000100:00100000:1.0:1788572368.517198:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7 00000100:00100000:1.0:1788572368.517211:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569502976:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572368.517454:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569502976:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 245us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572368.517464:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7 00000100:00100000:3.0:1788572368.526273:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572368.526350:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569503104 00000100:00100000:2.0:1788572368.526368:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569503104 00000100:00100000:2.0:1788572368.526587:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8 00000100:00100000:2.0:1788572368.526601:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569503104:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572368.526939:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569503104:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 Request processed in 339us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572368.526948:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8 00000100:00100000:2.0:1788572368.538280:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572368.538715:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569503232 00000100:00100000:0.0:1788572368.538729:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569503232 00000100:00100000:0.0:1788572368.538806:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9 00000100:00100000:0.0:1788572368.538820:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569503232:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572368.538847:0:196582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572368.538872:0:196582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1000/0x265cfe11109bdfe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3a5 expref: -99 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572368.538911:0:196582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1000/0x265cfe11109bdfe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3a5 expref: 10 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572368.538925:0:196582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1000/0x265cfe11109bdfe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3a5 expref: 10 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572368.538935:0:196582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1000, rc 0) 00000100:00100000:0.0:1788572368.539018:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569503232:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 200us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572368.539027:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9 00000100:00100000:0.0:1788572368.541340:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572368.541873:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569503360 00000100:00100000:2.0:1788572368.541890:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569503360 00000100:00100000:2.0:1788572368.541978:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10 00000100:00100000:2.0:1788572368.541991:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569503360:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572368.542177:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569503360:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 187us (846us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572368.542187:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10 00000100:00100000:1.0:1788572369.279252:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:2.0:1788572369.405314:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:02000400:3.0:1788572369.788818:0:177320:0:(service.c:2875:ptlrpc_watchdog_fire()) mdt00_000: service thread pid 188048 was inactive for 40.539 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: 00000100:00080000:0.0:1788572369.788978:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572369.788987:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788572369.788990:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572369.788995:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572369.789000:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572369.789011:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9117 00000100:00080000:0.0:1788572369.789016:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572369.789025:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572369.789085:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905f6c700 x1875444584362880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572369.789143:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572369.789148:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572369.789150:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572369.789154:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9117 00000100:00080000:0.0:1788572369.789158:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572369.789163:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572369.789182:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590a804000 x1875444584363136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572369.789218:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572369.789222:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572369.789223:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572369.789228:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9117 00000100:00080000:0.0:1788572369.789230:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572369.789234:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572369.789247:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a27420a80 x1875444584363520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572369.789257:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572369.789261:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572369.789262:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572369.789266:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9117 00000100:00080000:0.0:1788572369.789268:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572369.789272:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572369.789296:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a27420380 x1875444584363648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572369.789347:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572359/real 1788572359] req@ffff8e5a41328000 x1875444584360192/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572369.789383:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e5a41328000 x1875444584360192/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572369.789409:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584362880:0@lo:38:kworker.0 00000100:00100000:0.0:1788572369.789522:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.789591:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584363136:0@lo:38:kworker.0 00000100:00100000:0.0:1788572369.789634:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.789661:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584363520:0@lo:38:kworker.0 00000100:00100000:0.0:1788572369.789702:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.789722:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584363648:0@lo:38:kworker.0 00000100:00100000:0.0:1788572369.789743:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572369.789763:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572369.789776:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788572369.789785:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584360192:0@lo:250:kworker.0 00000100:00100000:0.0:1788572369.789823:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584363008:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.789851:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.789873:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572369.789880:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584363776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.789905:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.789927:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584363392:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.789955:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.789975:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572369.789980:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584363264:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.790004:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.790040:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584362880 00000100:00100000:0.0:1788572369.790050:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584362880 00000100:00100000:0.0:1788572369.790079:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584363520 00000100:00100000:0.0:1788572369.790082:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584363520 00000100:00100000:0.0:1788572369.790091:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584363648 00000100:00100000:0.0:1788572369.790093:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584363648 00000100:00100000:0.0:1788572369.790100:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584363008 00000100:00100000:0.0:1788572369.790102:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584363008 00000100:00100000:1.0:1788572369.790105:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584363776 00000100:00100000:1.0:1788572369.790109:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584363776 00000100:00100000:2.0:1788572369.790202:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584363392 00000100:00100000:2.0:1788572369.790207:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584363392 00000100:00100000:0.0:1788572369.790460:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788572369.790474:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584363008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.790574:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584363008:12345-0@lo:400:kworker.0 Request processed in 104us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572369.790582:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788572369.796023:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788572369.796059:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584363776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.796293:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584363776:12345-0@lo:400:kworker.0 Request processed in 248us (6381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.796302:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788572369.796351:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1788572369.796367:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584362880:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572369.796401:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572369.796503:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584362880:12345-0@lo:38:kworker.0 Request processed in 109us (6956us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572369.798080:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1788572369.798133:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1788572369.798143:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584363520:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572369.798173:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572369.798263:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584363520:12345-0@lo:38:kworker.0 Request processed in 120us (8559us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572369.798269:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1788572369.798286:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1788572369.798291:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584363648:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572369.798301:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572369.798326:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584363648:12345-0@lo:38:kworker.0 Request processed in 34us (8582us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572369.798332:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1788572369.798340:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584363264 00000100:00100000:0.0:1788572369.798352:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584363264 00000100:00100000:1.0:1788572369.798355:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584363136 00000100:00100000:1.0:1788572369.798358:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584363136 00000100:00100000:1.0:1788572369.798388:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1788572369.798392:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584363136:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572369.798401:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7746 00010000:00020000:1.0:1788572369.798402:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572369.798410:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584363264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.798433:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584363136:12345-0@lo:38:kworker.0 Request processed in 40us (8799us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572369.798439:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1788572369.798466:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584363264:12345-0@lo:400:kworker.0 Request processed in 59us (8460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572369.798472:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7746 00000100:00080000:1.0:1788572369.798505:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572369.798513:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572369.798517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572369.798521:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572369.798551:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584363264:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.798614:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584363776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.798631:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584363008:0@lo:400:kworker.0 10000000:01000000:0.0:1788572369.798777:0:196575:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788572369.798802:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdb2e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.798817:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdb2e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.798823:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788572369.798838:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.798848:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0600/0x265cfe11109bdb27 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdb2e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.798872:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdabe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.798878:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdabe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.798883:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572369.798887:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.798890:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1616fe00/0x265cfe11109bdab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdabe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.798899:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdada expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.798906:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdada expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.798911:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572369.798915:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.798918:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1616ea00/0x265cfe11109bdad3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdada expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.798932:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdb04 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.798938:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdb04 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.798944:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572369.798947:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.798951:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11255a00/0x265cfe11109bdafd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdb04 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.798962:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdb12 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.798969:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdb12 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.798974:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572369.798977:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.798980:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bdb0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdb12 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.798992:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.798998:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.799002:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572369.799007:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.799010:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1616f000/0x265cfe11109bdb35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdb3c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.799019:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdc85 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.799026:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdc85 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.799031:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572369.799035:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.799038:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109bdc7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdc85 expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.799047:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdcbd expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.799052:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdcbd expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.799057:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572369.799061:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.799063:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11255c00/0x265cfe11109bdcb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdcbd expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.799076:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdd0a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.799083:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdd0a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.799093:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572369.799096:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.799099:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a00030400/0x265cfe11109bdd03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdd0a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572369.799100:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572369.799104:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584362880:0@lo:38:kworker.0 00010000:00010000:0.0:1788572369.799116:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdae8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.799122:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdae8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572369.799124:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572369.799127:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 10000000:01000000:0.0:1788572369.799128:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00100000:1.0:1788572369.799130:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584363136:0@lo:38:kworker.0 00010000:00010000:0.0:1788572369.799131:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.799134:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1c00/0x265cfe11109bdae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdae8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572369.799141:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00010000:0.0:1788572369.799144:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdaf6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572369.799145:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572369.799148:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584363520:0@lo:38:kworker.0 10000000:00010000:0.0:1788572369.799151:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdaf6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.799156:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00080000:1.0:1788572369.799159:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00010000:0.0:1788572369.799160:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1788572369.799162:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00010000:00010000:0.0:1788572369.799164:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bdaef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdaf6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572369.799165:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584363648:0@lo:38:kworker.0 00010000:00010000:0.0:1788572369.799173:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdb20 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.799183:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdb20 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.799189:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788572369.799192:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788572369.799195:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bdb19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdb20 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.799203:0:196575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bdcaf expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572369.799210:0:196575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bdcaf expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572369.799214:0:196575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00080000:1.0:1788572369.799217:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572369.799222:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00010000:00010000:0.0:1788572369.799224:0:196575:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1788572369.799225:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00010000:00010000:0.0:1788572369.799227:0:196575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2a00/0x265cfe11109bdca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bdcaf expref: -99 pid: 194756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572369.799229:0:177620:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 9112 00000100:00080000:1.0:1788572369.799234:0:177620:0:(import.c:630:import_select_connection()) MGC192.168.202.157@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572369.799241:0:177620:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 00000100:00080000:0.0:1788572369.799254:0:196575:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 261, was 0): CONNECTING 00000100:00080000:0.0:1788572369.799259:0:196575:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788572369.799274:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fafdc00 x1875444584363904/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572369.799313:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584363904:0@lo:250:kworker.0 00000100:00100000:0.0:1788572369.799376:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572369.799776:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7747 00000100:00100000:2.0:1788572369.799790:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584363392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572369.799857:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584363392:12345-0@lo:400:kworker.0 Request processed in 71us (9900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572369.799864:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7747 00000100:00100000:2.0:1788572369.799904:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584363392:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.801274:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584363904 00000100:00100000:1.0:1788572369.801306:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584363904 00000100:00100000:1.0:1788572369.801412:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788572369.801420:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3640:x1875444584363904:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1788572369.801454:0:196583:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e87131b0-4a60-4def-a26d-6e23dcfe5daa@0@lo t0 exp 0000000000000000 cur 9122 last 0 00000020:00000080:1.0:1788572369.803093:0:196583:0:(genops.c:1385:class_connect()) connect: client e87131b0-4a60-4def-a26d-6e23dcfe5daa, cookie 0x265cfe11109bdfe9 00000100:00080000:1.0:1788572369.806314:0:196583:0:(import.c:65:import_set_state_nolock()) ffff8e590cc73800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572369.808930:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+5:3640:x1875444584363904:12345-0@lo:250:kworker.0 Request processed in 7491us (9536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.808952:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788572369.810864:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.157@tcp: connect to target with instance 0 10000000:01000000:0.0:1788572369.810886:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:0.0:1788572369.810893:0:3640:0:(import.c:1328:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x265cfe11109bdfe9 00000100:00080000:0.0:1788572369.822950:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:0.0:1788572369.822971:0:3640:0:(import.c:1718:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:1.0:1788572369.824954:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584363904:0@lo:250:kworker.0 00000100:00080000:0.0:1788572369.824961:0:196586:0:(import.c:1642:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.202.157@tcp to MGS@0@lo 00000100:00100000:0.0:1788572369.824978:0:196586:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788572369.824985:0:196586:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:0.0:1788572369.825002:0:196586:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1788572369.825009:0:196586:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1788572369.825012:0:196586:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788572369.825054:0:196586:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1788572369.825060:0:196586:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) MGC192.168.202.157@tcp: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1788572369.825151:0:196575:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1788572369.825166:0:196575:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788572369.825214:0:196575:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788572369.825220:0:196575:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788572369.825344:0:196575:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.157@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788572369.825387:0:196575:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.157@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788572369.825391:0:196575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788572369.825393:0:196575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572369.825394:0:196575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572369.825395:0:196575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572369.825396:0:196575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572369.825397:0:196575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572369.825399:0:196575:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572369.825401:0:196575:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572369.825402:0:196575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572369.825403:0:196575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572369.825406:0:196575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788572369.825408:0:196575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788572369.825409:0:196575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572369.825410:0:196575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572369.825411:0:196575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572369.825412:0:196575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572369.825413:0:196575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572369.825414:0:196575:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572369.825415:0:196575:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572369.825416:0:196575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572369.825417:0:196575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572369.825445:0:196575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788572369.825464:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584364032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788572369.825571:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572369.825612:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5902252c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572369.825637:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584364032 00000100:00100000:2.0:1788572369.825645:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584364032 00000100:00100000:2.0:1788572369.825711:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572369.825721:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+5:196575:x1875444584364032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788572369.825764:0:196581:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788572369.825767:0:196581:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788572369.825770:0:196581:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1788572369.825778:0:196581:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000000:1.0:1788572369.826054:0:177620:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.202.157@tcp 10000000:01000000:1.0:1788572369.826069:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788572369.826072:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788572369.826073:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788572369.826075:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572369.826076:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572369.826077:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572369.826078:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572369.826080:0:177620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788572369.826081:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572369.826082:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788572369.826969:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788572369.826979:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1788572369.826982:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788572369.826983:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788572369.826984:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572369.826985:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572369.826988:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572369.826989:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572369.826990:0:177620:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572369.826991:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572369.826993:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788572369.827026:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788572369.827033:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788572369.827035:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788572369.827036:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788572369.827037:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572369.827038:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572369.827039:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572369.827040:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572369.827041:0:177620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788572369.827042:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572369.827043:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788572369.827057:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1788572369.827101:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584364160:0@lo:253:kworker.0 00000100:00100000:1.0:1788572369.827168:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572369.827221:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584364160 00000100:00100000:1.0:1788572369.827227:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584364160 00000100:00100000:1.0:1788572369.827259:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788572369.827268:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+6:3642:x1875444584364160:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788572369.827291:0:196583:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788572369.827306:0:196583:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788572369.827473:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584364288:0@lo:253:kworker.0 00000100:00100000:2.0:1788572369.827527:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572369.827546:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572369.827551:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584364416:0@lo:253:kworker.0 00000100:00100000:2.0:1788572369.827578:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572369.827601:0:196582:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788572369.827609:0:196582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1788572369.827727:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584364288 00000100:00100000:2.0:1788572369.827731:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584364288 00000100:00100000:2.0:1788572369.827749:0:196582:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788572369.827753:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584364416 00000100:00100000:2.0:1788572369.827756:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584364416 00000100:00100000:2.0:1788572369.829459:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572369.829475:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3643:x1875444584364288:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788572369.829525:0:196587:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1788572369.839429:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:196575:x1875444584364032:12345-0@lo:253:mount.lustre.0 Request processed in 13703us (13852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.839443:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788572369.839500:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788572369.839513:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:3643:x1875444584364416:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788572369.839546:0:196581:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788572369.843110:0:196583:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572369.843125:0:196583:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788572369.843272:0:196584:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572369.843278:0:196584:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572369.843301:0:196584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.843325:0:196584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb390 expref: 9 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.843335:0:196584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.843409:0:196584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb390 expref: 9 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.843431:0:196584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb390 expref: 9 pid: 196583 timeout: 9222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572369.843446:0:196584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584364544:192.168.202.57@tcp:104: 00000100:00100000:2.0:1788572369.843569:0:196584:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590520c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572369.843692:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:3642:x1875444584364160:12345-0@lo:253:kworker.0 Request processed in 16411us (16510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572369.843703:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 20000000:01000000:2.0:1788572369.843753:0:196587:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:1.0:1788572369.843929:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788572369.843932:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788572369.843934:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572369.843936:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572369.843937:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572369.843938:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572369.843940:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788572369.843942:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572369.843944:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788572369.843949:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584364160:0@lo:253:kworker.0 00000100:00100000:1.0:1788572369.844008:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584364032:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788572369.844021:0:196575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788572369.844024:0:196575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788572369.844025:0:196575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788572369.844027:0:196575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572369.844028:0:196575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572369.844029:0:196575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572369.844030:0:196575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572369.844031:0:196575:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572369.844033:0:196575:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788572369.844035:0:196575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572369.844037:0:196575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788572369.844056:0:196575:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a0f05c800 from lustre-MDT0000 10000000:01000000:1.0:1788572369.844082:0:196575:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788572369.844085:0:196575:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788572369.844094:0:196575:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5a0f05c800 10000000:01000000:1.0:1788572369.844099:0:196575:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788572369.844103:0:196575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e5a0f05c800 10000000:01000000:1.0:1788572369.844107:0:196575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788572369.844110:0:196575:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a0f05c800 from 1 10000000:01000000:1.0:1788572369.844113:0:196575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788572369.844145:0:196575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.844154:0:196575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.844167:0:196575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572369.844184:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584364672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572369.844216:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572369.844252:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59051293c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572369.844384:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584364672 00000100:00100000:0.0:1788572369.844397:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584364672 00000100:00100000:0.0:1788572369.844466:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788572369.844504:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:196575:x1875444584364672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572369.845362:0:196582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572369.845393:0:196582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdff7 expref: -99 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.845431:0:196582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdff7 expref: 8 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.845445:0:196582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdff7 expref: 8 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.845456:0:196582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe1800, rc 0) 00000100:00100000:0.0:1788572369.846140:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:196575:x1875444584364672:12345-0@lo:101:mount.lustre.0 Request processed in 1660us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572369.846151:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788572369.853106:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584364672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572369.853139:0:196575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.853152:0:196575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572369.853173:0:196575:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788572369.853188:0:196575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.853196:0:196575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572369.853203:0:196575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788572369.853360:0:196575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788572369.853367:0:196575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e5a0f05c800 10000000:01000000:1.0:1788572369.853370:0:196575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788572369.853374:0:196575:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788572369.853377:0:196575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788572369.853416:0:196575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.853424:0:196575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.853434:0:196575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572369.853454:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584364800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572369.853537:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572369.853573:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59051293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572369.853594:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584364800 00000100:00100000:1.0:1788572369.853601:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584364800 00000100:00100000:1.0:1788572369.853642:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788572369.853651:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:196575:x1875444584364800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572369.853665:0:196583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572369.853692:0:196583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1ffce000/0x265cfe11109be00c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be005 expref: -99 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.853714:0:196583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1ffce000/0x265cfe11109be00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be005 expref: 9 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.853723:0:196583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1ffce000/0x265cfe11109be00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be005 expref: 9 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.853732:0:196583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffce000, rc 0) 00000100:00100000:1.0:1788572369.853773:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:196575:x1875444584364800:12345-0@lo:101:mount.lustre.0 Request processed in 122us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.853779:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788572369.857076:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584364800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572369.857118:0:196575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572369.857141:0:196575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572369.857260:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584364928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572369.857342:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.857394:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572369.857420:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584364928 00000100:00100000:0.0:1788572369.857427:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584364928 00000100:00100000:0.0:1788572369.857498:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788572369.858797:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:196575:x1875444584364928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572369.859210:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196575:x1875444584364928:12345-0@lo:501:mount.lustre.0 Request processed in 1700us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572369.859222:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788572369.859322:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584364928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572369.859378:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584365056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572369.859442:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.859466:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572369.861407:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584365056 00000100:00100000:0.0:1788572369.861429:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584365056 00000100:00100000:0.0:1788572369.861548:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572369.861561:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196575:x1875444584365056:12345-0@lo:503:mount.lustre.0 20000000:01000000:2.0:1788572369.863425:0:196587:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572369.863434:0:196587:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788572369.863551:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196575:x1875444584365056:12345-0@lo:503:mount.lustre.0 Request processed in 1984us (4099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572369.863567:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788572369.864014:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:3643:x1875444584364288:12345-0@lo:253:kworker.0 Request processed in 34538us (36480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572369.864028:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:0.0:1788572369.867087:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788572369.867093:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788572369.867094:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572369.867095:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572369.867097:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572369.867098:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572369.867099:0:3643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572369.867101:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572369.867103:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788572369.867111:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584364288:0@lo:253:kworker.0 00000100:00100000:1.0:1788572369.867187:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584365056:0@lo:503:mount.lustre.0 20000000:01000000:0.0:1788572369.867752:0:196581:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788572369.869059:0:196588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196588:1875444584365184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572369.869200:0:196588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572369.869237:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572369.869275:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584365184 00000100:00100000:0.0:1788572369.869290:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584365184 00000100:00100000:2.0:1788572369.869299:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569503488 00000100:00100000:2.0:1788572369.869310:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569503488 00010000:00010000:2.0:1788572369.869356:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb390 expref: 10 pid: 196583 timeout: 9222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572369.869368:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788572369.869382:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:196588:x1875444584365184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572369.869397:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12902 00000100:00100000:2.0:1788572369.869411:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a04f34050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569503488:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572369.869425:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572369.869431:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb390 expref: 10 pid: 196583 timeout: 9222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869444:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb390 expref: 10 pid: 196583 timeout: 9222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869467:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869476:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788572369.869514:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026237113s 00010000:00010000:2.0:1788572369.869520:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869527:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869533:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869540:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869545:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572369.869550:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869558:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869568:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.869577:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572369.869623:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a04f34050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569503488:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 216us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572369.869630:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12902 00010000:00010000:1.0:1788572369.869881:0:196584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1a00/0x265cfe11109bdfcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb390 expref: 9 pid: 196583 timeout: 9222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572369.869906:0:196584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584364544:192.168.202.57@tcp:104: 00010000:00010000:1.0:1788572369.869935:0:196584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.869946:0:196584:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.869953:0:196584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572369.869960:0:196584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109bdff0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572369.870353:0:196588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572369.877470:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:196588:x1875444584365184:12345-0@lo:502:llog_process_th.0 Request processed in 8058us (8236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572369.877818:0:196588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196588:1875444584365184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788572369.877885:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572369.877902:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572369.877904:0:196588:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788572369.877918:0:196588:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788572369.877922:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788572369.877954:0:196588:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e590218b380) 00000020:00000080:0.0:1788572369.877986:0:196588:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1788572369.877995:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788572369.878069:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00080000:01000000:0.0:1788572369.878121:0:196588:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788572369.878132:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109be01a 00000020:00000080:0.0:1788572369.879040:0:196588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788572369.879051:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572369.879060:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572369.879062:0:196588:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788572369.879067:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572369.879072:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572369.879074:0:196588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788572369.879078:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788572369.879091:0:196588:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e5a413fcd40) 00000020:00000080:0.0:1788572369.879112:0:196588:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1788572369.879118:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788572369.879120:0:196588:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788572369.879123:0:196588:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788572369.879128:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788572369.879192:0:196588:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a0f05c800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788572369.879203:0:196588:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e5a413fb380) 00000020:00000080:0.0:1788572369.879214:0:196588:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 20000000:01000000:1.0:1788572369.879283:0:196581:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000004:01000000:0.0:1788572369.879290:0:196588:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788572369.879302:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109be02f 20000000:01000000:1.0:1788572369.879363:0:196581:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788572369.880117:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3643:x1875444584364416:12345-0@lo:253:kworker.0 Request processed in 40599us (52528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.880134:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000004:0.0:1788572369.880649:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788572369.880653:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572369.880655:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572369.880656:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572369.880658:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572369.880660:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572369.880662:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572369.880664:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572369.880665:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788572369.880670:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584364416:0@lo:253:kworker.0 00000020:00000080:0.0:1788572369.880915:0:196588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788572369.880981:0:196588:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788572369.880995:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x265cfe11109be036 00080000:01000000:0.0:1788572369.881006:0:196588:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788572369.881012:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109be03d 20000000:01000000:2.0:1788572369.887171:0:196584:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572369.887184:0:196584:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572369.887219:0:196584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.887242:0:196584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788572369.887253:0:196584:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026237113s 00010000:00010000:2.0:1788572369.887258:0:196584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.887265:0:196584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.887273:0:196584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.887280:0:196584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.887286:0:196584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572369.887291:0:196584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.887301:0:196584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.887317:0:196584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.887327:0:196584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572369.887335:0:196584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be044 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572370.055235:0:196588:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788572370.055451:0:196588:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b idx: 0 lr: 0 srv lr: 343597383680 lx: 0 gen 23 00000001:00080000:2.0:1788572370.055940:0:196588:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 326417519069 srv lr: 343597383680 lx: 0 gen 22 00000001:00000004:2.0:1788572370.055974:0:196588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 81, last_transno is 343597383680 00000001:00080000:2.0:1788572370.056304:0:196588:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788572370.056395:0:196588:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e590520c000: xid 1875444569495168, transno 343597383685, client gen 23, slot idx 0 00000001:00080000:2.0:1788572370.056407:0:196588:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e590520c840: xid 1875444569496064, transno 343597383686, client gen 23, slot idx 1 00000001:00080000:2.0:1788572370.056412:0:196588:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e590520c540: xid 1875444581057152, transno 326417519069, client gen 22, slot idx 2 00000001:00080000:2.0:1788572370.056418:0:196588:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e590520cb40: xid 1875444584348288, transno 343597383687, client gen 22, slot idx 3 00000020:00000080:2.0:1788572370.059939:0:196588:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e5a40148000) 00000020:00000080:2.0:1788572370.059997:0:196588:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788572370.060208:0:196588:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788572370.060223:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109be060 00000020:00000080:0.0:1788572370.061331:0:196588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788572370.071728:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x265cfe11109be067 00000020:00000080:3.0:1788572370.075472:0:196588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788572370.075514:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572370.075522:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572370.075524:0:196588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788572370.075529:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572370.075533:0:196588:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788572370.075535:0:196588:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572370.075536:0:196588:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572370.075538:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572370.075541:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572370.075542:0:196588:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572370.075545:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572370.075551:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572370.075553:0:196588:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788572370.075561:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788572370.075628:0:196588:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788572370.075652:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572370.075656:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572370.075657:0:196588:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788572370.075660:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572370.075664:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572370.075665:0:196588:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788572370.075668:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572370.075674:0:196588:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:00000080:3.0:1788572370.075712:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572370.075729:0:196588:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e5a109f99c0) 00000020:00000080:3.0:1788572370.075751:0:196588:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788572370.075757:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572370.075815:0:196588:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788572370.075821:0:196588:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788572370.075827:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109be075 00010000:00080000:3.0:1788572370.075858:0:196588:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e59059d0800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:0.0:1788572370.082666:0:196588:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788572370.101596:0:196588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572370.101611:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788572370.101659:0:196588:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788572370.101692:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109be07c 00000100:00080000:2.0:1788572370.101703:0:196588:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788572370.101709:0:196588:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e59059d0800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572370.101745:0:196588:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729e680 x1875444584365312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572370.101770:0:196588:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788572370.101805:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584365312:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788572370.101848:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572370.101854:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572370.101856:0:196588:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788572370.101859:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788572370.101862:0:196588:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788572370.101863:0:196588:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572370.101865:0:196588:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572370.101867:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788572370.101870:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572370.101872:0:196588:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788572370.101874:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788572370.101880:0:196588:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788572370.101884:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572370.101885:0:196588:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788572370.101890:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000100:00100000:1.0:1788572370.101894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788572370.101898:0:196588:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:2.0:1788572370.101922:0:196588:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788572370.101925:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788572370.101939:0:196588:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e590415cd40) 00000020:00000080:2.0:1788572370.101956:0:196588:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788572370.101960:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788572370.101966:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584365312 00000100:00100000:1.0:1788572370.101975:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584365312 00000100:00100000:1.0:1788572370.102006:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1788572370.102014:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584365312:12345-0@lo:38:llog_process_th.0 00000004:00080000:2.0:1788572370.102025:0:196588:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788572370.102035:0:196588:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00010000:00080000:1.0:1788572370.102041:0:188054:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9123 last 0 00000020:00000080:1.0:1788572370.102073:0:188054:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109be091 00000004:00100000:1.0:1788572370.102087:0:188054:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:2.0:1788572370.102108:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109be08a 00010000:00080000:2.0:1788572370.102142:0:196588:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a0efd4800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.157@tcp at head 00000100:00080000:1.0:1788572370.102182:0:188054:0:(import.c:65:import_set_state_nolock()) ffff8e5a3191f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572370.102231:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584365312:12345-0@lo:38:llog_process_th.0 Request processed in 216us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.102239:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1788572370.102276:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572370.102284:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 5 00000100:00080000:1.0:1788572370.102292:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788572370.102296:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788572370.102299:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572370.102306:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584365312:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1788572370.102404:0:196588:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:3.0:1788572370.102845:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572370.102850:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572370.102853:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572370.102858:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9122 00000100:00080000:3.0:1788572370.102863:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572370.102867:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572370.102880:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905166d80 x1875444584365696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572370.102912:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572370.102916:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572370.102918:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572370.102921:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9122 00000100:00080000:3.0:1788572370.102924:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572370.102928:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572370.102938:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905167480 x1875444584365952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572370.102959:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572370.102962:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572370.102963:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572370.102966:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9122 00000100:00080000:3.0:1788572370.102969:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572370.102973:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572370.102985:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905166300 x1875444584366336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572370.102994:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572370.102997:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572370.102998:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572370.103001:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9122 00000100:00080000:3.0:1788572370.103004:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572370.103008:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572370.103016:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905167800 x1875444584366464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572370.103064:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584365824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572370.103102:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.103148:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572370.103154:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584366080:0@lo:400:kworker.0 00000100:00100000:0.0:1788572370.103195:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584365824 00000100:00100000:3.0:1788572370.103196:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572370.103203:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584365824 00000100:00100000:3.0:1788572370.103246:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584366080 00000100:00100000:3.0:1788572370.103250:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584366080 00000100:00100000:0.0:1788572370.103257:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788572370.103268:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584365824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572370.103283:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7748 00000100:00100000:3.0:1788572370.103292:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584366080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572370.103330:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584365824:12345-0@lo:400:kworker.0 Request processed in 64us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572370.103338:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788572370.103344:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584366080:12345-0@lo:400:kworker.0 Request processed in 52us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.103352:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7748 00000100:00100000:3.0:1788572370.103388:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584366080:0@lo:400:kworker.0 00000100:00100000:3.0:1788572370.103399:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584365824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572370.103419:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584365696:0@lo:38:kworker.0 00000100:00100000:3.0:1788572370.103442:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.103465:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584365952:0@lo:38:kworker.0 00000100:00100000:0.0:1788572370.103472:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584365696 00000100:00100000:0.0:1788572370.103499:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584365696 00000100:00100000:3.0:1788572370.103510:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572370.103526:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1788572370.103533:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584365696:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788572370.103535:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584366336:0@lo:38:kworker.0 00000100:00100000:3.0:1788572370.103560:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.103583:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584366464:0@lo:38:kworker.0 00000100:00100000:0.0:1788572370.103590:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584365696:12345-0@lo:38:kworker.0 Request processed in 55us (145us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572370.103599:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1788572370.103611:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572370.103612:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584366336 00000100:00100000:0.0:1788572370.103618:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584366336 00000100:00100000:0.0:1788572370.103633:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584366464 00000100:00100000:0.0:1788572370.103636:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584366464 00000100:00080000:3.0:1788572370.103638:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572370.103644:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572370.103651:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1788572370.103651:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584365696:0@lo:38:kworker.0 00000100:00100000:0.0:1788572370.103662:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584366336:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788572370.103695:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1788572370.103702:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584366464:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572370.103716:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584366336:12345-0@lo:38:kworker.0 Request processed in 54us (153us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572370.103723:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1788572370.103745:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584366464:12345-0@lo:38:kworker.0 Request processed in 41us (135us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788572370.103753:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1788572370.103776:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584365952 00000100:00100000:3.0:1788572370.103779:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584365952 00000100:00100000:3.0:1788572370.103806:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1788572370.103810:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584365952:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788572370.103842:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584365952:12345-0@lo:38:kworker.0 Request processed in 30us (332us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788572370.103848:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00080000:3.0:1788572370.103875:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572370.103880:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572370.103883:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584365952:0@lo:38:kworker.0 00000100:00080000:3.0:1788572370.103892:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572370.103895:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572370.103899:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584366336:0@lo:38:kworker.0 00000100:00100000:1.0:1788572370.103904:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584365440:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788572370.103909:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572370.103913:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572370.103918:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584366464:0@lo:38:kworker.0 00000100:00100000:1.0:1788572370.103938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572370.103964:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584366208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572370.103987:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572370.104012:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572370.104018:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584365568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572370.104044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572370.104070:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584366592:0@lo:400:kworker.0 00000100:00100000:1.0:1788572370.104091:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572370.104129:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584366592 00000100:00100000:1.0:1788572370.104133:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584366592 00000100:00100000:1.0:1788572370.104156:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788572370.104163:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584366592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572370.104200:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584366592:12345-0@lo:400:kworker.0 Request processed in 37us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.104206:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788572370.104225:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584365568 00000100:00100000:1.0:1788572370.104229:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584365568 00000100:00100000:1.0:1788572370.104267:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788572370.104274:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3641:x1875444584365568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572370.104303:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:3641:x1875444584365568:12345-0@lo:400:kworker.0 Request processed in 31us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.104309:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788572370.104344:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584365440 00000100:00100000:1.0:1788572370.104348:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584365440 00000100:00100000:1.0:1788572370.104368:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1788572370.104560:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584365440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572370.104589:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:1.0:1788572370.104622:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584365440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.104628:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1788572370.104652:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584365568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572370.104664:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584366592:0@lo:400:kworker.0 00000100:00100000:1.0:1788572370.104677:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584365440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572370.107245:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584366208 00000100:00100000:3.0:1788572370.107261:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584366208 00000100:00100000:3.0:1788572370.107331:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7749 00000100:00100000:3.0:1788572370.107343:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584366208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572370.107453:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584366208:12345-0@lo:400:kworker.0 Request processed in 112us (3465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.107461:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7749 00000040:01000000:3.0:1788572370.107591:0:196588:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788572370.107624:0:196588:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788572370.107720:0:196588:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 79, last_idx 80 00000100:00100000:1.0:1788572370.107847:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584366208:0@lo:400:kworker.0 00000040:00080000:0.0:1788572370.110303:0:196588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572370.110340:0:196588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].81, 64 off13376 00000040:00080000:0.0:1788572370.110536:0:196588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x144:0x0].1, 64 off8256 00000040:00080000:0.0:1788572370.111573:0:196594:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 81 synced_idx: 0 lgh_last_idx: 81 00000040:00080000:0.0:1788572370.111579:0:196594:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x140:0x0] at index 80 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788572370.114032:0:196588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572370.114049:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788572370.114095:0:196588:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788572370.114120:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109be098 00000100:00080000:1.0:1788572370.114135:0:196588:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788572370.114142:0:196588:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5a0efd4800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572370.114179:0:196588:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a407e0e00 x1875444584366720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572370.114213:0:196588:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788572370.114289:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572370.114294:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572370.114296:0:196588:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788572370.114299:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788572370.114302:0:196588:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788572370.114304:0:196588:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572370.114306:0:196588:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572370.114308:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788572370.114311:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572370.114313:0:196588:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788572370.114316:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788572370.114321:0:196588:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000100:00100000:3.0:1788572370.114324:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584366720:0@lo:8:llog_process_th.0 00000020:00000080:1.0:1788572370.114326:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572370.114329:0:196588:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788572370.114335:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788572370.114340:0:196588:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:1.0:1788572370.114366:0:196588:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788572370.114370:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1788572370.114407:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788572370.114541:0:196588:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e5a372019c0) 00000100:00100000:2.0:1788572370.114542:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584366720 00000100:00100000:2.0:1788572370.114551:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584366720 00000020:00000080:1.0:1788572370.114559:0:196588:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type osp with refcount 2 00000020:00000080:1.0:1788572370.114567:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788572370.114592:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22658 00000100:00100000:2.0:1788572370.114600:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3640:x1875444584366720:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788572370.114627:0:43926:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9123 last 0 00000004:00080000:1.0:1788572370.114632:0:196588:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788572370.114640:0:196588:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788572370.114647:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109be0ad 00000020:00000080:2.0:1788572370.114652:0:43926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109be0a6 00002000:00100000:2.0:1788572370.114666:0:43926:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e5a0efd2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788572370.114671:0:43926:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788572370.114674:0:43926:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1788572370.114677:0:196588:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e59051d8800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.157@tcp at head 00002000:00080000:2.0:1788572370.114766:0:43926:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788572370.114791:0:43926:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572370.114846:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584366720:12345-0@lo:8:llog_process_th.0 Request processed in 245us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572370.114856:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22658 00010000:00010000:1.0:1788572370.115144:0:196588:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:3.0:1788572370.115146:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572370.115156:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:3.0:1788572370.115173:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788572370.115178:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788572370.115181:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788572370.115202:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788572370.115208:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584366720:0@lo:8:llog_process_th.0 00000040:01000000:1.0:1788572370.115214:0:196588:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788572370.115232:0:196588:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788572370.115305:0:196594:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x140:0x0] index 3 count 2 00000040:00080000:0.0:1788572370.115330:0:196594:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 81 synced_idx: 81 lgh_last_idx: 81 00000040:00080000:0.0:1788572370.115335:0:196594:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x144:0x0] at index 81 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1788572370.115351:0:196594:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788572370.115405:0:196594:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 9123109924701ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788572370.115412:0:196594:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788572370.115414:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584366976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572370.115449:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.115517:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572370.115524:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584366848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572370.115547:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.115578:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584366848 00000100:00100000:3.0:1788572370.115583:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584366848 00000100:00100000:3.0:1788572370.115621:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6339 00000100:00100000:3.0:1788572370.115628:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584366848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572370.115648:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572370.115696:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584366848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.115703:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6339 00000100:00080000:3.0:1788572370.115722:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572370.115746:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584366848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572370.116075:0:177561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584366976 00000100:00100000:0.0:1788572370.116080:0:177561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584366976 00000100:00100000:0.0:1788572370.116104:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22659 00000100:00100000:0.0:1788572370.116110:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584366976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572370.116154:0:177561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6690 count 1 00000100:00100000:0.0:1788572370.116239:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584366976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 128us (789us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572370.116246:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22659 00000004:00080000:3.0:1788572370.116279:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5905a9ce00, transno 0 00000004:00080000:3.0:1788572370.116284:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905a9ce00/1, rc -2, transno 0 00000100:00100000:3.0:1788572370.116301:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584366976:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1788572370.116446:0:196588:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 79, last_idx 80 00000040:00080000:0.0:1788572370.116979:0:196594:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 80, last_idx 81 00000040:00080000:0.0:1788572370.116999:0:196594:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x140:0x0] at index 80 of catalog [0x1:0x2:0x0] 00000004:00080000:2.0:1788572370.123412:0:196576:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1788572370.127322:0:196588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572370.127357:0:196588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].81, 64 off13376 00000040:00080000:1.0:1788572370.127559:0:196588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x146:0x0].1, 64 off8256 00000040:00080000:1.0:1788572370.128710:0:196596:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 81 synced_idx: 0 lgh_last_idx: 81 00000040:00080000:1.0:1788572370.128718:0:196596:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x142:0x0] at index 80 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788572370.128903:0:196596:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 80, last_idx 81 00000040:00080000:1.0:1788572370.128921:0:196596:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x142:0x0] at index 80 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788572370.129038:0:196596:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 81 synced_idx: 81 lgh_last_idx: 81 00000040:00080000:1.0:1788572370.129042:0:196596:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x146:0x0] at index 81 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788572370.131430:0:196588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572370.131445:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788572370.131522:0:196588:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788572370.131551:0:196588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109be0b4 00000100:00080000:0.0:1788572370.131563:0:196588:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572370.131569:0:196588:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e59051d8800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572370.131607:0:196588:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905a9ce00 x1875444584367104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572370.131638:0:196588:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788572370.131818:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584367104:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1788572370.131832:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572370.131837:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572370.131838:0:196588:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788572370.131841:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572370.131846:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572370.131847:0:196588:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788572370.131850:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788572370.131852:0:196588:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788572370.131854:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572370.131856:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572370.131857:0:196588:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788572370.131859:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572370.131861:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572370.131862:0:196588:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788572370.131865:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788572370.131898:0:196588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196588:1875444584367232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572370.131909:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572370.131974:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584367104 00000100:00100000:1.0:1788572370.131982:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584367104 00000100:00100000:1.0:1788572370.132021:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22660 00000100:00100000:1.0:1788572370.132028:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3640:x1875444584367104:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788572370.132066:0:43918:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9123 last 0 00000020:00000080:1.0:1788572370.132095:0:43918:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109be0bb 00000100:00100000:2.0:1788572370.143531:0:196588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572370.143613:0:196588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0459a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572370.147005:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584367232 00000100:00100000:0.0:1788572370.147022:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584367232 00000100:00100000:0.0:1788572370.147100:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788572370.147111:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:196588:x1875444584367232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572370.147303:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:196588:x1875444584367232:12345-0@lo:502:llog_process_th.0 Request processed in 193us (3792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572370.147313:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788572370.147538:0:196588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196588:1875444584367232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572370.147573:0:196588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572370.147580:0:196588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572370.147582:0:196588:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788572370.147587:0:196588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788572370.147948:0:196575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788572370.147974:0:196575:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788572370.147998:0:196575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572370.148010:0:196575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572370.148019:0:196575:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a0f05c800 from 1 10000000:01000000:0.0:1788572370.148022:0:196575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788572370.148056:0:196575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572370.148065:0:196575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572370.148075:0:196575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572370.148096:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584367360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572370.148138:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572370.148169:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a245173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572370.148259:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584367360 00000100:00100000:3.0:1788572370.148264:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584367360 00000100:00100000:3.0:1788572370.148301:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572370.148310:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:196575:x1875444584367360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572370.148320:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572370.148335:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be0c2 expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.148356:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be0c2 expref: 9 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.148367:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be0c2 expref: 9 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.148381:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670e00, rc 0) 00000100:00100000:3.0:1788572370.148431:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:196575:x1875444584367360:12345-0@lo:101:mount.lustre.0 Request processed in 122us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.148438:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572370.148476:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584367360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572370.148521:0:196575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.148531:0:196575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1788572370.151767:0:43918:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e59051de800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788572370.151781:0:43918:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788572370.151784:0:43918:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788572370.151888:0:43918:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788572370.151931:0:43918:0:(import.c:65:import_set_state_nolock()) ffff8e59051df800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572370.152048:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584367104:12345-0@lo:8:llog_process_th.0 Request processed in 20016us (20135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572370.152153:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788572370.152164:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788572370.152173:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788572370.152179:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788572370.152182:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59051d8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788572370.152204:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788572370.152210:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584367104:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788572370.152653:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22660 00000004:00080000:1.0:1788572370.152681:0:196596:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788572370.152711:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584367488:0@lo:256:mount.lustre.0 00000004:00080000:1.0:1788572370.152750:0:196596:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 9123147269314ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788572370.152756:0:196596:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788572370.153014:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584367616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572370.157358:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572370.157771:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584367616 00000100:00100000:0.0:1788572370.157780:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584367616 00000100:00100000:0.0:1788572370.157973:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6340 00000100:00100000:0.0:1788572370.157984:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584367616:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572370.158011:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788572370.158019:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141248 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572370.158089:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584367616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572370.158098:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6340 00000100:00100000:2.0:1788572370.158139:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584367616:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788572370.158642:0:196576:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788572370.159902:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.160015:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dde300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572370.166242:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584367488 00000100:00100000:0.0:1788572370.166260:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584367488 00000100:00100000:1.0:1788572370.166395:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788572370.166407:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:196575:x1875444584367488:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788572370.166434:0:196583:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788572370.166464:0:196583:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788572370.166468:0:196583:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788572370.166471:0:196583:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788572370.166474:0:196583:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 338 00000100:00100000:1.0:1788572370.166673:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:196575:x1875444584367488:12345-0@lo:256:mount.lustre.0 Request processed in 267us (6775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.166692:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788572370.167002:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584367488:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788572370.167858:0:196575:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572370.167882:0:196575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.167895:0:196575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572370.167903:0:196575:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a0f05c800 from 1 10000000:01000000:3.0:1788572370.167906:0:196575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572370.167941:0:196575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.167953:0:196575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.167963:0:196575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572370.167983:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584367744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572370.168030:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.168079:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dde300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572370.169922:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584367744 00000100:00100000:0.0:1788572370.169938:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584367744 00000100:00100000:0.0:1788572370.170006:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788572370.170016:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bf45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:196575:x1875444584367744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572370.170031:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572370.170049:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe0600/0x265cfe11109be0d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be0d0 expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572370.170077:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe0600/0x265cfe11109be0d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be0d0 expref: 10 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572370.170089:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe0600/0x265cfe11109be0d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be0d0 expref: 10 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572370.170099:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0600, rc 0) 00000100:00100000:0.0:1788572370.170176:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bf45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196575:x1875444584367744:12345-0@lo:101:mount.lustre.0 Request processed in 161us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572370.170183:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788572370.171939:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584367744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572370.171968:0:196575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.171982:0:196575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572370.172074:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584367872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572370.172130:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.172190:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dde300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572370.172280:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584367872 00000100:00100000:2.0:1788572370.172286:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584367872 00000100:00100000:2.0:1788572370.172398:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788572370.172409:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196575:x1875444584367872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572370.172575:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196575:x1875444584367872:12345-0@lo:501:mount.lustre.0 Request processed in 168us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572370.172583:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788572370.172899:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584367872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572370.172933:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584368000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572370.172981:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.178051:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dde300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572370.183187:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584368000 00000100:00100000:1.0:1788572370.183204:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584368000 00000100:00100000:1.0:1788572370.183282:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788572370.183293:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196575:x1875444584368000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572370.183814:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196575:x1875444584368000:12345-0@lo:503:mount.lustre.0 Request processed in 521us (10830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.183822:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788572370.183947:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584368000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572370.186591:0:196598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196598:1875444584368128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572370.186693:0:196598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572370.186734:0:196598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572370.186737:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584368128 00000100:00100000:0.0:1788572370.186744:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584368128 00000100:00100000:1.0:1788572370.187110:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788572370.187122:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196598:x1875444584368128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572370.189436:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196598:x1875444584368128:12345-0@lo:502:llog_process_th.0 Request processed in 2303us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.189455:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788572370.189671:0:196598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196598:1875444584368128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788572370.189726:0:196598:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572370.189859:0:196598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572370.189862:0:196598:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788572370.189871:0:196598:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a0f05c800 00000020:00000080:0.0:1788572370.189874:0:196598:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788572370.189883:0:196598:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572370.189886:0:196598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572370.189887:0:196598:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788572370.189890:0:196598:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572370.189892:0:196598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572370.189894:0:196598:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788572370.189897:0:196598:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a0f05c800 00000020:00000080:0.0:1788572370.189899:0:196598:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788572370.190060:0:196598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196598:1875444584368256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572370.190119:0:196598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572370.196205:0:196598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f1ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572370.199355:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584368256 00000100:00100000:3.0:1788572370.199384:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584368256 00000100:00100000:3.0:1788572370.199462:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788572370.199473:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196598:x1875444584368256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572370.199699:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196598:x1875444584368256:12345-0@lo:502:llog_process_th.0 Request processed in 214us (9566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.199707:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788572370.199815:0:196598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196598:1875444584368256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572370.199864:0:196598:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572370.201120:0:196598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572370.201127:0:196598:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788572370.201144:0:196598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788572370.201235:0:196575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788572370.201340:0:196575:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572370.201357:0:196575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.201368:0:196575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572370.201520:0:196575:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788572370.201524:0:196575:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5a0f05c800 10000000:01000000:3.0:1788572370.201527:0:196575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5a0f05c800 10000000:01000000:3.0:1788572370.201531:0:196575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788572370.201538:0:196575:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a0f05c800 from 1 10000000:01000000:3.0:1788572370.201541:0:196575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572370.201578:0:196575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.201587:0:196575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.201598:0:196575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572370.201625:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584368384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572370.201705:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.201752:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572370.201774:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584368384 00000100:00100000:3.0:1788572370.201781:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584368384 00000100:00100000:3.0:1788572370.201818:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788572370.201828:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:196575:x1875444584368384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572370.201841:0:196582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572370.201855:0:196582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01671800/0x265cfe11109be0e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be0de expref: -99 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.204061:0:196582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01671800/0x265cfe11109be0e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be0de expref: 11 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.204086:0:196582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01671800/0x265cfe11109be0e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be0de expref: 11 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.204096:0:196582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671800, rc 0) 00000100:00100000:3.0:1788572370.204201:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196575:x1875444584368384:12345-0@lo:101:mount.lustre.0 Request processed in 2373us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.204209:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788572370.205104:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584368384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572370.205135:0:196575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.205150:0:196575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572370.205235:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584368512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572370.206818:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572370.207746:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584368512 00000100:00100000:0.0:1788572370.207756:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584368512 00000100:00100000:0.0:1788572370.207931:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788572370.207943:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196575:x1875444584368512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572370.208107:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196575:x1875444584368512:12345-0@lo:501:mount.lustre.0 Request processed in 166us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572370.208115:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788572370.208337:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572370.208365:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584368512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572370.208520:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584368640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572370.208579:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.208622:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584368640 00000100:00100000:3.0:1788572370.208627:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584368640 00000100:00100000:3.0:1788572370.208656:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788572370.208663:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196575:x1875444584368640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572370.208754:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196575:x1875444584368640:12345-0@lo:503:mount.lustre.0 Request processed in 91us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.208761:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788572370.211356:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572370.211470:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584368640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572370.213604:0:196600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196600:1875444584368768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572370.213695:0:196600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.213747:0:196600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572370.214028:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584368768 00000100:00100000:2.0:1788572370.214035:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584368768 00000100:00100000:2.0:1788572370.214076:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788572370.214085:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196600:x1875444584368768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572370.214220:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196600:x1875444584368768:12345-0@lo:502:llog_process_th.0 Request processed in 135us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572370.214228:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788572370.214620:0:196600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196600:1875444584368768:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788572370.214709:0:196600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788572370.214726:0:196600:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e5a109f8000) 00000020:00000080:3.0:1788572370.214752:0:196600:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788572370.214845:0:196600:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a0f05c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788572370.214850:0:196600:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a0f05c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788572370.214852:0:196600:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a0f05c800 4 00010000:00080000:3.0:1788572370.216365:0:196600:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e59019dd000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572370.227190:0:196600:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1788572370.227573:0:196600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788572370.227617:0:196600:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788572370.227631:0:196600:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x265cfe11109be0f3 00000100:00080000:3.0:1788572370.227642:0:196600:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572370.227648:0:196600:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e59019dd000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572370.227699:0:196600:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1f8ffb80 x1875444584368896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572370.227726:0:196600:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788572370.228940:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584368896:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788572370.229024:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.230975:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584368896 00000100:00100000:3.0:1788572370.230996:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584368896 00000100:00100000:3.0:1788572370.231074:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1788572370.231085:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584368896:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572370.231206:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584368896:12345-0@lo:38:llog_process_th.0 Request processed in 121us (2181us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788572370.231214:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1788572370.231274:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572370.231286:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019dd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572370.231291:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572370.231295:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584368896:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572370.233072:0:196600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196600:1875444584369024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572370.233165:0:196600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.233259:0:196600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572370.242762:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584369024 00000100:00100000:0.0:1788572370.242780:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584369024 00000100:00100000:3.0:1788572370.243726:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788572370.243737:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196600:x1875444584369024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572370.244347:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196600:x1875444584369024:12345-0@lo:502:llog_process_th.0 Request processed in 609us (11180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.244356:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788572370.244407:0:196600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196600:1875444584369024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572370.244624:0:196600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196600:1875444584369152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572370.244696:0:196600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572370.244727:0:196600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36b4de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572370.245975:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584369152 00000100:00100000:1.0:1788572370.245991:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584369152 00000100:00100000:1.0:1788572370.246057:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788572370.246066:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196600:x1875444584369152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572370.246224:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196600:x1875444584369152:12345-0@lo:502:llog_process_th.0 Request processed in 159us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.246232:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788572370.246555:0:196600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196600:1875444584369152:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788572370.246589:0:196600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788572370.247002:0:196575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788572370.247026:0:196575:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788572370.247050:0:196575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572370.247062:0:196575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788572370.247121:0:196575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788572370.247124:0:196575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572370.247125:0:196575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572370.247127:0:196575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572370.247129:0:196575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572370.247130:0:196575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572370.247132:0:196575:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572370.247134:0:196575:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572370.247136:0:196575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572370.247137:0:196575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788572370.247143:0:196575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788572370.247145:0:196575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788572370.247147:0:196575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572370.247148:0:196575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572370.247150:0:196575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572370.247151:0:196575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572370.247152:0:196575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572370.247153:0:196575:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572370.247155:0:196575:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572370.247156:0:196575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572370.247158:0:196575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788572370.247180:0:196575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788572370.247198:0:196575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584369280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788572370.247255:0:196575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572370.247305:0:196575:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572370.247333:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584369280 00000100:00100000:1.0:1788572370.247340:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584369280 00000100:00100000:1.0:1788572370.247388:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788572370.247396:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196575:x1875444584369280:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788572370.247419:0:196587:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788572370.247435:0:196587:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788572370.259636:0:196587:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572370.259657:0:196587:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788572370.259972:0:196584:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788572370.259978:0:196584:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788572370.259999:0:196584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.260018:0:196584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be0c2 expref: 11 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.260027:0:196584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.260070:0:196584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109be0c2 expref: 11 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.260083:0:196584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109be0c2 expref: 11 pid: 196587 timeout: 9223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572370.260097:0:196584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584369408:0@lo:104: 00000100:00100000:3.0:1788572370.260159:0:196584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.260210:0:196584:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572370.260233:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584369408 00000100:00100000:3.0:1788572370.260239:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584369408 00000100:00100000:3.0:1788572370.260278:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5397 00000100:00100000:3.0:1788572370.260287:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:196584:x1875444584369408:12345-0@lo:104: 00010000:00010000:3.0:1788572370.260300:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.260345:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572370.260351:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:196584:x1875444584369408:12345-0@lo:104: Request processed in 65us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.260357:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5397 00010000:00010000:3.0:1788572370.262002:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572370.262015:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.262028:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572370.262033:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.262044:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572370.262053:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572370.262058:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572370.262123:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.262129:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572370.262160:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.262174:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be0c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109be0c9 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.262198:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572370.262200:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572370.262202:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572370.262219:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584369536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572370.263023:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.263178:0:196584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584369408:0@lo:104: 00010000:00010000:3.0:1788572370.263205:0:196584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572370.266080:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:196575:x1875444584369280:12345-0@lo:253:mount.lustre.0 Request processed in 18675us (18814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.266095:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788572370.266153:0:196575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:196575:1875444584369280:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572370.266169:0:196575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788572370.266172:0:196575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572370.266174:0:196575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572370.266175:0:196575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572370.266176:0:196575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572370.266177:0:196575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572370.266179:0:196575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572370.266180:0:196575:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572370.266182:0:196575:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572370.266183:0:196575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572370.266184:0:196575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788572370.266200:0:196575:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788572370.271617:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584369536 00000100:00100000:1.0:1788572370.271635:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584369536 00010000:00010000:1.0:1788572370.271679:0:43930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109be0c2 expref: 11 pid: 196587 timeout: 9223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572370.271734:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12903 00000100:00100000:1.0:1788572370.271744:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:3642:x1875444584369536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572370.271760:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572370.271766:0:43930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109be0c2 expref: 11 pid: 196587 timeout: 9223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.271778:0:43930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109be0c2 expref: 11 pid: 196587 timeout: 9223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.271801:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be0c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109be0c2 expref: 11 pid: 196587 timeout: 9223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.271820:0:43930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.271829:0:43930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788572370.271848:0:43930:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026237113s 00010000:00010000:1.0:1788572370.271853:0:43930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.271860:0:43930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.271866:0:43930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.271873:0:43930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.272285:0:43930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572370.272290:0:43930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.272301:0:43930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.282738:0:196584:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572370.282760:0:196584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.287505:0:43930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.287524:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01671200/0x265cfe11109be0fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572370.287545:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572370.287639:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:3642:x1875444584369536:12345-0@lo:103:ldlm_bl.0 Request processed in 15894us (24617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.287649:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12903 00000100:00100000:2.0:1788572370.288046:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584369536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572370.301593:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00000020:00080000:2.0:1788572370.302695:0:196575:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 326417522199 00000040:01000000:1.0:1788572370.309027:0:196575:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788572370.309710:0:196606:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 326417522199 00000020:00080000:2.0:1788572370.309716:0:196606:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522199 00000040:01000000:1.0:1788572370.309818:0:196607:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788572370.309835:0:196575:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788572370.310603:0:196608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196608:1875444584369664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572370.310680:0:196608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.310735:0:196608:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788572370.311014:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584369664 00000100:00100000:1.0:1788572370.311023:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584369664 00000100:00100000:1.0:1788572370.311080:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1788572370.311090:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:196608:x1875444584369664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788572370.311175:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:196608:x1875444584369664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 85us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572370.311183:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000040:01000000:0.0:1788572370.311385:0:196575:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788572370.311426:0:196575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788572370.312149:0:196575:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:3.0:1788572370.312290:0:196608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196608:1875444584369664:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788572370.312330:0:196575:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:01000000:3.0:1788572370.312333:0:196608:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788572370.312369:0:196608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196608:1875444584369792:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788572370.312396:0:196575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788572370.312418:0:196608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.312458:0:196608:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572370.312641:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584369792 00000100:00100000:0.0:1788572370.312647:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584369792 00000100:00100000:0.0:1788572370.312700:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1788572370.312708:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:196608:x1875444584369792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572370.312984:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:196608:x1875444584369792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 276us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572370.312991:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1788572370.313730:0:196608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196608:1875444584369792:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788572370.313759:0:196575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788572370.313817:0:196608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196608:1875444584369920:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572370.313853:0:196608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.313998:0:196608:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572370.314063:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584369920 00000100:00100000:0.0:1788572370.314069:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584369920 00000100:00100000:0.0:1788572370.314106:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1788572370.314114:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:196608:x1875444584369920:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572370.314184:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:196608:x1875444584369920:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 70us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572370.314191:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000040:00080000:1.0:1788572370.314327:0:196575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788572370.314364:0:196575:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788572370.314466:0:196575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788572370.314946:0:196575:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x84:0x0] (8/32) registered 00000100:00100000:2.0:1788572370.318198:0:196608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196608:1875444584369920:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788572370.318332:0:196608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196608:1875444584370048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788572370.318440:0:196608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572370.318475:0:196608:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a03a8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572370.318762:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584370048 00000100:00100000:3.0:1788572370.318768:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584370048 00000100:00100000:3.0:1788572370.320156:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1788572370.320171:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:196608:x1875444584370048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788572370.320454:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:196608:x1875444584370048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 287us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.320462:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1788572370.321251:0:196608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196608:1875444584370048:0@lo:1000:lod0000_rec0001.0 00010000:00080000:1.0:1788572370.323876:0:196575:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 343597383687 00000040:00080000:0.0:1788572370.328463:0:196608:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788572370.328594:0:196608:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00010000:00080000:3.0:1788572370.329720:0:196609:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 196609 00010000:02000000:3.0:1788572370.329734:0:196609:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1788572370.329950:0:196575:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788572370.329968:0:196575:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788572370.329991:0:196575:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788572370.330009:0:196575:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000040:00080000:1.0:1788572370.331829:0:196607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788572370.331914:0:196607:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788572370.331919:0:196607:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1788572370.334581:0:196575:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788572370.334912:0:196575:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:3.0:1788572370.363007:0:196609:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788572370.363016:0:196609:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788572370.428633:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572370.816966:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584370176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572370.817023:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.817080:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584370176 00000100:00100000:3.0:1788572370.817086:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584370176 00000100:00100000:3.0:1788572370.817133:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6341 00000100:00100000:3.0:1788572370.817143:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584370176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572370.817170:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141248 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572370.817205:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584370176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.817210:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6341 00000100:00100000:3.0:1788572370.817247:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584370176:0@lo:13:osp-pre-1-1.0 10000000:01000000:1.0:1788572371.004571:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788572371.004580:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a0f05c800 from 339 10000000:01000000:1.0:1788572371.004585:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788572371.004639:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.004651:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.004663:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572371.004688:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.004781:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.004830:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.005148:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584370304 00000100:00100000:2.0:1788572371.005156:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584370304 00000100:00100000:2.0:1788572371.005209:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788572371.005220:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:6515:x1875444584370304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.005235:0:196581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572371.005251:0:196581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be101 expref: -99 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.005281:0:196581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be101 expref: 11 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.005291:0:196581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be101 expref: 11 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.005300:0:196581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5200, rc 0) 00000100:00100000:2.0:1788572371.005341:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584370304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.005348:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788572371.005684:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572371.005718:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.005729:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572371.005784:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.005817:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.005851:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.006093:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584370432 00000100:00100000:3.0:1788572371.006099:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584370432 00000100:00100000:3.0:1788572371.006129:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788572371.006136:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584370432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572371.006152:0:196583:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788572371.006169:0:196583:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572371.006173:0:196583:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 339 00000100:00100000:3.0:1788572371.006280:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584370432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.006289:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788572371.007366:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788572371.007426:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788572371.007434:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.007446:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572371.007456:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788572371.007459:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a0a158000 from 52 10000000:01000000:1.0:1788572371.007462:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788572371.007512:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.007520:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.007528:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572371.007543:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.007579:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.007606:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.008028:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584370560 00000100:00100000:2.0:1788572371.008034:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584370560 00000100:00100000:2.0:1788572371.008076:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572371.008083:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584370560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.008094:0:196581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572371.008107:0:196581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5000/0x265cfe11109be116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be10f expref: -99 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.008128:0:196581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5000/0x265cfe11109be116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be10f expref: 12 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.008138:0:196581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb5000/0x265cfe11109be116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be10f expref: 12 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.008148:0:196581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5000, rc 0) 00000100:00100000:2.0:1788572371.008189:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584370560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.008198:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572371.008823:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.008841:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be116 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.008851:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be116 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572371.009097:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.009136:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.009172:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.009340:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584370688 00000100:00100000:3.0:1788572371.009345:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584370688 00000100:00100000:3.0:1788572371.009383:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788572371.009392:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584370688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.009553:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584370688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.009560:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572371.009867:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.010269:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.010317:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.010350:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.010592:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584370816 00000100:00100000:3.0:1788572371.010598:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584370816 00000100:00100000:3.0:1788572371.010635:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788572371.010644:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584370816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.011073:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584370816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 428us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.011080:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788572371.011309:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572371.012651:0:196630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788572371.014199:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788572371.014243:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788572371.014255:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be116 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.014268:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be116 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572371.014279:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788572371.014282:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788572371.014285:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788572371.014321:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.014329:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.014340:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572371.014366:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.014431:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.014473:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.015586:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584370944 00000100:00100000:3.0:1788572371.015596:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584370944 00000100:00100000:3.0:1788572371.015656:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788572371.015665:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584370944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572371.015680:0:196582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572371.015696:0:196582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01671a00/0x265cfe11109be124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be11d expref: -99 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.015735:0:196582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01671a00/0x265cfe11109be124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be11d expref: 13 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.015747:0:196582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01671a00/0x265cfe11109be124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be11d expref: 13 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.015756:0:196582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671a00, rc 0) 00000100:00100000:3.0:1788572371.015832:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584370944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.015838:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572371.018671:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584370944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.018713:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be124 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.018727:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be124 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572371.018816:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.018876:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.018934:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.019001:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584371072 00000100:00100000:3.0:1788572371.019008:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584371072 00000100:00100000:3.0:1788572371.019060:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788572371.019072:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584371072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.019270:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584371072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.019279:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572371.019615:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.019649:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.019697:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.019734:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.019789:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584371200 00000100:00100000:3.0:1788572371.019794:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584371200 00000100:00100000:3.0:1788572371.019828:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788572371.019836:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584371200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.020687:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584371200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 849us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.020696:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788572371.020792:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572371.021715:0:196631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1788572371.022025:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788572371.022047:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788572371.022058:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be124 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.022069:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be124 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572371.022078:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788572371.022081:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a0a158000 from 7 10000000:01000000:3.0:1788572371.022084:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572371.022119:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.022127:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.022137:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572371.022158:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.022209:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572371.022254:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31da16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.022363:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584371328 00000100:00100000:2.0:1788572371.022369:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584371328 00000100:00100000:2.0:1788572371.022411:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788572371.022419:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584371328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.022431:0:196581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572371.022444:0:196581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5800/0x265cfe11109be132 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be12b expref: -99 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.022467:0:196581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5800/0x265cfe11109be132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be12b expref: 14 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.022502:0:196581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb5800/0x265cfe11109be132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be12b expref: 14 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.022511:0:196581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5800, rc 0) 00000100:00100000:2.0:1788572371.022549:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584371328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.022555:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788572371.022594:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.022607:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be132 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.022615:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be132 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572371.022661:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.022687:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.022713:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.022728:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584371456 00000100:00100000:2.0:1788572371.022731:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584371456 00000100:00100000:2.0:1788572371.022754:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788572371.022760:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584371456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.022867:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584371456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.022874:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788572371.024174:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.024222:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.024378:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.024419:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.024468:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584371584 00000100:00100000:3.0:1788572371.024474:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584371584 00000100:00100000:3.0:1788572371.024537:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788572371.024547:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3fbad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584371584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.024664:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3fbad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584371584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.024671:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788572371.024766:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572371.025880:0:196632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788572371.026437:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788572371.026471:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572371.026517:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be132 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.026531:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be132 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572371.026541:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788572371.026544:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a412c6800 from 52 10000000:01000000:0.0:1788572371.026547:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572371.026582:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.026590:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.026600:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572371.026623:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.026676:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572371.026719:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b3189c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.026793:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584371712 00000100:00100000:2.0:1788572371.026799:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584371712 00000100:00100000:2.0:1788572371.026844:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788572371.026853:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584371712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.026865:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572371.026878:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be139 expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.027007:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be139 expref: 15 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.027020:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be139 expref: 15 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.027036:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5600, rc 0) 00000100:00100000:2.0:1788572371.027083:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584371712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.027090:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788572371.027163:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572371.027179:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.027188:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572371.027239:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.027277:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572371.027299:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b3189c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.027394:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584371840 00000100:00100000:2.0:1788572371.027399:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584371840 00000100:00100000:2.0:1788572371.027433:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788572371.027440:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584371840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.027609:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584371840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.027616:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788572371.027796:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.027825:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.027871:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572371.027905:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b3189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572371.027919:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584371968 00000100:00100000:0.0:1788572371.027923:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584371968 00000100:00100000:0.0:1788572371.027948:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788572371.027955:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584371968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.028034:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584371968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572371.028042:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788572371.028080:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584371968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572371.030566:0:196633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788572371.030790:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788572371.030815:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572371.030827:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.030841:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572371.030852:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788572371.030855:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a412c6800 from 336 10000000:01000000:0.0:1788572371.030859:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788572371.030967:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.030977:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.030990:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572371.031016:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.031079:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572371.031127:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b3189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.033121:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584372096 00000100:00100000:3.0:1788572371.033136:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584372096 00000100:00100000:3.0:1788572371.033194:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788572371.033203:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584372096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572371.033220:0:196581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572371.033239:0:196581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01671c00/0x265cfe11109be14e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be147 expref: -99 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.033279:0:196581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01671c00/0x265cfe11109be14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be147 expref: 16 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.033290:0:196581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01671c00/0x265cfe11109be14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be147 expref: 16 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.033300:0:196581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01671c00, rc 0) 00000100:00100000:3.0:1788572371.033387:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584372096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.033394:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788572371.033454:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572371.033473:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.033502:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572371.033564:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.033603:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572371.033635:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590651f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.033649:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584372224 00000100:00100000:3.0:1788572371.033653:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584372224 00000100:00100000:3.0:1788572371.033675:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788572371.033682:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584372224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572371.033697:0:196582:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788572371.033725:0:196582:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572371.033729:0:196582:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788572371.033732:0:196582:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788572371.033734:0:196582:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788572371.033736:0:196582:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 339 00000100:00100000:3.0:1788572371.033816:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584372224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.033824:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788572371.033851:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788572371.034059:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572371.034067:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.034082:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572371.034091:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788572371.034094:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1788572371.034097:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788572371.034116:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.034124:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.034132:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572371.034145:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.034170:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572371.034188:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f282840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.034201:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584372352 00000100:00100000:3.0:1788572371.034205:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584372352 00000100:00100000:3.0:1788572371.034227:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788572371.034233:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584372352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572371.034240:0:196583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572371.034250:0:196583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be15c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be155 expref: -99 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.035018:0:196583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be155 expref: 17 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.035036:0:196583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be155 expref: 17 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.035046:0:196583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670e00, rc 0) 00000100:00100000:3.0:1788572371.035146:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584372352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 912us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.035154:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788572371.039393:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572371.039432:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.039448:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572371.039680:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.039760:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.039811:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.040355:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584372480 00000100:00100000:2.0:1788572371.040364:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584372480 00000100:00100000:2.0:1788572371.040453:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788572371.040465:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584372480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.040657:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584372480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.040665:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788572371.041938:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.041996:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.042058:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.042416:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.042503:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584372608 00000100:00100000:3.0:1788572371.042510:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584372608 00000100:00100000:3.0:1788572371.042559:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788572371.042568:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584372608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.044766:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584372608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2192us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572371.044780:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788572371.044851:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572371.050730:0:196636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1788572371.050809:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1788572371.050832:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788572371.050845:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.050857:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572371.050868:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788572371.050872:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a412c6800 from 1 10000000:01000000:0.0:1788572371.050875:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788572371.054132:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.054153:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.054166:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572371.054194:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.054262:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572371.054316:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.054510:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584372736 00000100:00100000:2.0:1788572371.054518:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584372736 00000100:00100000:2.0:1788572371.054568:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788572371.054579:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584372736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.054593:0:196581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572371.054607:0:196581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109be16a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be163 expref: -99 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.054636:0:196581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109be16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be163 expref: 18 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.054647:0:196581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109be16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be163 expref: 18 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.054657:0:196581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb5a00, rc 0) 00000100:00100000:2.0:1788572371.054709:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584372736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.054716:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788572371.054767:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.054782:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.054792:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572371.054810:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788572371.054815:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.054823:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572371.054831:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788572371.054834:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a412c6800 from 7 10000000:01000000:2.0:1788572371.054837:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572371.054853:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.054861:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.054869:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572371.054882:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.054920:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.054935:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.054948:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584372864 00000100:00100000:2.0:1788572371.054951:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584372864 00000100:00100000:2.0:1788572371.054976:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788572371.054983:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584372864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.054990:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572371.054998:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905bb4800/0x265cfe11109be178 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be171 expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.055012:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905bb4800/0x265cfe11109be178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be171 expref: 19 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.055021:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905bb4800/0x265cfe11109be178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be171 expref: 19 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.055028:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4800, rc 0) 00000100:00100000:2.0:1788572371.055056:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584372864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.055062:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788572371.055093:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572371.055103:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.055110:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572371.055163:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.055187:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.055199:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.055210:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584372992 00000100:00100000:2.0:1788572371.055214:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584372992 00000100:00100000:2.0:1788572371.055234:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788572371.055240:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584372992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.055344:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584372992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.055352:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788572371.055382:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584372992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.055407:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.055450:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.055463:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.055475:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584373120 00000100:00100000:2.0:1788572371.055498:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584373120 00000100:00100000:2.0:1788572371.055521:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788572371.055527:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584373120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.055603:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584373120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.055611:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788572371.055649:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572371.058291:0:196637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788572371.058626:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788572371.058675:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572371.058688:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.058711:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572371.058722:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788572371.058725:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e59028fe800 from 52 10000000:01000000:2.0:1788572371.058728:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788572371.058772:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.058780:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572371.058792:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572371.058818:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.058880:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.058936:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572371.059236:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584373248 00000100:00100000:0.0:1788572371.059244:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584373248 00000100:00100000:0.0:1788572371.059298:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572371.059308:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584373248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572371.059322:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572371.059336:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5905fe0000/0x265cfe11109be186 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be17f expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.059360:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5905fe0000/0x265cfe11109be186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be17f expref: 20 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.059371:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5905fe0000/0x265cfe11109be186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be17f expref: 20 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.059380:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0000, rc 0) 00000100:00100000:0.0:1788572371.059434:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584373248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572371.059443:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788572371.059610:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572371.059625:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be186 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.059636:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be186 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572371.059693:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.059735:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.059768:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572371.060573:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584373376 00000100:00100000:2.0:1788572371.060581:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584373376 00000100:00100000:2.0:1788572371.060626:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788572371.060635:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584373376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.060777:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584373376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572371.060785:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788572371.060824:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.060861:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.061015:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.061079:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572371.067371:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584373504 00000100:00100000:1.0:1788572371.067387:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584373504 00000100:00100000:1.0:1788572371.067474:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788572371.067499:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0efe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584373504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.067665:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0efe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584373504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (6649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572371.067674:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788572371.068025:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572371.071414:0:196638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788572371.072349:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788572371.072392:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788572371.072408:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be186 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.072421:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be186 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572371.072430:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788572371.072433:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788572371.072436:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788572371.072604:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.072615:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.072633:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572371.072768:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572371.072839:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572371.072921:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572371.075195:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584373632 00000100:00100000:1.0:1788572371.075212:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584373632 00000100:00100000:1.0:1788572371.075283:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788572371.075294:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0efeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584373632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572371.075310:0:196583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572371.075329:0:196583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1ffcf400/0x265cfe11109be194 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be18d expref: -99 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.075359:0:196583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1ffcf400/0x265cfe11109be194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be18d expref: 21 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.075372:0:196583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1ffcf400/0x265cfe11109be194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be18d expref: 21 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.075382:0:196583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf400, rc 0) 00000100:00100000:1.0:1788572371.075454:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0efeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584373632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572371.075461:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788572371.075532:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572371.075550:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be194 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.075560:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be194 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572371.075635:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.075667:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.075696:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.076157:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584373760 00000100:00100000:3.0:1788572371.076164:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584373760 00000100:00100000:3.0:1788572371.076204:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788572371.076213:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584373760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.076397:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584373760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.076405:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788572371.076983:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.077027:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.077078:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.077097:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572371.077112:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584373888 00000100:00100000:1.0:1788572371.077116:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584373888 00000100:00100000:1.0:1788572371.077143:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788572371.077150:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584373888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.078080:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584373888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 926us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.078340:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584373888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.078455:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000040:00080000:2.0:1788572371.084846:0:196639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1788572371.085440:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1788572371.085467:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788572371.085505:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be194 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.085519:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be194 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572371.085529:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572371.085532:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e59028fe800 from 7 10000000:01000000:1.0:1788572371.085535:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572371.085575:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.085585:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.085596:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572371.085622:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.085689:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.085739:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.085923:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584374016 00000100:00100000:3.0:1788572371.085931:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584374016 00000100:00100000:3.0:1788572371.085989:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788572371.085999:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584374016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572371.086013:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572371.086026:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a01670200/0x265cfe11109be1a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be19b expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.086050:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a01670200/0x265cfe11109be1a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be19b expref: 22 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.086061:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a01670200/0x265cfe11109be1a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be19b expref: 22 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.086071:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670200, rc 0) 00000100:00100000:3.0:1788572371.086151:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584374016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.086160:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788572371.086611:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572371.086626:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.086636:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be1a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572371.086694:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.086737:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.086764:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.086823:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584374144 00000100:00100000:3.0:1788572371.086828:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584374144 00000100:00100000:3.0:1788572371.086862:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788572371.086870:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584374144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.086987:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584374144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.086994:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788572371.087103:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.087130:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.087173:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572371.087199:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049f6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572371.087212:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584374272 00000100:00100000:1.0:1788572371.087216:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584374272 00000100:00100000:1.0:1788572371.087239:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788572371.087246:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584374272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572371.087332:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584374272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572371.087339:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788572371.087382:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572371.107394:0:196641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788572371.110724:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788572371.110763:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572371.110775:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.110787:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572371.110796:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788572371.110799:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e5a0efbb380 from 1 10000000:01000000:0.0:1788572371.110801:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788572371.110840:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.110849:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.110859:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572371.110882:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.111017:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572371.111060:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572371.111112:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584374400 00000100:00100000:1.0:1788572371.111120:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584374400 00000100:00100000:1.0:1788572371.111173:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788572371.111183:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584374400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572371.111198:0:196583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572371.111213:0:196583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1ffcec00/0x265cfe11109be1b0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be1a9 expref: -99 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.111236:0:196583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1ffcec00/0x265cfe11109be1b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be1a9 expref: 23 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.111245:0:196583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1ffcec00/0x265cfe11109be1b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be1a9 expref: 23 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.111253:0:196583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcec00, rc 0) 00000100:00100000:1.0:1788572371.112124:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584374400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 936us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572371.112133:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788572371.112825:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572371.112851:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.112866:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be1b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572371.112971:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788572371.112979:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.112988:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572371.112997:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788572371.112999:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5a0efbb380 from 1 10000000:01000000:0.0:1788572371.113002:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788572371.113035:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.113042:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.113052:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572371.113071:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.113114:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572371.113158:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572371.113208:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584374528 00000100:00100000:1.0:1788572371.113215:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584374528 00000100:00100000:1.0:1788572371.113332:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788572371.113344:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584374528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572371.113356:0:196582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572371.113370:0:196582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1ffcfa00/0x265cfe11109be1be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109be1b7 expref: -99 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.113393:0:196582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1ffcfa00/0x265cfe11109be1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be1b7 expref: 24 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.113403:0:196582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1ffcfa00/0x265cfe11109be1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be1b7 expref: 24 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.113411:0:196582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcfa00, rc 0) 00000100:00100000:1.0:1788572371.113455:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584374528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572371.113462:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788572371.114386:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572371.114404:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.114414:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572371.114510:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572371.114558:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572371.114591:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572371.114652:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584374656 00000100:00100000:3.0:1788572371.114658:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584374656 00000100:00100000:3.0:1788572371.114710:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788572371.114719:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584374656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572371.114812:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584374656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (253us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572371.114821:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788572371.114963:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584374656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788572371.114990:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788572371.114996:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572371.115004:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572371.328915:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:0.0:1788572371.457192:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572371.719519:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572371.722188:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569503616 00000100:00100000:3.0:1788572371.722203:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569503616 00000100:00100000:3.0:1788572371.722270:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 72 00000100:00100000:3.0:1788572371.722286:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569503616:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572371.722305:0:196582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572371.722326:0:196582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3ac expref: -99 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.722357:0:196582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ac expref: 10 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.722373:0:196582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ac expref: 10 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572371.722382:0:196582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616ea00, rc 0) 00000100:00100000:3.0:1788572371.723694:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569503616:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 1402us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.723706:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 72 00000100:00100000:0.0:1788572371.735666:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572371.742137:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569503744 00000100:00100000:3.0:1788572371.742160:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569503744 00000100:00100000:3.0:1788572371.742230:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 73 00000100:00100000:3.0:1788572371.742241:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569503744:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572371.742268:0:196581:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788572371.742302:0:196581:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572371.742306:0:196581:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788572371.742309:0:196581:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788572371.742312:0:196581:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788572371.742315:0:196581:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 339 00000100:00100000:3.0:1788572371.745079:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569503744:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 Request processed in 2828us (9416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572371.745094:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 73 00000100:00100000:2.0:1788572371.748226:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572371.748326:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569503872 00000100:00100000:0.0:1788572371.748337:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569503872 00000100:00100000:0.0:1788572371.748388:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1092 00000100:00100000:0.0:1788572371.748397:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569503872:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1788572371.748445:0:196070:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '02515dca-bbf0-45e0-bd6e-e76f0c89bd0b' at ffff8e5a0f02a000, cookie 0x265cfe11109be04b 00010000:00080000:0.0:1788572371.748451:0:196070:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp recovering/t343597383686 exp ffff8e5a0f02a000 cur 9124 last 1788572370 00010000:02000400:0.0:1788572371.748463:0:196070:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788572371.763581:0:196070:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788572371.766662:0:196070:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788572371.766868:0:196070:0:(import.c:65:import_set_state_nolock()) ffff8e5a109d5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572371.767197:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569503872:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 Request processed in 18796us (18981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572371.767209:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1092 00000100:00100000:0.0:1788572371.769861:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572371.770019:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569496064 00000100:00100000:3.0:1788572371.770029:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569496064 00000100:00100000:3.0:1788572371.770128:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1093 00000100:00100000:3.0:1788572371.770143:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569496064:12345-192.168.202.57@tcp:101:lfs.0 00010000:00080000:3.0:1788572371.770174:0:188833:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 343597383688, current: 343597383686, replaying 00010000:00010000:3.0:1788572371.770186:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572371.770218:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f000/0x265cfe11109be1cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb37b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572371.774397:0:188833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4121us 00000004:00200000:1.0:1788572371.788164:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00000004:00080000:1.0:1788572371.788194:0:188833:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200027501:0x2:0x0], cookie = 0x265cfe11109bdf33 00000004:00080000:1.0:1788572371.788197:0:188833:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x265cfe11109bdf33 in new mfd 00010000:00010000:1.0:1788572371.788337:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f000/0x265cfe11109be1cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb37b expref: 8 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.788356:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a1fbf4100) 00010000:00010000:1.0:1788572371.788361:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572371.788366:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616f000/0x265cfe11109be1cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb37b expref: 8 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572371.788388:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616f000, rc 0) 00000100:00100000:1.0:1788572371.788579:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2396:x1875444569496064:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 18438us (18727us total) trans 343597383686 rc 301/301 00000100:00100000:1.0:1788572371.788589:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1093 00000100:00100000:0.0:1788572371.830025:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572371.830347:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569497344 00000100:00100000:3.0:1788572371.830360:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569497344 00000100:00100000:3.0:1788572371.830444:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1094 00000100:00100000:3.0:1788572371.830457:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2396:x1875444569497344:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00080000:3.0:1788572371.830527:0:188049:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 343597383688, current: 343597383688, replaying 00000100:00100000:3.0:1788572371.830545:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2396:x1875444569497344:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 92us (533us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572371.830553:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1094 00010000:00080000:0.0:1788572371.830751:0:196609:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1788572372.332667:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572372.332711:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572372.333776:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569504000 00000100:00100000:3.0:1788572372.333787:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569504000 00000100:00100000:3.0:1788572372.333842:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 74 00000100:00100000:3.0:1788572372.333852:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569504000:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572372.333923:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569504000:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 72us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572372.333931:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 74 00000100:00100000:0.0:1788572372.336435:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569504128 00000100:00100000:0.0:1788572372.336448:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569504128 00000100:00100000:0.0:1788572372.336537:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 346 00000100:00100000:0.0:1788572372.336548:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569504128:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572372.336626:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569504128:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 80us (3913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572372.336634:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 346 00000100:00100000:0.0:1788572372.348580:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572372.477653:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572372.860916:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584374784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572372.860993:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572372.861252:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584374784 00000100:00100000:1.0:1788572372.861259:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584374784 00000100:00100000:1.0:1788572372.861337:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6342 00000100:00100000:1.0:1788572372.861347:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584374784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572372.861378:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572372.861422:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584374784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572372.861429:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6342 00000100:00080000:3.0:1788572372.861668:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572372.861706:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a407e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584374784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572373.372598:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572373.510700:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572374.396681:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00010000:00010000:3.0:1788572374.524681:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572375.420783:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 0 seconds 00000100:00080000:2.0:1788572375.421399:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572375.421404:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572375.421408:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572375.421421:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572375.421444:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729ca80 x1875444584375040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572375.421470:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572375.421475:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572375.421493:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572375.421565:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572375.421583:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36b92300 x1875444584375296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572375.421618:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572375.421622:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572375.421624:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572375.421629:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a10ffd800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572375.421641:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36aaca80 x1875444584375680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572375.421650:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572375.421654:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572375.421655:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572375.421659:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572375.421668:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36aaf480 x1875444584375808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572375.421696:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788572375.421699:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572375.421701:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e59019dd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572375.421705:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e59019dd000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572375.421715:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36aafb80 x1875444584376448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572375.421818:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584374912:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.421887:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.421926:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584375936:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.421953:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.421979:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788572375.421986:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584375168:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.422007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422025:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584376064:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.422049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422080:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584375040:0@lo:38:kworker.0 00000100:00100000:2.0:1788572375.422104:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422119:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584375296:0@lo:38:kworker.0 00000100:00100000:2.0:1788572375.422139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422154:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584375680:0@lo:38:kworker.0 00000100:00100000:2.0:1788572375.422171:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422184:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584375808:0@lo:38:kworker.0 00000100:00100000:2.0:1788572375.422222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422233:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584376448:0@lo:38:kworker.0 00000100:00100000:2.0:1788572375.422255:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422280:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584375424:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.422305:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422321:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584376192:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.422342:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422360:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572375.422365:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584375552:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.422386:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422401:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584376320:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.422421:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.422450:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584375936 00000100:00100000:2.0:1788572375.422457:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584375936 00000100:00100000:0.0:1788572375.422704:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584374912 00000100:00100000:0.0:1788572375.422709:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584374912 00000100:00100000:0.0:1788572375.422823:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788572375.422834:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584374912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572375.422885:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584374912:12345-0@lo:400:kworker.0 Request processed in 53us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572375.422892:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788572375.422925:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584375168 00000100:00100000:0.0:1788572375.422928:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584375168 00000100:00100000:0.0:1788572375.422945:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584375040 00000100:00100000:0.0:1788572375.422947:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584375040 00000100:00100000:0.0:1788572375.422955:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584375680 00000100:00100000:0.0:1788572375.422958:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584375680 00000100:00100000:0.0:1788572375.422964:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584375808 00000100:00100000:0.0:1788572375.422967:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584375808 00000100:00100000:0.0:1788572375.422974:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584376448 00000100:00100000:0.0:1788572375.422976:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584376448 00000100:00100000:0.0:1788572375.422985:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788572375.422992:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584375168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572375.423026:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584375168:12345-0@lo:400:kworker.0 Request processed in 34us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572375.423032:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788572375.423044:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1788572375.423049:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584375040:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788572375.423072:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9128 last 0 00000020:00000080:0.0:1788572375.423110:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x265cfe11109be1da 00000004:00100000:0.0:1788572375.423124:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788572375.423258:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572375.423298:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875444584375040:12345-0@lo:38:kworker.0 Request processed in 247us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572375.423305:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1788572375.423319:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1788572375.423323:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584375680:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788572375.423337:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9128 last 0 00000020:00000080:0.0:1788572375.423358:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x265cfe11109be1e1 00000004:00100000:0.0:1788572375.423364:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788572375.423379:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a31919000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572375.423406:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875444584375680:12345-0@lo:38:kworker.0 Request processed in 81us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572375.423413:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1788572375.423426:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1788572375.423430:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584375808:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788572375.423445:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9128 last 0 00000020:00000080:0.0:1788572375.423466:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x265cfe11109be1e8 00000004:00100000:0.0:1788572375.423473:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788572375.423831:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584376576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572375.423864:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572375.423912:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584375168:0@lo:400:kworker.0 00000100:00100000:1.0:1788572375.423923:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584374912:0@lo:400:kworker.0 00000100:00100000:3.0:1788572375.424646:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584376064 00000100:00100000:3.0:1788572375.424653:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584376064 00000100:00100000:3.0:1788572375.424682:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584375296 00000100:00100000:3.0:1788572375.424684:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584375296 00000100:00100000:3.0:1788572375.424693:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584376576 00000100:00100000:3.0:1788572375.424695:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584376576 00000100:00100000:3.0:1788572375.424707:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1788572375.424714:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1875444584376064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.425460:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788572375.425475:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584375936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.425623:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584375936:12345-0@lo:400:kworker.0 Request processed in 153us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572375.425630:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788572375.425650:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1788572375.425655:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584376448:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788572375.425679:0:188049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9128 last 0 00000020:00000080:2.0:1788572375.425719:0:188049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x265cfe11109be1ef 00000100:00080000:0.0:1788572375.425867:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a10fc6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572375.425909:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875444584375808:12345-0@lo:38:kworker.0 Request processed in 2477us (3686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572375.425916:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1788572375.425947:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584375424 00000100:00100000:0.0:1788572375.425951:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584375424 00000100:00100000:0.0:1788572375.425983:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584376192 00000100:00100000:0.0:1788572375.425985:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584376192 00000100:00100000:0.0:1788572375.426000:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584375552 00000100:00100000:0.0:1788572375.426003:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584375552 00000100:00100000:0.0:1788572375.426021:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584376320 00000100:00100000:0.0:1788572375.426024:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584376320 00000100:00100000:0.0:1788572375.426042:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7750 00000100:00100000:0.0:1788572375.426048:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584375424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572375.426087:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584375424:12345-0@lo:400:kworker.0 Request processed in 40us (3781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572375.426094:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7750 00000100:00100000:0.0:1788572375.426107:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7751 00000100:00100000:0.0:1788572375.426113:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584376192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572375.426142:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584376192:12345-0@lo:400:kworker.0 Request processed in 30us (3800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572375.426147:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7751 00000100:00100000:0.0:1788572375.426160:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7752 00000100:00100000:0.0:1788572375.426165:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584375552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572375.426194:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584375552:12345-0@lo:400:kworker.0 Request processed in 29us (3807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572375.426200:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7752 00000100:00100000:0.0:1788572375.426211:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7753 00000100:00100000:0.0:1788572375.426217:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584376320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572375.426240:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584376320:12345-0@lo:400:kworker.0 Request processed in 24us (3819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572375.426245:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7753 00000100:00080000:0.0:1788572375.426270:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572375.426273:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788572375.426311:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a3729ca80 x1875444584375040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572375.426326:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 81 00000004:00100000:2.0:1788572375.426839:0:188049:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572375.426868:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572375.426906:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584376448:12345-0@lo:38:kworker.0 Request processed in 1250us (4649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572375.426914:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1788572375.426946:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1788572375.426952:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584375296:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788572375.426972:0:189111:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8e5a0f02d000, cookie 0x265cfe11109be052 00010000:00080000:2.0:1788572375.426977:0:189111:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8e5a0f02d000 cur 9128 last 1788572370 00000004:00100000:2.0:1788572375.426987:0:189111:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572375.427001:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572375.427043:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584375296:12345-0@lo:38:kworker.0 Request processed in 90us (4903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572375.427050:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1788572375.427067:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1788572375.427075:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a407e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1875444584376576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572375.427101:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:2.0:1788572375.427134:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a407e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1875444584376576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (3269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572375.427140:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1788572375.427181:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584375552:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.427196:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584376320:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.427207:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584375424:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.427218:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584376192:0@lo:400:kworker.0 00000100:00100000:2.0:1788572375.427263:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584376576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572375.427277:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584375936:0@lo:400:kworker.0 00000100:00100000:3.0:1788572375.427421:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584376064:12345-0@lo:400:kworker.0 Request processed in 2706us (5370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572375.427430:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00080000:1.0:1788572375.428680:0:196609:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788572375.428689:0:196609:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 343597383688 00000020:00080000:1.0:1788572375.428695:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572375.428699:0:196609:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383688, next_transno: 343597383688 00010000:00080000:1.0:1788572375.428703:0:196609:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (343597383688) 00000020:00080000:1.0:1788572375.428706:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572375.428718:0:196609:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569497344 t343597383688 from 192.168.202.57@tcp req@ffff8e5905a9f100 x1875444569497344/t0(343597383688) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:32/0 lens 528/0 e 0 to 0 dl 1788572382 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572375.429895:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584376064:0@lo:400:kworker.0 00010000:00010000:1.0:1788572375.430619:0:196609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.430641:0:196609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.430659:0:196609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.430672:0:196609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.430680:0:196609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.430687:0:196609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.431105:0:196609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.431114:0:196609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.431121:0:196609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.431127:0:196609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572375.431132:0:196609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.431144:0:196609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.431157:0:196609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a27b10600) 00010000:00010000:1.0:1788572375.431161:0:196609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572375.431165:0:196609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.431171:0:196609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be1f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572375.431189:0:196609:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8a50f22 reply state 00000000424e4217 transno 343597383688 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.431199:0:196609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.431205:0:196609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a27b10b00) 00010000:00010000:1.0:1788572375.431208:0:196609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572375.431211:0:196609:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572375.431312:0:196609:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572375.431333:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572375.431337:0:196609:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 343597383689 00000020:00080000:1.0:1788572375.431341:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572375.431343:0:196609:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 343597383689 00000100:00080000:0.0:1788572375.434004:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8e5a3729ca80 x1875444584375040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572375.434020:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788572375.434025:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788572375.434029:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788572375.434036:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584375040:0@lo:38:kworker.0 00000100:00100000:0.0:1788572375.434074:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383687 gen 2 00000100:00080000:0.0:1788572375.434085:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 81 00000100:00080000:0.0:1788572375.434096:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788572375.434100:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788572375.434102:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383687 gen 2 00000100:00080000:0.0:1788572375.434105:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a1f80e800 from lustre-MDT0000_UUID committed 343597383687 last 0 00000100:00080000:0.0:1788572375.434109:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788572375.437026:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584375296:0@lo:38:kworker.0 00010000:00080000:0.0:1788572375.437068:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36aaca80 x1875444584375680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572375.437086:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 81 00010000:00080000:1.0:1788572375.438015:0:196823:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1788572375.438021:0:196823:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1788572375.438026:0:196823:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:1.0:1788572375.438475:0:196823:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdf4f expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788572375.438516:0:196823:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00010000:00010000:1.0:1788572375.438526:0:196823:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 3/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdf41 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788572375.438535:0:196823:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 2(512) 00000100:00100000:2.0:1788572375.438748:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572375.441893:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569497856 00000100:00100000:1.0:1788572375.441912:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569497856 00000100:00100000:1.0:1788572375.441986:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1099 00000100:00100000:1.0:1788572375.441998:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:2396:x1875444569497856:12345-192.168.202.57@tcp:36:rm.0 00010000:00080000:1.0:1788572375.442019:0:188050:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 343597383689, current: 343597383689, replaying 00000100:00100000:1.0:1788572375.442031:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:2396:x1875444569497856:12345-192.168.202.57@tcp:36:rm.0 Request processed in 37us (3300us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572375.442038:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1099 00000020:00080000:1.0:1788572375.442067:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572375.442071:0:196609:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383689, next_transno: 343597383689 00010000:00080000:1.0:1788572375.442077:0:196609:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (343597383689) 00000020:00080000:1.0:1788572375.442080:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572375.442089:0:196609:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569497856 t343597383689 from 192.168.202.57@tcp req@ffff8e5a411b0380 x1875444569497856/t0(343597383689) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:36/0 lens 512/0 e 0 to 0 dl 1788572386 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572375.442189:0:196609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442207:0:196609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442224:0:196609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442238:0:196609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442246:0:196609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442253:0:196609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442347:0:196609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 3/0,1 mode: --/EX res: [0x200027501:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442355:0:196609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442361:0:196609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442615:0:196609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442623:0:196609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442630:0:196609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442637:0:196609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572375.442642:0:196609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442650:0:196609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442662:0:196609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x3:0x0].0x0 (ffff8e5a36aabb00) 00010000:00010000:1.0:1788572375.442665:0:196609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572375.442669:0:196609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 2/0,0 mode: --/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442676:0:196609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be212 lrc: 0/0,0 mode: --/EX res: [0x200027501:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442695:0:196609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442702:0:196609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442708:0:196609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442713:0:196609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572375.442716:0:196609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.442722:0:196609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788572375.445583:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8e5a36aaca80 x1875444584375680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572375.445599:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788572375.445605:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788572375.445610:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788572375.445616:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584375680:0@lo:38:kworker.0 00010000:00080000:0.0:1788572375.445739:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36aaf480 x1875444584375808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572375.445757:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 81 00000100:00080000:0.0:1788572375.446663:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8e5a36aaf480 x1875444584375808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572375.446674:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788572375.446677:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788572375.446681:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788572375.446686:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584375808:0@lo:38:kworker.0 00010000:00080000:0.0:1788572375.446813:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36aafb80 x1875444584376448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572375.446826:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 81 00000100:00080000:0.0:1788572375.446833:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788572375.446837:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788572375.446840:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019dd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788572375.446845:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584376448:0@lo:38:kworker.0 00000100:00100000:0.0:1788572375.446898:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584376704:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1788572375.447006:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572375.447075:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584376704 00000100:00100000:0.0:1788572375.447082:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584376704 00000100:00100000:0.0:1788572375.447127:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1788572375.447136:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584376704:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788572375.447161:0:189111:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8e5905a9d180 x1875444584376704/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:36/0 lens 328/0 e 0 to 0 dl 1788572386 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572375.447173:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584376704:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 38us (168us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572375.447179:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000001:00080000:0.0:1788572375.447277:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383688 is committed 00000100:00100000:0.0:1788572375.447318:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584376832:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1788572375.447346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.447541:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584376832 00000100:00100000:2.0:1788572375.447546:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584376832 00000100:00100000:2.0:1788572375.447577:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1788572375.447585:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3640:x1875444584376832:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788572375.447594:0:188054:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8e5905a9c700 x1875444584376832/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:36/0 lens 328/0 e 0 to 0 dl 1788572386 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572375.447610:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3640:x1875444584376832:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 27us (264us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572375.447615:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00010000:00010000:1.0:1788572375.449941:0:196609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36aabf00) 00010000:00010000:1.0:1788572375.449950:0:196609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572375.449959:0:196609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.449975:0:196609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be204 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572375.450010:0:196609:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b8beb9b reply state 000000003b6c1806 transno 343597383689 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.450025:0:196609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.450034:0:196609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a27b10b00) 00010000:00010000:1.0:1788572375.450036:0:196609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572375.450039:0:196609:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572375.450108:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.450116:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.450123:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.450129:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572375.450133:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.450142:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.450153:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a27b10b00) 00010000:00010000:1.0:1788572375.450155:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572375.450159:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.450164:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109be1fd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788572375.450273:0:196609:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572375.450399:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572375.450403:0:196609:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383690 00000020:00080000:1.0:1788572375.450407:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572375.450409:0:196609:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383690 00000100:00100000:2.0:1788572375.480566:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572375.481040:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569504256 00000100:00100000:1.0:1788572375.481051:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569504256 00000100:00100000:1.0:1788572375.481111:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 349 00000100:00100000:1.0:1788572375.481121:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2396:x1875444569504256:12345-192.168.202.57@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788572375.481150:0:196070:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e5a411b2680 x1875444569504256/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:36/0 lens 224/0 e 0 to 0 dl 1788572386 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572375.481180:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2396:x1875444569504256:12345-192.168.202.57@tcp:400:ldlm_lock_repla.0 Request processed in 62us (626us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572375.481188:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 349 00000020:00080000:2.0:1788572375.481248:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572375.481253:0:196609:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 343597383690 00010000:00080000:2.0:1788572375.481257:0:196609:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788572375.481260:0:196609:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572375.481268:0:196609:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788572375.481271:0:196609:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788572375.481279:0:196609:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff8e5905a9d180 x1875444584376704/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:36/0 lens 328/0 e 0 to 0 dl 1788572386 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572375.481298:0:196609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572375.481329:0:196609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4000/0x265cfe11109be219 lrc: 2/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdf48 expref: -99 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.481372:0:196609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4000/0x265cfe11109be219 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdf48 expref: 8 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.481388:0:196609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4000/0x265cfe11109be219 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdf48 expref: 8 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.481397:0:196609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4000, rc 0) 00010000:00080000:2.0:1788572375.481464:0:196609:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572375.481495:0:196609:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788572375.481497:0:196609:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788572375.481502:0:196609:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff8e5905a9c700 x1875444584376832/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:36/0 lens 328/0 e 0 to 0 dl 1788572386 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572375.481519:0:196609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572375.481531:0:196609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109be220 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bdf3a expref: -99 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.481545:0:196609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109be220 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 8 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.481555:0:196609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109be220 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 8 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.481563:0:196609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4a00, rc 0) 00010000:00080000:2.0:1788572375.481585:0:196609:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572375.481592:0:196609:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00010000:0.0:1788572375.481819:0:3640:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572375.481831:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584376704:0@lo:101:ldlm_lock_repla.0 00010000:00010000:0.0:1788572375.481845:0:3640:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 3/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788572375.481852:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1788572375.481877:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584376832:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1788572375.481914:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584376960:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1788572375.481952:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.482159:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584376960 00000100:00100000:2.0:1788572375.482164:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584376960 00000100:00100000:2.0:1788572375.482206:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1788572375.482214:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3640:x1875444584376960:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1788572375.482227:0:188054:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e5905a9ea00 x1875444584376960/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:36/0 lens 224/0 e 0 to 0 dl 1788572386 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572375.482251:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3640:x1875444584376960:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 38us (300us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572375.482258:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00010000:00080000:1.0:1788572375.484378:0:196609:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788572375.484526:0:196609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 81, last_transno is 347892350976 00000001:00100000:3.0:1788572375.493707:0:196576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788572375.493719:0:196576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:3.0:1788572375.493824:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383689 is committed 00000001:00080000:1.0:1788572375.493933:0:196609:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788572375.493975:0:196609:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1788572375.493993:0:196609:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.202.57@tcp: req@ffff8e5a411b2680 x1875444569504256/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:36/0 lens 224/0 e 0 to 0 dl 1788572386 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572375.494024:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.494033:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.494045:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.494050:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572375.494055:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.494062:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.494079:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a27b10b00) 00010000:00010000:2.0:1788572375.494082:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572375.494087:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.494094:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce400/0x265cfe11109be20b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196609 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788572375.494102:0:196609:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8e5905a9ea00 x1875444584376960/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:36/0 lens 224/0 e 0 to 0 dl 1788572386 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788572375.495492:0:196609:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1788572375.502511:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788572375.502528:0:3640:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8e5905a9f800 x1875444584376960/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572391 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572375.502539:0:3640:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8e5905a9f800 x1875444584376960/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572391 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572375.502546:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788572375.502558:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1788572375.502564:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b9e60552): req@ffff8e5a31cb9f80 x1875444584348288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 1 dl 1788572345 ref 2 fl Rpc:XQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572375.502580:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000b23d3ac): req@ffff8e5905167b80 x1875444584354176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572358 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572375.502591:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584376960:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1788572375.503082:0:188074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.503121:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d66e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572375.503158:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.503190:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584377088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572375.503214:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.503251:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584348288 00000100:00100000:2.0:1788572375.503258:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584348288 00000100:00100000:2.0:1788572375.503295:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584354176 00000100:00100000:2.0:1788572375.503298:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584354176 00000100:00100000:2.0:1788572375.503307:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584377088 00000100:00100000:2.0:1788572375.503310:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584377088 00000100:00100000:2.0:1788572375.503323:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1788572375.503331:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:188074:x1875444584348288:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572375.503432:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1788572375.503443:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:3643:x1875444584354176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572375.503470:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445654528 avail 1299415040 00000100:00100000:3.0:1788572375.503645:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:3643:x1875444584354176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 204us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572375.503652:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1788572375.503670:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1788572375.503676:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3642:x1875444584377088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572375.503686:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445654528 avail 1299415040 00000100:00100000:3.0:1788572375.503716:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3642:x1875444584377088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572375.503722:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000020:00080000:2.0:1788572375.504602:0:188053:0:(tgt_handler.c:3154:tgt_check_resent()) @@@ reconstruct resent RPC req@ffff8e5a411b3b80 x1875444584348288/t343597383687(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:36/0 lens 1312/4320 e 0 to 0 dl 1788572386 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:2.0:1788572375.504641:0:188053:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a31686208 index 0: rc = 0 00000020:00080000:2.0:1788572375.504649:0:188053:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a31686208 index 1: rc = 0 00000020:00080000:2.0:1788572375.504653:0:188053:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a31686208 index 2: rc = 0 00000020:00080000:2.0:1788572375.504655:0:188053:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a31686208 index 3: rc = 0 00000020:00080000:2.0:1788572375.504657:0:188053:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a31686208 index 4: rc = 0 00000020:00080000:2.0:1788572375.504659:0:188053:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a31686208 index 5: rc = 0 00000020:00080000:2.0:1788572375.504661:0:188053:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a31686208 index 6: rc = 0 00000100:00100000:2.0:1788572375.504710:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188074:x1875444584348288:12345-0@lo:1000:osp_up0-1.0 Request processed in 1378us (1630us total) trans 343597383687 rc 0/0 00000100:00100000:2.0:1788572375.504717:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1788572375.504846:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584354176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572375.504878:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584377088:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1788572375.504982:0:188074:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383687 committed transno 343597383687 00000100:00100000:3.0:1788572375.504999:0:188074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584348288:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788572375.505021:0:188074:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e590639b300 version 2 rpc_version 2 00000020:00100000:3.0:1788572375.505043:0:188074:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572375.505048:0:188074:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1f8ffb80 x1875444584377344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572375.505067:0:188074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584377344:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572375.505099:0:188074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572375.505126:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572375.505141:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584377344 00000100:00100000:3.0:1788572375.505146:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584377344 00000100:00100000:3.0:1788572375.505178:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1788572375.505186:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188074:x1875444584377344:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1788572375.520707:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350977 is committed 00000100:00100000:1.0:1788572375.520974:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188074:x1875444584377344:12345-0@lo:1000:osp_up0-1.0 Request processed in 15783us (15869us total) trans 347892350977 rc 0/0 00000100:00100000:1.0:1788572375.520987:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000004:00080000:3.0:1788572375.521090:0:188074:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350977 committed transno 347892350977 00000100:00100000:3.0:1788572375.521095:0:188074:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350977 gen 2 00000100:00100000:3.0:1788572375.521116:0:188074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584377344:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788572375.521142:0:188074:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e590639b300 version 3 rpc_version 3 00000020:00100000:3.0:1788572375.521173:0:188074:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572375.521181:0:188074:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5905165880 x1875444584377600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572375.521202:0:188074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584377600:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572375.521246:0:188074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572375.521293:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788572375.521354:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584377600 00000100:00100000:1.0:1788572375.521360:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584377600 00000100:00100000:1.0:1788572375.521407:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1788572375.521416:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188074:x1875444584377600:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788572375.526106:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:188074:x1875444584377600:12345-0@lo:1000:osp_up0-1.0 Request processed in 4683us (4851us total) trans 347892350978 rc 0/0 00000100:00100000:1.0:1788572375.526122:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1788572375.534304:0:188074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584377600:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1788572375.536898:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.536921:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.536936:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572375.536954:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fc50b4b reply state 0000000074a18a67 transno 21474837476 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.536966:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.537159:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a03b22d00) 00010000:00010000:1.0:1788572375.537164:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572375.537171:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788572375.537177:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x1:0x0]: returning size 4096 00000004:00080000:1.0:1788572375.537189:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x2:0x0] 00010000:00010000:1.0:1788572375.537200:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.537210:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.537219:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.540187:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788572375.540209:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x2:0x0] 00010000:00010000:1.0:1788572375.540222:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.540235:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788572375.540348:0:188048:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788572375.540369:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161770:x1875444569496448:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 46290840us (46291081us total) trans 21474837476 rc 0/0 00000100:00100000:1.0:1788572375.540379:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1048 00000100:02000400:1.0:1788572375.540405:0:188048:0:(service.c:2915:ptlrpc_watchdog_update()) mdt00_000: service thread pid 188048 completed after 46.290s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources). 00010000:00010000:2.0:1788572375.546677:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572375.546692:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 2/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.546705:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572375.546713:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572375.549846:0:82817:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.549908:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 2/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.549916:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572375.549942:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 1/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.549950:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcf200/0x265cfe11109bdf3a lrc: 0/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109be220 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.549973:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.549975:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.549978:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572375.550014:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584377728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572375.550076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.550137:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584377728 00000100:00100000:2.0:1788572375.550144:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584377728 00000100:00100000:2.0:1788572375.550185:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4660 00000100:00100000:2.0:1788572375.550193:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3643:x1875444584377728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572375.550206:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572375.550222:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4a00/0x265cfe11109be220 lrc: 0/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdf3a expref: 9 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.550236:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e59019b4c00) 00010000:00010000:2.0:1788572375.550247:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572375.550278:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3643:x1875444584377728:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572375.550285:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4660 00000100:00100000:2.0:1788572375.550325:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584377728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572375.550380:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572375.550400:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569504512 00000100:00100000:2.0:1788572375.550403:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569504512 00000100:00100000:2.0:1788572375.550428:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5 00000100:00100000:2.0:1788572375.550434:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:161770:x1875444569504512:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:2.0:1788572375.550644:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:161770:x1875444569504512:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 209us (264us total) trans 347892350979 rc 0/0 00000100:00100000:2.0:1788572375.550651:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5 00010000:00010000:3.0:1788572375.557869:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.557893:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.557901:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.557907:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572375.557913:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.557921:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.557939:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a03b22d00) 00010000:00010000:3.0:1788572375.557942:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572375.557947:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.557953:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be227 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1788572375.566773:0:196609:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaac7886dfe10 00100000:10000000:0.0:1788572375.568851:0:196609:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1788572375.571244:0:196597:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1989:0x0] 00000100:00100000:2.0:1788572375.571292:0:196597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196597:1875444584377856:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788572375.571361:0:196597:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.571399:0:196597:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572375.572551:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584377856 00000100:00100000:2.0:1788572375.572561:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584377856 00000100:00100000:2.0:1788572375.572609:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22661 00000100:00100000:2.0:1788572375.572618:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:196597:x1875444584377856:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788572375.572649:0:17061:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6689 -> diff = -152 00002000:02000040:2.0:1788572375.572654:0:17061:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6538 to 0x2c0000401:6689) 00000004:00080000:1.0:1788572375.575115:0:196595:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x1a22:0x0] 00000100:00100000:1.0:1788572375.575174:0:196595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196595:1875444584377984:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788572375.575249:0:196595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572375.575285:0:196595:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590520c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572375.575345:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584377984 00000100:00100000:1.0:1788572375.575351:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584377984 00000100:00100000:1.0:1788572375.575392:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22662 00000100:00100000:1.0:1788572375.575401:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+6:196595:x1875444584377984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788572375.575427:0:179391:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6721 -> diff = -31 00002000:02000040:1.0:1788572375.575431:0:179391:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6691 to 0x280000401:6721) 00002000:00010000:1.0:1788572375.575474:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.575511:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.575528:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a41:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.575533:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.575539:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.575555:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.575566:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.575581:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.575598:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572375.575707:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.575713:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.575721:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a40:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.578093:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.578115:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578140:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578153:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578162:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578198:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572375.578320:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.578327:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578337:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3f:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.578340:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.578345:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578360:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578368:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578375:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578390:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572375.578429:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.578435:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578442:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3e:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.578445:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.578449:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578457:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578465:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578492:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578508:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788572375.578546:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.578551:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578559:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3d:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.578562:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.578566:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578574:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578582:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578589:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578600:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788572375.578636:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.578640:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578649:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3c:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.578651:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.578655:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578664:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578672:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578680:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578687:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788572375.578720:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.578725:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578733:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3b:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.578735:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.578739:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578748:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578756:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578763:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578771:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788572375.578846:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.578852:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578861:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3a:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.578863:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.578867:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578875:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578883:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578890:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578903:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788572375.578939:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.578944:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578952:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a39:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.578955:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.578958:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578966:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578973:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578980:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.578988:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788572375.579025:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.579030:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579037:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a38:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.579041:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.579044:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579052:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579059:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579066:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579073:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1788572375.579110:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.579115:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579121:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a37:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.579124:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.579128:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579136:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579143:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579150:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579158:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1788572375.579193:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.579198:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579206:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a36:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.579208:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.579212:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579221:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579229:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579236:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579245:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1788572375.579280:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.579285:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579293:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a35:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.579295:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.579299:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579307:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579315:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579323:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579331:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1788572375.579367:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.579372:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579380:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a34:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.579383:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.579387:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579396:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579405:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579413:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579421:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1788572375.579451:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.579456:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579464:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a33:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.579467:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.579472:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579502:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579511:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579517:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579530:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:1.0:1788572375.579565:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.579570:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579577:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a32:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.579579:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.579582:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579590:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579597:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579603:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579609:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:1.0:1788572375.579645:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.579650:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579657:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a31:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.579660:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.579663:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579670:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579677:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579683:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579690:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:1.0:1788572375.579722:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.579727:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579734:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a30:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.579737:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.579741:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579749:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579757:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579765:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.579775:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00010000:00010000:0.0:1788572375.579828:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1788572375.579838:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579846:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.579850:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579859:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579876:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579884:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b7063fd/0x265cfe11109be22e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579906:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1788572375.579911:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579922:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.579924:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579931:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579940:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579946:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109be235 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579958:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788572375.579962:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579968:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.579971:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579979:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579988:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.579995:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d3cc035/0x265cfe11109be23c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580007:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788572375.580009:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580015:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580018:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580025:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580034:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580040:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109be243 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580051:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788572375.580054:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580060:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580063:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580070:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580077:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580083:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109be24a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580094:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788572375.580096:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580101:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580104:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580110:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580119:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580125:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109be251 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580139:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788572375.580142:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580149:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580152:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580159:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580168:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580175:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109be258 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580185:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788572375.580188:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580194:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580196:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580207:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580215:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580221:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109be25f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580230:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788572375.580233:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580239:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580241:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580248:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580255:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580262:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109be266 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580275:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788572375.580278:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580283:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580286:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580293:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580301:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580308:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109be26d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580316:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788572375.580320:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580326:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580329:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580340:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580348:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580354:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109be274 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580364:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788572375.580367:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580373:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580376:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580384:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580393:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580401:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109be27b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580416:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788572375.580419:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580425:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580428:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580435:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580443:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580450:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109be282 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580459:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572375.580462:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580466:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580469:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580528:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580538:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580544:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109be289 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580554:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572375.580557:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580563:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580565:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580572:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580580:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580587:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109be290 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580600:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572375.580604:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580609:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580612:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580618:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580625:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580632:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109be297 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580641:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572375.580645:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580650:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580653:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580663:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580672:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580678:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109be29e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580689:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572375.580693:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580699:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.580701:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580708:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580715:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580722:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109be2a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.580737:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.580739:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.580741:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572375.584938:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.584951:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.584968:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2f:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.584973:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.584980:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.584996:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585007:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585017:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585039:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572375.585104:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.585110:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585120:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2e:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.585123:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.585128:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585137:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585146:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585154:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585163:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572375.585203:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.585208:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585216:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2d:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.585219:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.585223:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585233:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585242:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585249:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585258:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572375.585303:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.585309:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585316:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2c:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.585319:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.585323:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585333:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.585341:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.587528:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.587560:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788572375.587687:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.587695:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.587707:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2b:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.587712:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.587718:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588441:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588454:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588463:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588475:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788572375.588517:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788572375.588523:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588532:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.588537:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588547:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588564:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588572:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109be2ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588597:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572375.588601:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588608:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.588612:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588620:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588631:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588638:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109be2b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588650:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572375.588654:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588661:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.588664:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588671:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588681:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588690:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109be2ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588702:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572375.588706:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.588713:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.588716:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.589025:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.589038:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.589046:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008c0dc48/0x265cfe11109be2c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.589059:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.589063:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.589069:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.589073:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.589080:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.589089:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.589097:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7920746/0x265cfe11109be2c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.589114:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.589116:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.589118:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.592463:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.592474:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.592500:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.592559:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572375.592701:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.592711:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.593838:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2a:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.593849:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.593857:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.593877:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.593889:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.593898:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.593930:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572375.594008:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.594015:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594024:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a29:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.594027:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.594031:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594041:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594049:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594056:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594075:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572375.594086:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572375.594087:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.594092:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.594093:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594101:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572375.594101:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.594107:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.594107:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.594123:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594124:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594141:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.594141:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594150:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d5bdaec/0x265cfe11109be2cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.594150:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003122c460/0x265cfe11109be2d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594169:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.594169:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.594170:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.594171:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.594172:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.594172:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572375.594212:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.594218:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594226:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a28:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.594229:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.594234:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594243:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594251:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594259:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594280:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572375.594322:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.594327:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594335:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a27:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.594339:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.594343:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594352:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594360:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594368:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594383:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572375.594391:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572375.594395:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594404:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.594407:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594416:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594427:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594435:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109be2dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594447:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.594451:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594458:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.594462:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.594470:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.594541:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.595882:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.595898:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005153f421/0x265cfe11109be2e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.595920:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.595922:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.595925:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788572375.597238:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1788572375.598871:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.598883:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.598901:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a26:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.598906:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.598912:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.598927:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.598936:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.598944:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.598969:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572375.599043:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.599049:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599057:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a25:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.599060:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.599064:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599074:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599083:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599089:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599108:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572375.599126:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572375.599132:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599140:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.599145:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599153:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599171:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599179:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42bedfc/0x265cfe11109be2eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599201:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.599205:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599211:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.599214:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599221:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599230:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599236:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001babe2ab/0x265cfe11109be2f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599249:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.599251:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.599252:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.599260:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572375.599301:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.599306:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599314:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a24:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.599317:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.599321:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599331:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599340:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599346:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599359:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572375.599365:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.599370:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599382:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.599385:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599392:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599402:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599409:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d4d527b/0x265cfe11109be2f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599422:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.599424:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.599425:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572375.599501:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572375.599506:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599513:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a23:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:1.0:1788572375.599516:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572375.599520:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599534:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599542:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599548:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.599573:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788572375.599606:0:179391:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6690 00000100:00100000:1.0:1788572375.599707:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:196595:x1875444584377984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24302us (24454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572375.599718:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22662 00010000:00010000:0.0:1788572375.600161:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572375.600169:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.600180:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.600185:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.600195:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.600210:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.600219:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008a90e6d/0x265cfe11109be300 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.600244:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.600246:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.600248:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572375.604117:0:196595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196595:1875444584377984:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788572375.604144:0:196595:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x1a41:0x0] from OST, last_created [0x280000401:0x1a41:0x0]last_used is [0x280000401:0x1a22:0x0] 00000100:00100000:1.0:1788572375.604262:0:196595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196595:1875444584378240:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788572375.604347:0:196595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572375.604381:0:196595:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a373f6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572375.604409:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584378240 00000100:00100000:1.0:1788572375.604418:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584378240 00000100:00100000:1.0:1788572375.604473:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22663 00000100:00100000:1.0:1788572375.604507:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:196595:x1875444584378240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788572375.604574:0:43928:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 6722 00000100:00100000:0.0:1788572375.608085:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584378112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572375.608120:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:196595:x1875444584378240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3616us (3772us total) trans 38654705668 rc 0/0 00000100:00100000:1.0:1788572375.608131:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22663 00000100:00100000:0.0:1788572375.608150:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572375.608302:0:196595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196595:1875444584378240:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788572375.608320:0:196595:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1a41:0x0]-[0x280000401:0x1a61:0x0] 00002000:00010000:2.0:1788572375.615424:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.615440:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.615459:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a21:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.615465:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.615471:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572375.615552:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584378112 00000100:00100000:0.0:1788572375.615563:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584378112 00000100:00100000:0.0:1788572375.615619:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6343 00000100:00100000:0.0:1788572375.615629:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584378112:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572375.615636:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.615646:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:0.0:1788572375.615653:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00010000:00010000:2.0:1788572375.615655:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.615673:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572375.615686:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572375.615692:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.615701:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572375.615706:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.615715:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.615732:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.615740:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be307 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.615763:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.615765:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572375.615766:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584378112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (7615us total) trans 0 rc 0/0 00010000:00010000:2.0:1788572375.615767:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572375.615774:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6343 00000100:00100000:0.0:1788572375.615859:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584378112:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788572375.617580:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788572375.617637:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.617647:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.617664:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a20:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.617668:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.617674:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.617693:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.617703:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.617711:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.617784:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572375.618115:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.618121:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.618129:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1f:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.618131:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.618135:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.618143:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.618150:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.618160:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618691:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572375.618701:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618710:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.618714:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618725:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618743:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618751:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4b4a460/0x265cfe11109be30e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618770:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572375.618776:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618783:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.618786:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618803:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618899:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.618911:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.618913:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.618915:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.619003:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572375.619010:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000509125ca/0x265cfe11109be315 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572375.619113:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.619118:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619129:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1e:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.619132:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.619138:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619149:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619158:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619165:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619196:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.619203:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619210:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.619214:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619222:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619232:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619239:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.619240:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.619241:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.619295:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572375.619299:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032e0df03/0x265cfe11109be31c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572375.619357:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.619362:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619370:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1d:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.619373:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.619377:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619386:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619394:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619401:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619625:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.619632:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619641:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.619645:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619653:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619665:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.619674:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.619676:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.619678:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.619749:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572375.619754:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028592d6a/0x265cfe11109be323 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572375.619843:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.619849:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619858:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1c:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.619861:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.619866:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619874:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619882:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.619890:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.619956:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572375.619962:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.619970:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.619974:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.619982:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.619998:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.620007:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.620008:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.620010:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.620069:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572375.620074:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109be32a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572375.620125:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.620131:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620144:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1b:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.620148:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.620152:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620161:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620170:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620177:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.620201:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.620207:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.620215:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.620219:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.620227:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.620237:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.620245:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.620247:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.620249:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.620307:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572375.620312:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109be331 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572375.620374:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.620378:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620386:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1a:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.620389:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.620393:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620402:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620410:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620417:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.620593:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572375.620599:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.620606:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.620610:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.620618:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.620630:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.620638:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.620640:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.620641:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.620711:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572375.620717:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109be338 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572375.620771:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.620776:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620784:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a19:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.620787:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.620801:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620812:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620833:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.620840:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.621048:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.621054:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.621062:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.621066:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.621075:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.621087:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.621096:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.621097:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.621099:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.621156:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572375.621161:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109be33f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572375.621218:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.621223:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.621231:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a18:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.621234:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.621237:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.621246:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.621254:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.621265:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.623468:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.623492:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.623514:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.623519:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.623530:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.623552:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.623563:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.623565:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.623566:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572375.624660:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572375.624672:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109be346 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.625870:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572375.626988:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572375.626999:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.627016:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a17:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:3.0:1788572375.627021:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572375.627027:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.627043:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.628163:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.628175:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.628198:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572375.628280:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572375.628286:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.628298:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a16:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:3.0:1788572375.628301:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572375.628307:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.628317:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.628324:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.628330:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.628511:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572375.628520:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.628529:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616fe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572375.628534:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.628543:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.628561:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.628569:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5397f62/0x265cfe11109be34d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572375.628588:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.628590:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572375.628594:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.629465:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572375.629492:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572375.629498:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.629506:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572375.629510:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.629594:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.629610:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.629617:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000a61123/0x265cfe11109be354 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.629633:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.629635:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.629637:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572375.629721:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572375.630841:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.630863:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a15:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:3.0:1788572375.630867:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572375.630873:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.630887:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.630897:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.630905:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.630926:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572375.630941:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572375.630946:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.630953:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616ee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572375.630957:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.630965:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.630979:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.630991:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e67208f0/0x265cfe11109be35b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.631007:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.631009:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.631011:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572375.632063:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572375.632072:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632083:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a14:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:3.0:1788572375.632087:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572375.632091:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632101:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632109:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632116:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632138:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572375.632189:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572375.632194:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632203:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a13:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:3.0:1788572375.632206:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572375.632210:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632219:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632227:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632235:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632251:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572375.632260:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572375.632266:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632273:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616fa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572375.632279:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632292:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632304:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632311:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51da2f4/0x265cfe11109be362 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632325:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572375.632328:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.632335:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572375.632338:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572375.632719:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.632726:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632735:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a12:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.632738:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.632742:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632752:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632760:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632767:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632804:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572375.632846:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.632852:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632860:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a11:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.632863:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.632868:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632877:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632884:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632891:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632906:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788572375.632944:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.632949:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632957:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a10:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.632961:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.632965:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632975:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632983:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.632991:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633005:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788572375.633039:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633044:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633051:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0f:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633053:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.633057:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633064:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633071:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633077:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633084:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788572375.633115:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633121:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633128:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0e:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633131:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.633134:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633143:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633151:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633159:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633168:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788572375.633202:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633206:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633215:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0d:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633218:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.633222:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633231:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633239:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633246:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633253:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788572375.633284:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633289:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633297:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0c:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633300:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.633304:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633314:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633323:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633330:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633339:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788572375.633521:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633526:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633534:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0b:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633537:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.633540:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633549:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633557:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633564:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633580:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788572375.633617:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633623:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633631:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0a:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633633:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a0a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.633638:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633647:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633655:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633662:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633670:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788572375.633705:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633710:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633718:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a09:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633721:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a09:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.633725:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633734:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633742:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633748:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633757:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1788572375.633806:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633811:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633819:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a08:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633822:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a08:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.633826:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633835:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633843:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633851:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633859:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1788572375.633898:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633903:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633911:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a07:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633913:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a07:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.633917:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633927:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633935:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633942:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633951:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1788572375.633980:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.633985:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.633992:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a06:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.633996:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a06:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.634000:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634009:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634017:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634024:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634031:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1788572375.634058:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.634062:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634070:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a05:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.634072:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a05:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.634077:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634086:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634095:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634102:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634110:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1788572375.634143:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.634148:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634155:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a04:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.634158:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a04:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.634162:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634171:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634178:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634186:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634200:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1788572375.634228:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.634233:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634240:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a03:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.634243:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a03:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.634247:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634255:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634263:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634270:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634278:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1788572375.634306:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572375.634311:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634318:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a02:0x0].0x0 since=9128s v=(0 0) 00010000:00010000:2.0:1788572375.634322:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a02:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572375.634326:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634334:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.634342:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634648:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788572375.634657:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634670:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.634674:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634684:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634701:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634709:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109be370 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634737:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788572375.634741:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634747:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.634750:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634757:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634766:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634773:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109be377 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634787:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788572375.634802:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634809:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.634812:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634820:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634831:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634839:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109be37e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634853:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788572375.634856:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634862:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.634866:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634874:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634884:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634892:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b67833d1/0x265cfe11109be385 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634905:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788572375.634909:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634915:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.634919:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634927:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634936:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634944:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109be38c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634956:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788572375.634960:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634967:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.634970:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634978:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634988:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.634995:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109be393 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635007:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788572375.635011:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635017:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.635021:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635034:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635043:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635051:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109be39a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635063:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788572375.635066:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635072:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.635075:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635083:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635093:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635099:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109be3a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635117:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788572375.635121:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635127:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.635130:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635138:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635143:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635148:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635154:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635155:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee74e34d/0x265cfe11109be3a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635162:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b524fb21/0x265cfe11109be369 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635166:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788572375.635170:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635176:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.635179:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635183:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572375.635187:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635193:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635194:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572375.635197:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635202:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635204:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635209:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109be3af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635212:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635220:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cd3fb37/0x265cfe11109be3b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635221:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572375.635224:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635229:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572375.635230:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.635233:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635233:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635241:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635241:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572375.635244:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635249:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635256:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052fb1079/0x265cfe11109be3bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635257:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635266:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635272:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572375.635272:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021bfa06b/0x265cfe11109be3c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635276:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635281:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.635284:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635285:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572375.635288:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635292:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635294:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572375.635297:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635301:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635305:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635308:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109be3cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635313:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635318:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572375.635319:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109be3d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635321:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.635327:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572375.635330:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635334:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.635336:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.635338:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.635342:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.635433:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572375.635449:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572375.635833:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572375.635839:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635848:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572375.635853:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635862:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635874:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635882:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109be3e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572375.635898:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.635900:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.635902:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.635908:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.635914:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788572375.636274:0:17061:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6537 00010000:00010000:0.0:1788572375.636442:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.636452:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109be3d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572375.636469:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.636470:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572375.636472:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572375.636562:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:196597:x1875444584377856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 63939us (65195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572375.636573:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22661 00010000:00010000:1.0:1788572375.636705:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572375.637575:0:196597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196597:1875444584377856:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788572375.637595:0:196597:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1a21:0x0] from OST, last_created [0x2c0000401:0x1a21:0x0]last_used is [0x2c0000401:0x1989:0x0] 00000100:00100000:2.0:1788572375.637681:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584378368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572375.637740:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572375.637832:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584378368 00000100:00100000:3.0:1788572375.637840:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584378368 00000100:00100000:3.0:1788572375.637892:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6344 00000100:00100000:3.0:1788572375.637901:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584378368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572375.637926:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141248 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572375.638020:0:196597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196597:1875444584378496:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788572375.638051:0:196597:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572375.638080:0:196597:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572375.640522:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584378496 00000100:00100000:1.0:1788572375.640536:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584378496 00000100:00100000:1.0:1788572375.640592:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22664 00000100:00100000:1.0:1788572375.640602:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:196597:x1875444584378496:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788572375.640648:0:43920:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6690 00000100:00100000:1.0:1788572375.642261:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:196597:x1875444584378496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1652us (4200us total) trans 4294975677 rc 0/0 00000100:00100000:1.0:1788572375.642272:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22664 00000100:00100000:1.0:1788572375.642347:0:196597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196597:1875444584378496:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788572375.642362:0:196597:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1a21:0x0]-[0x2c0000401:0x1a41:0x0] 00000100:00100000:3.0:1788572375.647934:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584378368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10025us (10185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572375.647949:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6344 00000100:00100000:2.0:1788572375.655995:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584378368:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788572375.888927:0:196862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788572375.932759:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584378624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572375.932844:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572375.933115:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584378624 00000100:00100000:2.0:1788572375.933124:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584378624 00000100:00100000:2.0:1788572375.933176:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6345 00000100:00100000:2.0:1788572375.933185:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584378624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572375.933211:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140352 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572375.933256:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584378624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572375.933264:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6345 00000100:00100000:2.0:1788572375.933314:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584378624:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788572375.934648:0:188042:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788572376.362906:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572376.362967:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572376.363008:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572376.363096:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569504768 00000100:00100000:1.0:1788572376.363106:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569504768 00000100:00100000:1.0:1788572376.363168:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569504896 00000100:00100000:1.0:1788572376.363172:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569504896 00000100:00100000:1.0:1788572376.363198:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 350 00000100:00100000:1.0:1788572376.363208:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569504768:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572376.363286:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569504768:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 80us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572376.363294:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 350 00000100:00100000:1.0:1788572376.363313:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 351 00000100:00100000:1.0:1788572376.363320:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569504896:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572376.363360:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569504896:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 40us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572376.363366:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 351 00000100:00100000:0.0:1788572376.364310:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569504640 00000100:00100000:0.0:1788572376.364318:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569504640 00000100:00100000:0.0:1788572376.364375:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 76 00000100:00100000:0.0:1788572376.364383:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569504640:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572376.364429:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569504640:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 47us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572376.364440:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 76 00010000:00010000:3.0:1788572376.636775:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788572376.831206:0:196915:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788572376.831449:0:196915:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788572377.661889:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572377.999049:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584378752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572377.999161:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572378.000011:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584378752 00000100:00100000:1.0:1788572378.000037:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584378752 00000100:00100000:1.0:1788572378.000128:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6346 00000100:00100000:1.0:1788572378.000143:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584378752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572378.000191:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572378.000285:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584378752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572378.000292:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6346 00000100:00100000:1.0:1788572378.000354:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584378752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788572378.000626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1788572378.322025:0:196966:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788572378.322645:0:196966:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788572378.685925:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572379.709338:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572380.542020:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572380.542070:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584378880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572380.542190:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.542445:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584379136:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.542529:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.542549:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584379648:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.542573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.542590:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584380160:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.542617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.542636:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788572380.542641:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584379008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.542672:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.542696:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584379520:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.542716:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.542729:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584380032:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.542746:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.542774:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584379136 00000100:00100000:1.0:1788572380.542783:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584379136 00000100:00100000:1.0:1788572380.542845:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584379648 00000100:00100000:1.0:1788572380.542847:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584379648 00000100:00100000:1.0:1788572380.542873:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788572380.542883:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584379136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.542953:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584379136:12345-0@lo:400:kworker.0 Request processed in 72us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572380.542962:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788572380.542983:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788572380.542989:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584379648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543017:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584379648:12345-0@lo:400:kworker.0 Request processed in 29us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572380.543023:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788572380.543058:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584379008 00000100:00100000:1.0:1788572380.543062:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584379008 00000100:00100000:1.0:1788572380.543087:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788572380.543094:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584379008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543155:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584379008:12345-0@lo:400:kworker.0 Request processed in 61us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572380.543162:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788572380.543202:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584379264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543227:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.543245:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584379776:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543268:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.543284:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584380288:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543304:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.543321:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572380.543327:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584379392:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.543361:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584379904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543380:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.543394:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584380416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572380.543437:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584379264 00000100:00100000:1.0:1788572380.543441:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584379264 00000100:00100000:1.0:1788572380.543461:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584379776 00000100:00100000:1.0:1788572380.543464:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584379776 00000100:00100000:1.0:1788572380.543511:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584379904 00000100:00100000:1.0:1788572380.543515:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584379904 00000100:00100000:1.0:1788572380.543528:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584380416 00000100:00100000:1.0:1788572380.543531:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584380416 00000100:00100000:1.0:1788572380.543547:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788572380.543554:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584379264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543592:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584379264:12345-0@lo:400:kworker.0 Request processed in 39us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572380.543599:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788572380.543613:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788572380.543619:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584379776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543645:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584379776:12345-0@lo:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572380.543651:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788572380.543663:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788572380.543668:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584379904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543696:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584379904:12345-0@lo:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572380.543701:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788572380.543713:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788572380.543718:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584380416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543742:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584380416:12345-0@lo:400:kworker.0 Request processed in 24us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572380.543748:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788572380.543787:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584379008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543806:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584379136:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543817:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584379648:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543853:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584379904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543864:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584380416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543873:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584379264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572380.543883:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584379776:0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.544557:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584380160 00000100:00100000:3.0:1788572380.544568:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584380160 00000100:00100000:3.0:1788572380.544624:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584379520 00000100:00100000:3.0:1788572380.544628:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584379520 00000100:00100000:3.0:1788572380.544652:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584380288 00000100:00100000:3.0:1788572380.544656:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584380288 00000100:00100000:3.0:1788572380.544676:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584379392 00000100:00100000:3.0:1788572380.544679:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584379392 00000100:00100000:3.0:1788572380.544709:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7754 00000100:00100000:3.0:1788572380.544719:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584380160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.544835:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584380160:12345-0@lo:400:kworker.0 Request processed in 118us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572380.544845:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7754 00000100:00100000:3.0:1788572380.544865:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7755 00000100:00100000:3.0:1788572380.544870:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584379520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.544936:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584379520:12345-0@lo:400:kworker.0 Request processed in 65us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572380.544943:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7755 00000100:00100000:3.0:1788572380.544967:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7756 00000100:00100000:3.0:1788572380.544974:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584380288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.545013:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584380288:12345-0@lo:400:kworker.0 Request processed in 40us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572380.545019:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7756 00000100:00100000:3.0:1788572380.545030:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7757 00000100:00100000:3.0:1788572380.545051:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584379392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.545084:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584379392:12345-0@lo:400:kworker.0 Request processed in 35us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572380.545090:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7757 00000100:00100000:3.0:1788572380.545117:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584378880 00000100:00100000:3.0:1788572380.545122:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584378880 00000100:00100000:3.0:1788572380.545148:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584380032 00000100:00100000:3.0:1788572380.545151:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584380032 00000100:00100000:3.0:1788572380.545164:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1788572380.545170:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3643:x1875444584378880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572380.545224:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00000100:00100000:3.0:1788572380.545267:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3643:x1875444584378880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (3088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572380.545277:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1788572380.545290:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1788572380.545297:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584380032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.545331:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584380032:12345-0@lo:400:kworker.0 Request processed in 35us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572380.545337:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1788572380.545418:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584379520:0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.545433:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584380032:0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.545448:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584380160:0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.545535:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584379392:0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.545550:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584380288:0@lo:400:kworker.0 00000100:00100000:3.0:1788572380.545571:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584378880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572380.546400:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584380544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572380.546517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572380.546581:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572380.546588:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572380.546591:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572380.546726:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584380544 00000100:00100000:2.0:1788572380.546734:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584380544 00000100:00100000:2.0:1788572380.546789:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1788572380.546800:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584380544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572380.546835:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:2.0:1788572380.546887:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584380544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572380.546904:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1788572380.548105:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584380544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572380.581817:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572380.582308:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569505024 00000100:00100000:1.0:1788572380.582324:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569505024 00000100:00100000:1.0:1788572380.582429:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1100 00000100:00100000:1.0:1788572380.582441:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:162187:x1875444569505024:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572380.582516:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572380.582550:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f600/0x265cfe11109be3e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3b3 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572380.582643:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fa00/0x265cfe11109be3ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572380.582662:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fa00/0x265cfe11109be3ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572380.582680:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fa00/0x265cfe11109be3ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572380.582753:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572380.582757:0:196070:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572380.582784:0:196070:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fa00/0x265cfe11109be3ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572380.582815:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f600/0x265cfe11109be3e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3b3 expref: 9 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572380.582837:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fa00/0x265cfe11109be3ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3b3 expref: 8 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572380.582848:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572380.582851:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572380.582856:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164fa00, rc 0) 00000100:00100000:1.0:1788572380.582953:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:162187:x1875444569505024:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 514us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572380.582969:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1100 00000100:00080000:0.0:1788572380.585723:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572380.611786:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572380.612354:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569505152 00000100:00100000:3.0:1788572380.612369:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569505152 00000100:00100000:3.0:1788572380.612540:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1101 00000100:00100000:3.0:1788572380.612556:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:162187:x1875444569505152:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572380.612609:0:188833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00000100:00100000:3.0:1788572380.612730:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:162187:x1875444569505152:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 179us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572380.612738:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1101 00000100:00100000:2.0:1788572380.619099:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572380.619310:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569505280 00000100:00100000:0.0:1788572380.619326:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569505280 00000100:00100000:0.0:1788572380.619415:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1102 00000100:00100000:0.0:1788572380.619430:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162187:x1875444569505280:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:0.0:1788572380.619520:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:0.0:1788572380.619618:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162187:x1875444569505280:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 190us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572380.619626:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1102 00000100:00100000:1.0:1788572380.627185:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572380.627416:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569505408 00000100:00100000:0.0:1788572380.627432:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569505408 00000100:00100000:0.0:1788572380.627546:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22665 00000100:00100000:0.0:1788572380.627556:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2396:x1875444569505408:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:0.0:1788572380.627604:0:43921:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9133 last 0 00000020:00000080:0.0:1788572380.627648:0:43921:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109be3f5 00002000:00100000:0.0:1788572380.627665:0:43921:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e5903a20000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572380.627690:0:43921:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572380.627798:0:43921:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788572380.627839:0:43921:0:(import.c:65:import_set_state_nolock()) ffff8e5903a25000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572380.627956:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569505408:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 399us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572380.627965:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22665 00000001:00100000:0.0:1788572380.632113:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:0.0:1788572380.632134:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705668 is committed 00000100:00100000:2.0:1788572380.637575:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572380.637730:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569505536 00000100:00100000:0.0:1788572380.637750:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569505536 00000100:00100000:0.0:1788572380.637904:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6347 00000100:00100000:0.0:1788572380.637916:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3a49fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162187:x1875444569505536:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572380.637950:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572380.638026:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3a49fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162187:x1875444569505536:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 112us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572380.638034:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6347 00000100:00080000:1.0:1788572380.639925:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572380.647178:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572380.647295:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569505664 00000100:00100000:0.0:1788572380.647306:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569505664 00000100:00100000:0.0:1788572380.647417:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22666 00000100:00100000:0.0:1788572380.647426:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2396:x1875444569505664:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:0.0:1788572380.647475:0:43919:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9133 last 0 00000020:00000080:0.0:1788572380.647544:0:43919:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109be3fc 00002000:00100000:0.0:1788572380.647556:0:43919:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e5903a22000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572380.647578:0:43919:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572380.647649:0:43919:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788572380.647681:0:43919:0:(import.c:65:import_set_state_nolock()) ffff8e5903a27000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572380.647756:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569505664:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 328us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572380.647763:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22666 00000100:00100000:1.0:1788572380.651659:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000001:00100000:1.0:1788572380.653350:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:1.0:1788572380.653370:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975677 is committed 00000100:00100000:3.0:1788572380.653723:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569505792 00000100:00100000:3.0:1788572380.653733:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569505792 00000100:00100000:1.0:1788572380.654052:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6348 00000100:00100000:1.0:1788572380.654066:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162187:x1875444569505792:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:1.0:1788572380.654266:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572380.654384:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162187:x1875444569505792:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 320us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572380.654391:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6348 00000100:00080000:0.0:1788572380.654651:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572380.734168:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572381.052792:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572381.052814:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584380672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572381.052883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572381.053688:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584380672 00000100:00100000:3.0:1788572381.053711:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584380672 00000100:00100000:3.0:1788572381.053767:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6349 00000100:00100000:3.0:1788572381.053777:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584380672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572381.053800:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572381.053865:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584380672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572381.053872:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6349 00000100:00100000:1.0:1788572381.055258:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 2 00000100:00100000:1.0:1788572381.055298:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584380672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572381.057301:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572381.057319:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584380800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572381.057379:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572381.057417:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584380800 00000100:00100000:1.0:1788572381.057423:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584380800 00000100:00100000:1.0:1788572381.057459:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6350 00000100:00100000:1.0:1788572381.057468:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584380800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572381.057511:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572381.057552:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584380800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572381.057561:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6350 00000100:00100000:1.0:1788572381.057593:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975677 gen 2 00000100:00100000:1.0:1788572381.058948:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584380800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572381.061682:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572381.061712:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584380928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572381.061785:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572381.062966:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584380928 00000100:00100000:3.0:1788572381.062979:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584380928 00000100:00100000:3.0:1788572381.063048:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6351 00000100:00100000:3.0:1788572381.063813:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584380928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572381.063847:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572381.063958:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584380928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 900us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572381.063966:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6351 00000100:00100000:2.0:1788572381.069191:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584380928:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788572381.072788:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350979 is committed 00000001:00080000:2.0:1788572381.072808:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350978 is committed 00000100:00100000:3.0:1788572381.552658:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572381.552712:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572381.552749:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572381.552788:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572381.552836:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572381.552876:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569506432 00000100:00100000:3.0:1788572381.552887:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569506432 00000100:00100000:3.0:1788572381.552960:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569506304 00000100:00100000:3.0:1788572381.552964:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569506304 00000100:00100000:3.0:1788572381.552989:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7758 00000100:00100000:3.0:1788572381.553000:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506432:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572381.553331:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569506176 00000100:00100000:2.0:1788572381.553337:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569506176 00000100:00100000:2.0:1788572381.553389:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569506048 00000100:00100000:2.0:1788572381.553392:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569506048 00000100:00100000:2.0:1788572381.553412:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 358 00000100:00100000:2.0:1788572381.553419:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506176:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572381.553518:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506176:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 58us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572381.553526:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 358 00000100:00100000:2.0:1788572381.553545:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 359 00000100:00100000:2.0:1788572381.553552:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569506048:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572381.553578:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569506048:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 27us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572381.553585:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 359 00000100:00100000:2.0:1788572381.553626:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7759 00000100:00100000:2.0:1788572381.553633:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506304:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572381.553659:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506304:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 27us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572381.553664:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7759 00000100:00100000:0.0:1788572381.553775:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569505920 00000100:00100000:0.0:1788572381.553781:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569505920 00000100:00100000:0.0:1788572381.553833:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 78 00000100:00100000:0.0:1788572381.553841:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569505920:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572381.553870:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569505920:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572381.553876:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 78 00000100:00080000:0.0:1788572381.553922:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572381.554194:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506432:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 1194us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572381.554202:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7758 00010000:00010000:3.0:1788572381.758235:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572382.784072:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572383.102572:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572383.102607:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584381056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572383.102711:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572383.102775:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584381056 00000100:00100000:0.0:1788572383.102786:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584381056 00000100:00100000:0.0:1788572383.102855:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6352 00000100:00100000:0.0:1788572383.102866:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584381056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572383.102907:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572383.102974:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584381056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572383.102983:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6352 00000100:00080000:0.0:1788572383.103018:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572383.103065:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584381056:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572383.804627:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572384.834397:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572385.660849:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572385.660875:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584381184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572385.661028:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.662816:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584381440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.662878:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.662921:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584381952:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.662947:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.662968:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584382464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663001:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.663055:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572385.663066:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584381312:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663115:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.663139:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584381824:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663162:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.663179:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584382336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663198:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.663229:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584381440 00000100:00100000:1.0:1788572385.663237:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584381440 00000100:00100000:1.0:1788572385.663286:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584382336 00000100:00100000:1.0:1788572385.663289:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584382336 00000100:00100000:1.0:1788572385.663308:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788572385.663316:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584381440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663369:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584381440:12345-0@lo:400:kworker.0 Request processed in 53us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.663377:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788572385.663394:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788572385.663400:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584382336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663427:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584382336:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.663433:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788572385.663452:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584381952 00000100:00100000:1.0:1788572385.663455:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584381952 00000100:00100000:1.0:1788572385.663505:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584382464 00000100:00100000:1.0:1788572385.663509:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584382464 00000100:00100000:1.0:1788572385.663526:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584381824 00000100:00100000:1.0:1788572385.663529:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584381824 00000100:00100000:1.0:1788572385.663547:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7760 00000100:00100000:1.0:1788572385.663553:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584381952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663583:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584381952:12345-0@lo:400:kworker.0 Request processed in 31us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.663588:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7760 00000100:00100000:1.0:1788572385.663598:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7761 00000100:00100000:1.0:1788572385.663603:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584382464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663628:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584382464:12345-0@lo:400:kworker.0 Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.663634:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7761 00000100:00100000:1.0:1788572385.663643:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7762 00000100:00100000:1.0:1788572385.663649:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584381824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663670:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584381824:12345-0@lo:400:kworker.0 Request processed in 22us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.663678:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7762 00000100:00100000:1.0:1788572385.663695:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584381312 00000100:00100000:1.0:1788572385.663698:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584381312 00000100:00100000:1.0:1788572385.663737:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788572385.663744:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584381312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663773:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584381312:12345-0@lo:400:kworker.0 Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.663780:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788572385.663817:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584381696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663845:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.663863:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584382208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663899:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.663916:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584382720:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663937:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.663956:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788572385.663962:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584381568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.663983:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.664006:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584382080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664028:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.664040:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584382592:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664059:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572385.664084:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584382592 00000100:00100000:1.0:1788572385.664088:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584382592 00000100:00100000:1.0:1788572385.664112:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7763 00000100:00100000:1.0:1788572385.664119:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584382592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664153:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584382592:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.664159:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7763 00000100:00100000:1.0:1788572385.664175:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584382208 00000100:00100000:1.0:1788572385.664178:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584382208 00000100:00100000:1.0:1788572385.664194:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584382720 00000100:00100000:1.0:1788572385.664197:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584382720 00000100:00100000:1.0:1788572385.664207:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584381568 00000100:00100000:1.0:1788572385.664209:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584381568 00000100:00100000:1.0:1788572385.664219:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584382080 00000100:00100000:1.0:1788572385.664221:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584382080 00000100:00100000:1.0:1788572385.664232:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788572385.664237:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584382208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664265:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584382208:12345-0@lo:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.664271:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788572385.664283:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788572385.664289:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584382720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664316:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584382720:12345-0@lo:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.664322:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788572385.664334:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788572385.664340:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584381568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664364:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584381568:12345-0@lo:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.664370:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788572385.664382:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788572385.664388:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584382080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664413:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584382080:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572385.664419:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788572385.664455:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584381568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664466:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584382080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664474:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584382592:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664517:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584382208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664526:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584382720:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664563:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584381312:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664574:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584381824:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664584:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584382336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664596:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584381440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664605:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584381952:0@lo:400:kworker.0 00000100:00100000:1.0:1788572385.664615:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584382464:0@lo:400:kworker.0 00000100:00100000:0.0:1788572385.664765:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584381184 00000100:00100000:0.0:1788572385.664770:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584381184 00000100:00100000:0.0:1788572385.664804:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584381696 00000100:00100000:0.0:1788572385.664808:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584381696 00000100:00100000:0.0:1788572385.664822:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1788572385.664830:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584381184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572385.664861:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:0.0:1788572385.664901:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584381184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (3873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572385.664907:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1788572385.664924:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1788572385.664930:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3642:x1875444584381696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572385.664964:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3642:x1875444584381696:12345-0@lo:400:kworker.0 Request processed in 35us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572385.664971:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00080000:0.0:1788572385.665003:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572385.665007:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572385.665009:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572385.665012:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572385.665039:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350978 gen 2 00000004:00080000:0.0:1788572385.665045:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350978 committed transno 347892350978 00000020:00080000:0.0:1788572385.665074:0:3642:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e5902252e40 refcount 2 committed 0 result 0 batchid 17179873000 00000020:00080000:0.0:1788572385.665079:0:3642:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e590ce34400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5902252a80 00000020:00080000:0.0:1788572385.665083:0:3642:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027502:0x1:0x0].1 00000020:00080000:0.0:1788572385.665086:0:3642:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e590ce34200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5a37285c00 00000020:00080000:0.0:1788572385.665099:0:3642:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x24000272a:0x1:0x0].1 00000100:00100000:0.0:1788572385.665151:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584381696:0@lo:400:kworker.0 00000100:00100000:2.0:1788572385.665987:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584382848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572385.666047:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788572385.666118:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 17179873000 committed batchid 8589939517 00000020:00080000:2.0:1788572385.666209:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 8589939517 00000100:00100000:2.0:1788572385.666241:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584381184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572385.666668:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584382848 00000100:00100000:3.0:1788572385.666675:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584382848 00000100:00100000:3.0:1788572385.666719:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1788572385.666729:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584382848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572385.666756:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00000100:00100000:3.0:1788572385.666821:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584382848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572385.666828:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1788572385.666864:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584382848:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788572385.855452:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572386.172987:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572386.173020:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584382976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572386.173107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572386.173373:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584382976 00000100:00100000:1.0:1788572386.173384:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584382976 00000100:00100000:0.0:1788572386.173431:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572386.173443:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584383104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572386.173450:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6353 00000100:00100000:1.0:1788572386.173462:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584382976:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572386.173504:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788572386.173518:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572386.173538:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584383104 00000100:00100000:0.0:1788572386.173544:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584383104 00000100:00100000:0.0:1788572386.173567:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6354 00000100:00100000:0.0:1788572386.173575:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584383104:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572386.173587:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584382976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (478us total) trans 0 rc 0/0 00002000:00000024:0.0:1788572386.173594:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572386.173598:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6353 00000100:00100000:0.0:1788572386.173641:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584383104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572386.173648:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6354 00000100:00100000:1.0:1788572386.173659:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584382976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572386.173695:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584383104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572386.174009:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572386.174019:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584383232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572386.174053:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572386.174283:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584383232 00000100:00100000:1.0:1788572386.174288:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584383232 00000100:00100000:1.0:1788572386.174320:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6355 00000100:00100000:1.0:1788572386.174328:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584383232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572386.174344:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572386.174384:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584383232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572386.174390:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6355 00000100:00100000:2.0:1788572386.174471:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584383232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572386.671966:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572386.672058:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572386.672097:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572386.672127:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572386.672152:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572386.672253:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569506944 00000100:00100000:1.0:1788572386.672265:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569506944 00000100:00100000:1.0:1788572386.672325:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569507072 00000100:00100000:1.0:1788572386.672329:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569507072 00000100:00100000:0.0:1788572386.672346:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569506560 00000100:00100000:0.0:1788572386.672354:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569506560 00000100:00100000:1.0:1788572386.672356:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7764 00000100:00100000:1.0:1788572386.672368:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506944:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572386.672407:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 80 00000100:00100000:0.0:1788572386.672417:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569506560:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572386.672453:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506944:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 85us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572386.672457:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569506560:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 40us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572386.672465:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7764 00000100:00100000:0.0:1788572386.672470:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 80 00000100:00100000:1.0:1788572386.672521:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7765 00000100:00100000:1.0:1788572386.672531:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569507072:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572386.672542:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569506688 00000100:00100000:0.0:1788572386.672547:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569506688 00000100:00100000:1.0:1788572386.672565:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569507072:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 36us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572386.672576:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569506816 00000100:00100000:0.0:1788572386.672579:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569506816 00000100:00100000:1.0:1788572386.672588:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7765 00000100:00100000:0.0:1788572386.672604:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 366 00000100:00100000:0.0:1788572386.672612:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569506688:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572386.672641:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569506688:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572386.672649:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 366 00000100:00100000:0.0:1788572386.672666:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 367 00000100:00100000:0.0:1788572386.672674:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506816:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572386.672701:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569506816:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572386.672708:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 367 00000100:00080000:2.0:1788572386.673845:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572386.673852:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572386.673855:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572386.673858:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788572386.876883:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572387.784584:0:197160:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:0.0:1788572387.901868:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572388.220898:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584383360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572388.220981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572388.221225:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584383360 00000100:00100000:0.0:1788572388.221243:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584383360 00000100:00100000:0.0:1788572388.221306:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6356 00000100:00100000:0.0:1788572388.221317:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584383360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572388.221348:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572388.221407:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584383360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572388.221414:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6356 00000100:00100000:3.0:1788572388.221608:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584383360:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572388.221714:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572388.925319:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572389.954349:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572390.071535:0:197208:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1788572390.784442:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572390.784466:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584383488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572390.784553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572390.784630:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584383488 00000100:00100000:1.0:1788572390.784641:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584383488 00000100:00100000:2.0:1788572390.784774:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584383616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572390.784802:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1788572390.784809:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572390.784817:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584383488:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572390.784839:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584384128:0@lo:400:kworker.0 00000004:00000024:1.0:1788572390.784858:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00000100:00100000:2.0:1788572390.784867:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572390.784889:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584384640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572390.784919:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584383488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572390.784920:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572390.784931:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1788572390.784945:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572390.784952:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584383744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.784976:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572390.784994:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584384256:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.785016:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572390.785031:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584384768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.785049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572390.785074:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584383744 00000100:00100000:2.0:1788572390.785078:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584383744 00000100:00100000:2.0:1788572390.785126:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584384256 00000100:00100000:2.0:1788572390.785129:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584384256 00000100:00100000:2.0:1788572390.785147:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788572390.785153:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584383744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.785188:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584383744:12345-0@lo:400:kworker.0 Request processed in 35us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572390.785194:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788572390.785209:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788572390.785218:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584384256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572390.785230:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584384640 00000100:00100000:1.0:1788572390.785236:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584384640 00000100:00100000:2.0:1788572390.785249:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584384256:12345-0@lo:400:kworker.0 Request processed in 32us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572390.785257:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1788572390.785258:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788572390.785270:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584384640:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788572390.785292:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572390.785310:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584384640:12345-0@lo:400:kworker.0 Request processed in 42us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572390.785311:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584384000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572390.785323:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1788572390.785347:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584383616 00000100:00100000:2.0:1788572390.785348:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572390.785353:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584383616 00000100:00100000:2.0:1788572390.785374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584384512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572390.785384:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788572390.785394:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.785401:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572390.785423:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584385024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572390.785436:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584383616:12345-0@lo:400:kworker.0 Request processed in 43us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572390.785445:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788572390.785449:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572390.785469:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572390.785502:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584383872:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.785532:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572390.785551:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584384384:0@lo:400:kworker.0 00000100:00100000:1.0:1788572390.785562:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584384512 00000100:00100000:1.0:1788572390.785569:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584384512 00000100:00100000:2.0:1788572390.785577:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572390.785590:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584384896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572390.785600:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788572390.785609:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584384512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.785616:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572390.785650:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584385024 00000100:00100000:2.0:1788572390.785654:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584385024 00000100:00100000:2.0:1788572390.785671:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584383872 00000100:00100000:2.0:1788572390.785674:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584383872 00000100:00100000:2.0:1788572390.785686:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584384384 00000100:00100000:2.0:1788572390.785688:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584384384 00000100:00100000:2.0:1788572390.785702:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788572390.785708:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584385024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572390.786316:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584384512:12345-0@lo:400:kworker.0 Request processed in 706us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572390.786325:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788572390.786342:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788572390.786352:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584383872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572390.786510:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572390.786521:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584385152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572390.786552:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572390.786584:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584385152 00000100:00100000:0.0:1788572390.786599:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584385152 00000100:00100000:0.0:1788572390.786629:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1788572390.786636:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584385152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572390.786658:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:0.0:1788572390.786693:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584385152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572390.786699:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1788572390.786722:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788572390.786736:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584384384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572390.787717:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584384128 00000100:00100000:3.0:1788572390.787725:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584384128 00000100:00100000:3.0:1788572390.787766:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584384768 00000100:00100000:3.0:1788572390.787769:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584384768 00000100:00100000:3.0:1788572390.787789:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584384000 00000100:00100000:3.0:1788572390.787792:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584384000 00000100:00100000:3.0:1788572390.787811:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584384896 00000100:00100000:3.0:1788572390.787814:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584384896 00000100:00100000:3.0:1788572390.787833:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7766 00000100:00100000:3.0:1788572390.787840:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584384128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572390.787904:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584384128:12345-0@lo:400:kworker.0 Request processed in 65us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572390.787911:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7766 00000100:00100000:3.0:1788572390.787926:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7767 00000100:00100000:3.0:1788572390.787933:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584384768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572390.787962:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584384768:12345-0@lo:400:kworker.0 Request processed in 30us (2913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572390.787968:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7767 00000100:00100000:3.0:1788572390.787979:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7768 00000100:00100000:3.0:1788572390.787984:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584384000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.788193:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584385024:12345-0@lo:400:kworker.0 Request processed in 2483us (2742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572390.788201:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788572390.788353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2746c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584383488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572390.788398:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584383744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.788411:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584384256:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.788421:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584384768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.788430:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584383616:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.788440:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584384128:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.788450:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584384640:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.788528:0:177561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7769 00000100:00100000:2.0:1788572390.788537:0:177561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584384896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.788569:0:177561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584384896:12345-0@lo:400:kworker.0 Request processed in 34us (2955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572390.788575:0:177561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7769 00000100:00100000:2.0:1788572390.790142:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584385152:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788572390.790186:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572390.790191:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572390.790194:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572390.790197:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572390.792101:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584383872:12345-0@lo:400:kworker.0 Request processed in 5734us (6550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572390.792117:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788572390.792202:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584383872:0@lo:400:kworker.0 00000100:00100000:0.0:1788572390.793021:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584384384:12345-0@lo:400:kworker.0 Request processed in 6287us (7439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572390.793031:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000020:00080000:0.0:1788572390.793169:0:188042:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 17179873000 batchid updated 00000020:00080000:0.0:1788572390.793193:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873000 00000100:00100000:0.0:1788572390.793303:0:188089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:188089:1875444584385280:0@lo:1000:dist_txn-1.0 00000100:00100000:0.0:1788572390.793365:0:188089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572390.793389:0:188089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a370df000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572390.793408:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584385280 00000100:00100000:0.0:1788572390.793414:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584385280 00000100:00100000:0.0:1788572390.793453:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1788572390.793461:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:188089:x1875444584385280:12345-0@lo:1000:dist_txn-1.0 00000100:00100000:0.0:1788572390.793545:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:188089:x1875444584385280:12345-0@lo:1000:dist_txn-1.0 Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572390.793553:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1788572390.793605:0:188089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:188089:1875444584385280:0@lo:1000:dist_txn-1.0 00000004:00080000:0.0:1788572390.793641:0:188089:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a24517d80 with version 4 00000020:00080000:0.0:1788572390.793900:0:188089:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17179873000 cancel update log [0x200027502:0x1:0x0].1: rc = 0 00000020:00080000:0.0:1788572390.793981:0:188089:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17179873000 cancel update log [0x24000272a:0x1:0x0].1: rc = 0 00000020:00080000:0.0:1788572390.793991:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873000 00000004:00080000:0.0:1788572390.794000:0:188074:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e590639b300 version 4 rpc_version 4 00000020:00100000:0.0:1788572390.794016:0:188074:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572390.794023:0:188074:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5905a9ce00 x1875444584385536/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572390.794036:0:188074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584385536:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572390.794063:0:188074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572390.794080:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a18819d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572390.794106:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584385536 00000100:00100000:0.0:1788572390.794110:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584385536 00000100:00100000:0.0:1788572390.794134:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1788572390.794140:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:188074:x1875444584385536:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572390.794272:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188074:x1875444584385536:12345-0@lo:1000:osp_up0-1.0 Request processed in 130us (207us total) trans 347892350980 rc 0/0 00000100:00100000:0.0:1788572390.794291:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1788572390.794326:0:188074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584385536:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788572390.794990:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584384384:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.795004:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584384896:0@lo:400:kworker.0 00000100:00100000:3.0:1788572390.795736:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584384000:12345-0@lo:400:kworker.0 Request processed in 7747us (10386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572390.795748:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7768 00000100:00100000:2.0:1788572390.800456:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584384000:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.800492:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584384512:0@lo:400:kworker.0 00000100:00100000:2.0:1788572390.800511:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584385024:0@lo:400:kworker.0 00010000:00010000:1.0:1788572390.972687:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572391.295319:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572391.295344:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584385664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572391.295418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572391.295731:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584385664 00000100:00100000:2.0:1788572391.295741:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584385664 00000100:00100000:2.0:1788572391.295798:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6357 00000100:00100000:2.0:1788572391.295808:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584385664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572391.295838:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572391.295885:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584385664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572391.295895:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6357 00000100:00100000:2.0:1788572391.295915:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572391.295924:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584385792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572391.295950:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572391.296022:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584385792 00000100:00100000:1.0:1788572391.296026:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584385792 00000100:00100000:1.0:1788572391.296058:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6358 00000100:00100000:1.0:1788572391.296065:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584385792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572391.296083:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572391.296135:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584385792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572391.296141:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6358 00000100:00100000:1.0:1788572391.296186:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584385664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572391.296226:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584385792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572391.296524:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572391.296535:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584385920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572391.296569:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572391.296644:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584385920 00000100:00100000:3.0:1788572391.296649:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584385920 00000100:00100000:3.0:1788572391.296682:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6359 00000100:00100000:3.0:1788572391.296689:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584385920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572391.296702:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572391.296756:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584385920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572391.296763:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6359 00000100:00100000:3.0:1788572391.296796:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584385920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572391.790318:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572391.790372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572391.790412:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572391.790445:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572391.790471:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572391.790673:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569507712 00000100:00100000:3.0:1788572391.790684:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569507712 00000100:00100000:3.0:1788572391.790750:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569507584 00000100:00100000:3.0:1788572391.790753:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569507584 00000100:00100000:3.0:1788572391.790777:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7770 00000100:00100000:3.0:1788572391.790788:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569507712:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572391.790860:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569507712:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 74us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572391.790868:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7770 00000100:00100000:3.0:1788572391.790886:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7771 00000100:00100000:3.0:1788572391.790892:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569507584:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572391.790929:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569507584:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572391.790936:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7771 00000100:00100000:2.0:1788572391.791201:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569507456 00000100:00100000:2.0:1788572391.791206:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569507456 00000100:00100000:2.0:1788572391.791245:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569507328 00000100:00100000:2.0:1788572391.791249:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569507328 00000100:00100000:2.0:1788572391.791274:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 374 00000100:00100000:2.0:1788572391.791283:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569507456:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572391.791318:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569507456:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 38us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572391.791326:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 374 00000100:00100000:2.0:1788572391.791362:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 375 00000100:00100000:2.0:1788572391.791370:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569507328:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572391.791398:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569507328:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572391.791405:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 375 00000100:00100000:0.0:1788572391.791573:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569507200 00000100:00100000:0.0:1788572391.791577:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569507200 00000100:00100000:0.0:1788572391.791616:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 82 00000100:00100000:0.0:1788572391.791625:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569507200:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572391.791652:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569507200:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572391.791659:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 82 00000100:00080000:1.0:1788572391.791855:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572391.791860:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572391.791863:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572391.791865:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572391.996906:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572392.208011:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.208142:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569507840 00000100:00100000:0.0:1788572392.208157:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569507840 00000100:00100000:0.0:1788572392.208242:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1103 00000100:00100000:0.0:1788572392.208253:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:162656:x1875444569507840:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:0.0:1788572392.208295:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00000100:00100000:0.0:1788572392.208398:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:162656:x1875444569507840:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 146us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572392.208406:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1103 00000100:00100000:1.0:1788572392.214736:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.214916:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569507968 00000100:00100000:3.0:1788572392.214931:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569507968 00000100:00100000:3.0:1788572392.215048:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1104 00000100:00100000:3.0:1788572392.215061:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162656:x1875444569507968:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572392.215142:0:188833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:3.0:1788572392.215295:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162656:x1875444569507968:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 236us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572392.215305:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1104 00000100:00100000:1.0:1788572392.221336:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.221516:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569508096 00000100:00100000:3.0:1788572392.221531:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569508096 00000100:00100000:3.0:1788572392.221687:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6360 00000100:00100000:3.0:1788572392.222369:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162656:x1875444569508096:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572392.222413:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572392.222592:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162656:x1875444569508096:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 235us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572392.222601:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6360 00000100:00100000:2.0:1788572392.234809:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.235170:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569508224 00000100:00100000:0.0:1788572392.235184:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569508224 00000100:00100000:0.0:1788572392.235268:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6361 00000100:00100000:0.0:1788572392.235281:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162656:x1875444569508224:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572392.235327:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572392.235431:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162656:x1875444569508224:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 152us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572392.235440:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6361 00000100:00100000:1.0:1788572392.320726:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.321008:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569508352 00000100:00100000:2.0:1788572392.321023:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569508352 00000100:00100000:2.0:1788572392.321103:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1105 00000100:00100000:2.0:1788572392.321117:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:162673:x1875444569508352:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572392.321154:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.321184:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109be403 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3ba expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321276:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321296:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321313:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321331:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321338:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321346:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321553:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321563:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321570:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572392.321617:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1788572392.321622:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572392.321668:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321688:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321700:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321709:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321715:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.321720:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321729:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321743:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:2.0:1788572392.321746:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.321753:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321760:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be40a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321780:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321786:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321792:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321798:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.321800:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321806:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321814:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8e590b95fa00) 00010000:00010000:2.0:1788572392.321817:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.321820:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321827:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be411 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321880:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109be403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ba expref: 9 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321897:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ba expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.321905:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e590b95f500) 00010000:00010000:2.0:1788572392.321908:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572392.321910:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00030600, rc 0) 00000100:00100000:2.0:1788572392.321995:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:162673:x1875444569508352:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 880us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572392.322003:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1105 00000100:00100000:3.0:1788572392.336599:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.336812:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569508608 00000100:00100000:2.0:1788572392.336829:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569508608 00000100:00100000:2.0:1788572392.336918:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1106 00000100:00100000:2.0:1788572392.336930:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:162673:x1875444569508608:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572392.336969:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.337001:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109be41f lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3c1 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.337108:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 3/1,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.337156:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.337172:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.337186:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.337197:0:196070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4000/0x265cfe11109be219 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bdf48 expref: 7 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.337206:0:196070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 4/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.337254:0:196070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4000/0x265cfe11109be219 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bdf48 expref: 7 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572392.337274:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdcaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:196070:1875444584386048:0@lo:104: 00000100:00100000:2.0:1788572392.337341:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572392.337397:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318600 going to sleep for 11 seconds 00000100:00100000:3.0:1788572392.337880:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584386048 00000100:00100000:3.0:1788572392.337890:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584386048 00000100:00100000:3.0:1788572392.337963:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5398 00000100:00100000:3.0:1788572392.337973:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:196070:x1875444584386048:12345-0@lo:104: 00010000:00010000:3.0:1788572392.337994:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.338100:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572392.338107:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:196070:x1875444584386048:12345-0@lo:104: Request processed in 136us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572392.338115:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5398 00000100:00100000:2.0:1788572392.338345:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdcaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:196070:1875444584386048:0@lo:104: 00010000:00010000:2.0:1788572392.338374:0:196070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.338519:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572392.338530:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.338540:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670400 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:0.0:1788572392.338547:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 4/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572392.338563:0:10395:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 4/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.340722:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 2/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.340741:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572392.340780:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 1/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.340790:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a01670400/0x265cfe11109bdf48 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x265cfe11109be219 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.340847:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572392.340850:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572392.340854:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572392.340878:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584386176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572392.341000:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572392.341604:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584386176 00000100:00100000:3.0:1788572392.341617:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584386176 00010000:00010000:3.0:1788572392.341672:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4000/0x265cfe11109be219 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x265cfe11109bdf48 expref: 8 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572392.341727:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12904 00000100:00100000:3.0:1788572392.341739:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584386176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572392.341758:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1788572392.347001:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350980 is committed 00010000:00010000:3.0:1788572392.348035:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905bb4000/0x265cfe11109be219 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bdf48 expref: 7 pid: 196609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.348074:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0xf7117594 (ffff8e59019b4600) 00010000:00010000:3.0:1788572392.348080:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.348092:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.348101:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 4/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.348214:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572392.348351:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584386176:12345-0@lo:103:ldlm_bl.0 Request processed in 6613us (7349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572392.348364:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12904 00000100:00100000:1.0:1788572392.348784:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584386176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572392.353260:0:196070:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.353284:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572392.353544:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdcaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:196070:1875444584386304:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788572392.353650:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572392.353704:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572392.355850:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584386304 00000100:00100000:0.0:1788572392.355871:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584386304 00000100:00100000:0.0:1788572392.355975:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1788572392.355989:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:196070:x1875444584386304:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788572392.356171:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:196070:x1875444584386304:12345-0@lo:1000:mdt00_004.0 Request processed in 185us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572392.356181:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1788572392.356371:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdcaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:196070:1875444584386304:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788572392.356457:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109be434 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356512:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109be434 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356528:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109be434 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356545:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356553:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 2/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356566:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356572:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572392.356578:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356588:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356602:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e590b95f500) 00010000:00010000:3.0:1788572392.356605:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572392.356611:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356619:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109be426 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356658:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356665:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356672:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356677:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572392.356680:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356691:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356699:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0xf7117594 (ffff8e59019b4600) 00010000:00010000:3.0:1788572392.356701:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572392.356705:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 2/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356711:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109be42d lrc: 0/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356774:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109be41f lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3c1 expref: 10 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356791:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109be434 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3c1 expref: 9 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.356798:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b100) 00010000:00010000:3.0:1788572392.356800:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572392.356802:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616e000, rc 0) 00000100:00100000:3.0:1788572392.356874:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:162673:x1875444569508608:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 19946us (20291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572392.356884:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1106 00000100:00100000:1.0:1788572392.365439:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.365708:0:188059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569508736 00000100:00100000:0.0:1788572392.365722:0:188059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569508736 00000100:00100000:0.0:1788572392.365794:0:188059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5 00000100:00100000:0.0:1788572392.365809:0:188059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162673:x1875444569508736:12345-192.168.202.57@tcp:900:lfs.0 00000100:00100000:0.0:1788572392.365921:0:188059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162673:x1875444569508736:12345-192.168.202.57@tcp:900:lfs.0 Request processed in 114us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572392.365930:0:188059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5 00000100:00100000:1.0:1788572392.369532:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.369804:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569508992 00000100:00100000:3.0:1788572392.369816:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569508992 00000100:00100000:3.0:1788572392.369884:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1107 00000100:00100000:3.0:1788572392.369895:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:162673:x1875444569508992:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572392.369920:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572392.369946:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616fa00/0x265cfe11109be43b lrc: 2/0,0 mode: --/CR res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3c8 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572392.370058:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788572392.370305:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616fa00/0x265cfe11109be43b lrc: 1/0,0 mode: --/CR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3c8 expref: 7 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.370391:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b900) 00010000:00010000:3.0:1788572392.370394:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572392.370400:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616fa00/0x265cfe11109be43b lrc: 0/0,0 mode: --/CR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3c8 expref: 7 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.370425:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616fa00, rc 0) 00000100:00100000:3.0:1788572392.370531:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:162673:x1875444569508992:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 637us (1049us total) trans 21474837478 rc 301/301 00000100:00100000:3.0:1788572392.370538:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1107 00000100:00100000:3.0:1788572392.377247:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.377473:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569509248 00000100:00100000:2.0:1788572392.377518:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569509248 00000100:00100000:2.0:1788572392.377581:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6 00000100:00100000:2.0:1788572392.377593:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:162673:x1875444569509248:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:2.0:1788572392.377850:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:162673:x1875444569509248:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 258us (613us total) trans 21474837479 rc 0/0 00000100:00100000:2.0:1788572392.377858:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6 00000100:00100000:1.0:1788572392.447828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.447995:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569509504 00000100:00100000:0.0:1788572392.448006:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569509504 00000100:00100000:0.0:1788572392.448076:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1108 00000100:00100000:0.0:1788572392.448087:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:162678:x1875444569509504:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572392.448113:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572392.448150:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be449 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3cf expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572392.448269:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:188048:1875444584386432:0@lo:900:mdt00_000.0 00000100:00100000:0.0:1788572392.448319:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572392.448358:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a370df000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572392.448511:0:188059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584386432 00000100:00100000:1.0:1788572392.448515:0:188059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584386432 00000100:00100000:1.0:1788572392.448554:0:188059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572392.448562:0:188059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:188048:x1875444584386432:12345-0@lo:900:mdt00_000.0 00000100:00100000:1.0:1788572392.448627:0:188059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:188048:x1875444584386432:12345-0@lo:900:mdt00_000.0 Request processed in 66us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572392.448635:0:188059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572392.448730:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:188048:1875444584386432:0@lo:900:mdt00_000.0 00000100:00100000:3.0:1788572392.448808:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584386560:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572392.448841:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572392.448869:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590394c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572392.449022:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584386560 00000100:00100000:1.0:1788572392.449027:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584386560 00000100:00100000:1.0:1788572392.449064:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1788572392.449071:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584386560:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788572392.449154:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584386560:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572392.449161:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1788572392.449187:0:188048:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350980 gen 2 00000004:00080000:1.0:1788572392.449193:0:188048:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350980 committed transno 347892350980 00000100:00100000:1.0:1788572392.449209:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584386560:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788572392.449263:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.449273:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.449282:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572392.449294:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584386688:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1788572392.449321:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572392.449337:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d711840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572392.449505:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584386688 00000100:00100000:3.0:1788572392.449510:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584386688 00000100:00100000:3.0:1788572392.449544:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1788572392.449551:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188048:x1875444584386688:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788572392.449563:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572392.449577:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109be457 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109be450 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.449600:0:188053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109be457 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be450 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.449614:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109be457 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be450 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.449622:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572392.449625:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788572392.449629:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616fa00, rc 0) 00000100:00100000:3.0:1788572392.449670:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:188048:x1875444584386688:12345-0@lo:101:mdt00_000.0 Request processed in 120us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572392.449676:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1788572392.450244:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584386688:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788572392.450262:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be457 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.450273:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be457 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572392.450292:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788572392.450300:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be457 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.450312:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be457 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.450374:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.450384:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.450394:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.450408:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.450414:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.450420:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572392.450604:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584386816:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788572392.450645:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572392.450665:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a18819d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572392.450728:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584386816 00000100:00100000:3.0:1788572392.450733:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584386816 00000100:00100000:3.0:1788572392.450772:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1788572392.450780:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:188048:x1875444584386816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572392.450853:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:188048:x1875444584386816:12345-0@lo:1000:mdt00_000.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572392.450860:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1788572392.451030:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584386816:0@lo:1000:mdt00_000.0 00000004:00080000:0.0:1788572392.451319:0:188048:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x1f4:0x0], count =78 00000004:00080000:0.0:1788572392.451327:0:188048:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x1f4:0x0]+78 in llog 00000004:00080000:0.0:1788572392.451343:0:188048:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x242:0x0], index 0: 0 00010000:00010000:0.0:1788572392.451553:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be46c lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451565:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be46c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451573:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be46c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451605:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451612:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451618:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451626:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451632:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572392.451637:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451644:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451655:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a122fbc00) 00010000:00010000:0.0:1788572392.451658:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572392.451662:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 3/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451669:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be45e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572392.451685:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9396ef7 reply state 000000009fab76d3 transno 21474837480 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451695:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451702:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x679fc7b1 (ffff8e5a122fb600) 00010000:00010000:0.0:1788572392.451704:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572392.451706:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572392.451739:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be449 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3cf expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451773:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be46c lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3cf expref: 9 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.451788:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2:0x0].0x0 (ffff8e5a122fb800) 00010000:00010000:0.0:1788572392.451791:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572392.451794:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a01670400, rc 0) 00000100:00100000:0.0:1788572392.451840:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:162678:x1875444569509504:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 3755us (4021us total) trans 21474837480 rc 0/0 00000100:00100000:0.0:1788572392.451847:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1108 00000100:00100000:1.0:1788572392.458181:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.458293:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569509760 00000100:00100000:2.0:1788572392.458305:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569509760 00000100:00100000:2.0:1788572392.458367:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7 00000100:00100000:2.0:1788572392.458378:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:162678:x1875444569509760:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.458731:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:162678:x1875444569509760:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 355us (562us total) trans 21474837481 rc 0/0 00000100:00100000:2.0:1788572392.458742:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7 00000100:00100000:3.0:1788572392.464659:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.464980:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569510016 00000100:00100000:2.0:1788572392.464990:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569510016 00000100:00100000:2.0:1788572392.465057:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1109 00000100:00100000:2.0:1788572392.465069:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:162678:x1875444569510016:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572392.465097:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.465121:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be47a lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3d6 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.465254:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.465269:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.465281:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.465294:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x94c295fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.465301:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.465308:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.465679:0:196070:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x1f5:0x0], count =77 00000004:00080000:2.0:1788572392.465697:0:196070:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x1f5:0x0]+77 in llog 00000004:00080000:2.0:1788572392.465709:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x242:0x0], index 1: 0 00010000:00010000:2.0:1788572392.466114:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031800/0x265cfe11109be48f lrc: 3/1,0 mode: --/PR res: [0x240002729:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466136:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031800/0x265cfe11109be48f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466145:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031800/0x265cfe11109be48f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466178:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466187:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466193:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466199:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.466203:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466210:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466222:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e590b95fa00) 00010000:00010000:2.0:1788572392.466225:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.466230:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466237:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be481 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572392.466258:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015b0c655 reply state 00000000e8c99d6a transno 21474837482 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466268:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466274:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x94c295fa (ffff8e590b95f300) 00010000:00010000:2.0:1788572392.466276:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572392.466279:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572392.466309:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be47a lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3d6 expref: 14 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466330:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031800/0x265cfe11109be48f lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3d6 expref: 13 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.466338:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3:0x0].0x0 (ffff8e590b95ff00) 00010000:00010000:2.0:1788572392.466340:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572392.466343:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00031800, rc 0) 00000100:00100000:2.0:1788572392.466420:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:162678:x1875444569510016:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1352us (1772us total) trans 21474837482 rc 0/0 00000100:00100000:2.0:1788572392.466428:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1109 00000100:00100000:1.0:1788572392.481421:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.481979:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569510272 00000100:00100000:2.0:1788572392.481991:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569510272 00000100:00100000:2.0:1788572392.482052:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8 00000100:00100000:2.0:1788572392.482063:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:162678:x1875444569510272:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.483090:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:162678:x1875444569510272:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 1025us (1675us total) trans 21474837483 rc 0/0 00000100:00100000:2.0:1788572392.483104:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8 00000100:00100000:1.0:1788572392.490299:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.490389:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569510528 00000100:00100000:2.0:1788572392.490401:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569510528 00000100:00100000:2.0:1788572392.490572:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1110 00000100:00100000:2.0:1788572392.490583:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:162678:x1875444569510528:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572392.490610:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.490636:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be49d lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3dd expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.490770:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.493793:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.493820:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.493856:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.493865:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.493871:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.494253:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x243:0x0], index 0: 0 00010000:00010000:2.0:1788572392.494408:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be4b2 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494418:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be4b2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494425:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be4b2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494454:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494461:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494468:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494473:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.494502:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494525:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494536:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e590b95fa00) 00010000:00010000:2.0:1788572392.494539:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.494543:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494550:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4a4 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572392.494566:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021f89aec reply state 000000001a23fddc transno 21474837484 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494577:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494583:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xc1e56442 (ffff8e590b95f200) 00010000:00010000:2.0:1788572392.494586:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572392.494588:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572392.494622:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be49d lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3dd expref: 18 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494641:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be4b2 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3dd expref: 17 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.494648:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x4:0x0].0x0 (ffff8e590b95fd00) 00010000:00010000:2.0:1788572392.494651:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572392.494653:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00031200, rc 0) 00000100:00100000:2.0:1788572392.494715:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+18:162678:x1875444569510528:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 4134us (4427us total) trans 21474837484 rc 0/0 00000100:00100000:2.0:1788572392.494723:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1110 00000100:00100000:3.0:1788572392.502304:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572392.506184:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569510784 00000100:00100000:1.0:1788572392.506205:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569510784 00000100:00100000:1.0:1788572392.506291:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9 00000100:00100000:1.0:1788572392.506302:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+18:162678:x1875444569510784:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572392.506714:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+19:162678:x1875444569510784:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 412us (4419us total) trans 21474837485 rc 0/0 00000100:00100000:1.0:1788572392.506727:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9 00000100:00100000:1.0:1788572392.519281:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.519963:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569511040 00000100:00100000:2.0:1788572392.519981:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569511040 00000100:00100000:2.0:1788572392.520058:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1111 00000100:00100000:2.0:1788572392.520069:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+19:162678:x1875444569511040:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572392.520097:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.520193:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be4c0 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3e4 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.520317:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.520332:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.520344:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.520356:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xef08328a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.520362:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.520368:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.520718:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x243:0x0], index 1: 0 00010000:00010000:3.0:1788572392.524124:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616ee00/0x265cfe11109be4d5 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524168:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616ee00/0x265cfe11109be4d5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524181:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616ee00/0x265cfe11109be4d5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524224:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524232:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524240:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524246:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572392.524250:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524258:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524270:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e590b95fa00) 00010000:00010000:3.0:1788572392.524273:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572392.524278:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524285:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be4c7 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572392.524308:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0ed3f77 reply state 00000000b96b9f97 transno 21474837486 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524319:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524325:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xef08328a (ffff8e590b95f100) 00010000:00010000:3.0:1788572392.524328:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572392.524331:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572392.524373:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be4c0 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3e4 expref: 22 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524395:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616ee00/0x265cfe11109be4d5 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3e4 expref: 21 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.524402:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x5:0x0].0x0 (ffff8e5a0a54b900) 00010000:00010000:3.0:1788572392.524404:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572392.524407:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616ee00, rc 0) 00000100:00100000:3.0:1788572392.524739:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+22:162678:x1875444569511040:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 4670us (5465us total) trans 21474837486 rc 0/0 00000100:00100000:3.0:1788572392.524748:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1111 00000100:00100000:3.0:1788572392.547283:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572392.547466:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569511296 00000100:00100000:1.0:1788572392.547529:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569511296 00000100:00100000:1.0:1788572392.547588:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10 00000100:00100000:1.0:1788572392.547599:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+22:162678:x1875444569511296:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572392.547929:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+23:162678:x1875444569511296:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 331us (659us total) trans 21474837487 rc 0/0 00000100:00100000:1.0:1788572392.547939:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10 00000100:00100000:0.0:1788572392.556974:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.557104:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569511552 00000100:00100000:3.0:1788572392.557114:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569511552 00000100:00100000:0.0:1788572392.557261:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1112 00000100:00100000:0.0:1788572392.557272:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+23:162678:x1875444569511552:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572392.557296:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572392.557328:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be4e3 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.557430:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.557445:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.557456:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.557467:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.557474:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.557528:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572392.558057:0:188048:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x244:0x0], index 0: 0 00010000:00010000:0.0:1788572392.558229:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109be4f8 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558241:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109be4f8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558248:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109be4f8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558280:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558290:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558296:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558302:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558308:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572392.558323:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558330:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558341:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a122fbc00) 00010000:00010000:0.0:1788572392.558344:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572392.558349:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 3/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558356:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be4ea lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572392.558373:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001de39811 reply state 00000000b9b45fa7 transno 21474837488 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558384:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558389:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x1c2b00d3 (ffff8e5a122fbe00) 00010000:00010000:0.0:1788572392.558392:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572392.558395:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572392.558426:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be4e3 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3eb expref: 26 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558445:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109be4f8 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3eb expref: 25 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.558453:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x6:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:0.0:1788572392.558455:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572392.558458:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4a00, rc 0) 00000100:00100000:0.0:1788572392.558594:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+26:162678:x1875444569511552:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1323us (1628us total) trans 21474837488 rc 0/0 00000100:00100000:0.0:1788572392.558603:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1112 00000100:00100000:2.0:1788572392.565266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572392.565640:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569511808 00000100:00100000:1.0:1788572392.565651:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569511808 00000100:00100000:1.0:1788572392.565717:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 11 00000100:00100000:1.0:1788572392.565728:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+26:162678:x1875444569511808:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572392.566472:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+27:162678:x1875444569511808:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 743us (1212us total) trans 21474837489 rc 0/0 00000100:00100000:1.0:1788572392.566539:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 11 00000100:00100000:1.0:1788572392.588347:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.588545:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569512064 00000100:00100000:2.0:1788572392.588556:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569512064 00000100:00100000:2.0:1788572392.588625:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1113 00000100:00100000:2.0:1788572392.588636:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+27:162678:x1875444569512064:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572392.588666:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.588704:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be506 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3f2 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.588845:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.588860:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.588873:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.588887:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.588895:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.588901:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.589270:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x244:0x0], index 1: 0 00010000:00010000:2.0:1788572392.589429:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254200/0x265cfe11109be51b lrc: 3/1,0 mode: --/PR res: [0x240002729:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589440:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254200/0x265cfe11109be51b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589448:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254200/0x265cfe11109be51b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589509:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589517:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589524:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589530:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.589535:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589542:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589553:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e590b95fc00) 00010000:00010000:2.0:1788572392.589556:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.589561:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589568:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be50d lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572392.589584:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1e41872 reply state 00000000c5c083be transno 21474837490 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589594:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589600:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x494dcf1b (ffff8e590b95f600) 00010000:00010000:2.0:1788572392.589603:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572392.589605:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572392.589633:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be506 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3f2 expref: 30 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589652:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254200/0x265cfe11109be51b lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3f2 expref: 29 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.589659:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x7:0x0].0x0 (ffff8e590b95f700) 00010000:00010000:2.0:1788572392.589662:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572392.589665:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254200, rc 0) 00000100:00100000:2.0:1788572392.589728:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+30:162678:x1875444569512064:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1094us (1395us total) trans 21474837490 rc 0/0 00000100:00100000:2.0:1788572392.589737:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1113 00000100:00100000:0.0:1788572392.596663:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.596823:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569512320 00000100:00100000:2.0:1788572392.596833:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569512320 00000100:00100000:2.0:1788572392.596890:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12 00000100:00100000:2.0:1788572392.596902:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+30:162678:x1875444569512320:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.597236:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+31:162678:x1875444569512320:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 336us (581us total) trans 21474837491 rc 0/0 00000100:00100000:2.0:1788572392.597244:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12 00000100:00100000:1.0:1788572392.604603:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.604886:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569512576 00000100:00100000:3.0:1788572392.604897:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569512576 00000100:00100000:3.0:1788572392.604967:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1114 00000100:00100000:3.0:1788572392.604977:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+31:162678:x1875444569512576:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572392.605006:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572392.605032:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f400/0x265cfe11109be529 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb3f9 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.605165:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.605190:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.605202:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.605216:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x76709d63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.605223:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.605229:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.606331:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x245:0x0], index 0: 0 00010000:00010000:2.0:1788572392.606522:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254e00/0x265cfe11109be53e lrc: 3/1,0 mode: --/PR res: [0x240002729:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606537:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254e00/0x265cfe11109be53e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606546:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254e00/0x265cfe11109be53e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606582:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606589:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606596:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606605:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.606609:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606616:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606629:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b800) 00010000:00010000:2.0:1788572392.606632:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.606637:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606644:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be530 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572392.606660:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004291e5b0 reply state 000000005af5743d transno 21474837492 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606669:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606676:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x76709d63 (ffff8e5a0a54be00) 00010000:00010000:2.0:1788572392.606678:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572392.606681:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572392.606727:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f400/0x265cfe11109be529 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3f9 expref: 34 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606754:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254e00/0x265cfe11109be53e lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3f9 expref: 33 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.606769:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x8:0x0].0x0 (ffff8e590b95fc00) 00010000:00010000:2.0:1788572392.606772:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572392.606775:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254e00, rc 0) 00000100:00100000:2.0:1788572392.606870:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+34:162678:x1875444569512576:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1894us (2278us total) trans 21474837492 rc 0/0 00000100:00100000:2.0:1788572392.606880:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1114 00000100:00100000:3.0:1788572392.612627:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.612750:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569512832 00000100:00100000:2.0:1788572392.612761:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569512832 00000100:00100000:2.0:1788572392.612834:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13 00000100:00100000:2.0:1788572392.612846:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+34:162678:x1875444569512832:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.613206:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+35:162678:x1875444569512832:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 362us (587us total) trans 21474837493 rc 0/0 00000100:00100000:2.0:1788572392.613213:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13 00000100:00100000:0.0:1788572392.627888:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.628267:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569513088 00000100:00100000:3.0:1788572392.628279:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569513088 00000100:00100000:3.0:1788572392.628347:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1115 00000100:00100000:3.0:1788572392.628357:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+35:162678:x1875444569513088:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572392.628381:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572392.628403:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be54c lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb400 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.628545:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.628565:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.628577:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.628589:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xa3936bac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.628596:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.628603:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572392.629281:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x245:0x0], index 1: 0 00010000:00010000:3.0:1788572392.629447:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f400/0x265cfe11109be561 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629459:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f400/0x265cfe11109be561 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629468:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f400/0x265cfe11109be561 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629884:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629894:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629900:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629907:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572392.629912:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629920:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629933:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b700) 00010000:00010000:3.0:1788572392.629936:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572392.629940:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629945:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be553 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572392.629961:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b9bec80 reply state 00000000a60994e5 transno 21474837494 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629972:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.629978:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xa3936bac (ffff8e5a0a54b000) 00010000:00010000:3.0:1788572392.629980:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572392.629983:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572392.630019:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be54c lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb400 expref: 38 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.630044:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f400/0x265cfe11109be561 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb400 expref: 37 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.630057:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x9:0x0].0x0 (ffff8e5a0a54b400) 00010000:00010000:3.0:1788572392.630059:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572392.630062:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616f400, rc 0) 00000100:00100000:3.0:1788572392.631370:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+38:162678:x1875444569513088:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 3007us (3484us total) trans 21474837494 rc 0/0 00000100:00100000:3.0:1788572392.631381:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1115 00000100:00100000:1.0:1788572392.650413:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.650520:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569513344 00000100:00100000:2.0:1788572392.650532:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569513344 00000100:00100000:2.0:1788572392.650587:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14 00000100:00100000:2.0:1788572392.650598:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+38:162678:x1875444569513344:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.650912:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+39:162678:x1875444569513344:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 315us (508us total) trans 21474837495 rc 0/0 00000100:00100000:2.0:1788572392.650921:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14 00000100:00100000:1.0:1788572392.666617:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.666956:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569513600 00000100:00100000:3.0:1788572392.666967:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569513600 00000100:00100000:3.0:1788572392.667024:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1116 00000100:00100000:3.0:1788572392.667034:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+39:162678:x1875444569513600:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572392.667063:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572392.667090:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be56f lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb407 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.667230:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.667247:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.667260:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.667273:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.667280:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.667287:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572392.668037:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x246:0x0], index 0: 0 00010000:00010000:0.0:1788572392.670435:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109be584 lrc: 3/1,0 mode: --/PR res: [0x240002729:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.670459:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109be584 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.670473:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109be584 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.671104:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.671113:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.671125:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.671141:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572392.671146:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.671153:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.671166:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b700) 00010000:00010000:0.0:1788572392.671170:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572392.671275:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.671283:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be576 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572392.671307:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000513e5a17 reply state 0000000007a42e31 transno 21474837496 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.672814:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.672830:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xd0b639f4 (ffff8e5a0a54bd00) 00010000:00010000:0.0:1788572392.672833:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572392.672837:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572392.672895:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be56f lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb407 expref: 42 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.672937:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109be584 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb407 expref: 41 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.672946:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xa:0x0].0x0 (ffff8e5a122fbc00) 00010000:00010000:0.0:1788572392.672948:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572392.672951:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4c00, rc 0) 00000100:00100000:0.0:1788572392.673042:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+42:162678:x1875444569513600:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 6008us (6438us total) trans 21474837496 rc 0/0 00000100:00100000:0.0:1788572392.673052:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1116 00000100:00100000:0.0:1788572392.683594:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.683707:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569513856 00000100:00100000:2.0:1788572392.683717:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569513856 00000100:00100000:2.0:1788572392.683800:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15 00000100:00100000:2.0:1788572392.683812:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+42:162678:x1875444569513856:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.684170:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+43:162678:x1875444569513856:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 359us (586us total) trans 21474837497 rc 0/0 00000100:00100000:2.0:1788572392.684187:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15 00000100:00100000:3.0:1788572392.693306:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.694928:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569514112 00000100:00100000:2.0:1788572392.694942:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569514112 00000100:00100000:2.0:1788572392.695017:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1117 00000100:00100000:2.0:1788572392.695028:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+43:162678:x1875444569514112:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572392.695054:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.695076:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be592 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb40e expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.695195:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.695210:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.695223:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.695236:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.695243:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.695250:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.696164:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x246:0x0], index 1: 0 00010000:00010000:2.0:1788572392.698448:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be5a7 lrc: 3/1,0 mode: --/PR res: [0x240002729:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.698474:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be5a7 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.698509:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be5a7 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699397:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699406:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699412:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699418:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.699422:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699430:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699446:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e590b95f900) 00010000:00010000:2.0:1788572392.699449:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.699454:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699462:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be599 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572392.699774:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cfd0ca0 reply state 0000000061f5bcd5 transno 21474837498 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699867:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699878:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xfdd9083c (ffff8e590b95f800) 00010000:00010000:2.0:1788572392.699881:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572392.699885:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572392.699935:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be592 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb40e expref: 46 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699960:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be5a7 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb40e expref: 45 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.699967:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xb:0x0].0x0 (ffff8e590b95fa00) 00010000:00010000:2.0:1788572392.699970:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572392.699973:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254000, rc 0) 00000100:00100000:2.0:1788572392.700111:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+46:162678:x1875444569514112:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 5083us (6814us total) trans 21474837498 rc 0/0 00000100:00100000:2.0:1788572392.700121:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1117 00000100:00100000:0.0:1788572392.720052:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.720179:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569514368 00000100:00100000:2.0:1788572392.720190:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569514368 00000100:00100000:2.0:1788572392.720261:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 16 00000100:00100000:2.0:1788572392.720273:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+46:162678:x1875444569514368:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.720641:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+47:162678:x1875444569514368:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 369us (597us total) trans 21474837499 rc 0/0 00000100:00100000:2.0:1788572392.720653:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 16 00000100:00100000:0.0:1788572392.737777:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.737998:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569514624 00000100:00100000:3.0:1788572392.738008:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569514624 00000100:00100000:3.0:1788572392.738072:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1118 00000100:00100000:3.0:1788572392.738083:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+47:162678:x1875444569514624:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572392.738108:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572392.738141:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616fe00/0x265cfe11109be5b5 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb415 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.738264:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.738281:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.738294:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.738307:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.738313:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.738319:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572392.739187:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x247:0x0], index 0: 0 00010000:00010000:3.0:1788572392.739357:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be5ca lrc: 3/1,0 mode: --/PR res: [0x240002729:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.739370:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be5ca lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.739380:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be5ca lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.739413:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.739420:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.739427:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.739432:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572392.739436:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.739443:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.739455:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b700) 00010000:00010000:3.0:1788572392.739458:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572392.739463:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.739474:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be5bc lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572392.741588:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000323b6df1 reply state 000000008c37b7fa transno 21474837500 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.741607:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.741614:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x1b7026cc (ffff8e5a0a54b800) 00010000:00010000:3.0:1788572392.741617:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572392.741621:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572392.741677:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616fe00/0x265cfe11109be5b5 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb415 expref: 50 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.741713:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be5ca lrc: 3/0,0 mode: PR/PR res: [0x240002729:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb415 expref: 49 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.741722:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xc:0x0].0x0 (ffff8e5a0a54bf00) 00010000:00010000:3.0:1788572392.741724:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572392.741727:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1616f800, rc 0) 00000100:00100000:3.0:1788572392.741798:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+50:162678:x1875444569514624:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 3715us (4031us total) trans 21474837500 rc 0/0 00000100:00100000:3.0:1788572392.741807:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1118 00000100:00100000:3.0:1788572392.751330:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.751417:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569514880 00000100:00100000:2.0:1788572392.751428:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569514880 00000100:00100000:2.0:1788572392.751521:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 17 00000100:00100000:2.0:1788572392.751535:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+50:162678:x1875444569514880:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.751850:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+51:162678:x1875444569514880:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 319us (541us total) trans 21474837501 rc 0/0 00000100:00100000:2.0:1788572392.751858:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 17 00000100:00100000:0.0:1788572392.757659:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.757954:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569515136 00000100:00100000:2.0:1788572392.757965:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569515136 00000100:00100000:2.0:1788572392.758026:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1119 00000100:00100000:2.0:1788572392.758036:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+51:162678:x1875444569515136:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572392.758062:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.758084:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be5d8 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb41c expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.758225:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.758240:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.758253:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.758266:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.758278:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.758285:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.758653:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x247:0x0], index 1: 0 00010000:00010000:2.0:1788572392.759270:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be5ed lrc: 3/1,0 mode: --/PR res: [0x240002729:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759282:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be5ed lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759290:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be5ed lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759326:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759333:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759340:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759345:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.759349:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759356:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759371:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e590b95f900) 00010000:00010000:2.0:1788572392.759374:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.759379:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759386:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be5df lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572392.759402:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000648e57ff reply state 0000000043301d56 transno 21474837502 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759413:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759420:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x3e3e6f26 (ffff8e590b95f400) 00010000:00010000:2.0:1788572392.759422:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572392.759425:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572392.759456:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be5d8 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb41c expref: 54 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759548:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be5ed lrc: 3/0,0 mode: PR/PR res: [0x240002729:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb41c expref: 53 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.759558:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xd:0x0].0x0 (ffff8e5a02ffbb00) 00010000:00010000:2.0:1788572392.759561:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572392.759563:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255a00, rc 0) 00000100:00100000:2.0:1788572392.759630:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+54:162678:x1875444569515136:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1595us (1981us total) trans 21474837502 rc 0/0 00000100:00100000:2.0:1788572392.759639:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1119 00000100:00100000:0.0:1788572392.766885:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.767030:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569515392 00000100:00100000:2.0:1788572392.767040:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569515392 00000100:00100000:2.0:1788572392.767095:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 18 00000100:00100000:2.0:1788572392.767106:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+54:162678:x1875444569515392:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.767423:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+55:162678:x1875444569515392:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 317us (547us total) trans 21474837503 rc 0/0 00000100:00100000:2.0:1788572392.767431:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 18 00000100:00100000:0.0:1788572392.771716:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.772083:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569515648 00000100:00100000:2.0:1788572392.772093:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569515648 00000100:00100000:2.0:1788572392.772158:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1120 00000100:00100000:2.0:1788572392.772170:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+55:162678:x1875444569515648:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572392.772198:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.772223:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be5fb lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb423 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.772446:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.772462:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.772475:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.772858:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x610cb780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.772868:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.772877:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572392.773228:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x248:0x0], index 0: 0 00010000:00010000:0.0:1788572392.773981:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109be610 lrc: 3/1,0 mode: --/PR res: [0x240002729:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774000:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109be610 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774009:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109be610 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774045:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774053:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774060:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774066:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572392.774070:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774077:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774089:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a02ffbd00) 00010000:00010000:0.0:1788572392.774092:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572392.774097:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774103:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be602 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572392.774118:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000011619e9 reply state 00000000442ff888 transno 21474837504 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774128:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774145:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x610cb780 (ffff8e5a122fb700) 00010000:00010000:0.0:1788572392.774148:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572392.774151:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572392.774189:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be5fb lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb423 expref: 58 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774210:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109be610 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb423 expref: 57 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.774217:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xe:0x0].0x0 (ffff8e5a122fb400) 00010000:00010000:0.0:1788572392.774219:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572392.774222:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905bb4400, rc 0) 00000100:00100000:0.0:1788572392.774299:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+58:162678:x1875444569515648:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 2130us (2602us total) trans 21474837504 rc 0/0 00000100:00100000:0.0:1788572392.774307:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1120 00000100:00100000:0.0:1788572392.779191:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.779269:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569515904 00000100:00100000:2.0:1788572392.779282:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569515904 00000100:00100000:2.0:1788572392.779355:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 19 00000100:00100000:2.0:1788572392.779366:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+58:162678:x1875444569515904:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.779994:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+59:162678:x1875444569515904:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 627us (814us total) trans 21474837505 rc 0/0 00000100:00100000:2.0:1788572392.780003:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 19 00000100:00100000:3.0:1788572392.788528:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.788687:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569516160 00000100:00100000:2.0:1788572392.788709:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569516160 00000100:00100000:2.0:1788572392.788769:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1121 00000100:00100000:2.0:1788572392.788780:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+59:162678:x1875444569516160:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572392.788816:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.788840:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be61e lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb42a expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.788950:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.788965:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.788978:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.788992:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.788998:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789005:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.789328:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x248:0x0], index 1: 0 00010000:00010000:2.0:1788572392.789469:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be633 lrc: 3/1,0 mode: --/PR res: [0x240002729:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789541:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be633 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789551:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be633 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789588:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789595:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789602:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789608:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.789613:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789620:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789633:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a02ffbe00) 00010000:00010000:2.0:1788572392.789636:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.789641:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789647:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be625 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572392.789668:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f556f94 reply state 00000000f13e8e84 transno 21474837506 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789679:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789685:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x83daffd9 (ffff8e5a02ffb300) 00010000:00010000:2.0:1788572392.789688:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572392.789690:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572392.789722:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be61e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb42a expref: 62 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789743:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be633 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb42a expref: 61 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.789751:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xf:0x0].0x0 (ffff8e5a02ffb900) 00010000:00010000:2.0:1788572392.789753:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572392.789755:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254c00, rc 0) 00000100:00100000:2.0:1788572392.789816:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+62:162678:x1875444569516160:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1038us (1335us total) trans 21474837506 rc 0/0 00000100:00100000:2.0:1788572392.789824:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1121 00000100:00100000:0.0:1788572392.795594:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.795823:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569516416 00000100:00100000:3.0:1788572392.795833:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569516416 00000100:00100000:3.0:1788572392.795889:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 20 00000100:00100000:3.0:1788572392.795899:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+62:162678:x1875444569516416:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572392.796214:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+63:162678:x1875444569516416:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 315us (632us total) trans 21474837507 rc 0/0 00000100:00100000:3.0:1788572392.796223:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 20 00000100:00100000:1.0:1788572392.803933:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.815552:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569516672 00000100:00100000:2.0:1788572392.815570:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569516672 00000100:00100000:3.0:1788572392.815896:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1122 00000100:00100000:3.0:1788572392.815907:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+63:162678:x1875444569516672:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572392.815932:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572392.815957:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616fe00/0x265cfe11109be641 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb431 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.816090:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.816105:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.816117:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.816142:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.816150:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.816158:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572392.816540:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x249:0x0], index 0: 0 00010000:00010000:3.0:1788572392.816676:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109be656 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.820929:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109be656 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.820956:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109be656 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821038:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821046:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821054:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821060:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572392.821064:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821072:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821084:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b700) 00010000:00010000:3.0:1788572392.821087:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572392.821091:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821102:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f000/0x265cfe11109be648 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572392.821121:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b70b3526 reply state 0000000078b44b23 transno 21474837508 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821141:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821148:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xa6a94833 (ffff8e590430c900) 00010000:00010000:3.0:1788572392.821150:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572392.821153:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572392.821201:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616fe00/0x265cfe11109be641 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb431 expref: 66 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821223:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109be656 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb431 expref: 65 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.821231:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x10:0x0].0x0 (ffff8e590430ce00) 00010000:00010000:3.0:1788572392.821233:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572392.821235:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce000, rc 0) 00000100:00100000:3.0:1788572392.821299:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+66:162678:x1875444569516672:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 5394us (17381us total) trans 21474837508 rc 0/0 00000100:00100000:3.0:1788572392.821308:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1122 00000100:00100000:0.0:1788572392.831863:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572392.831945:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569516928 00000100:00100000:1.0:1788572392.831955:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569516928 00000100:00100000:1.0:1788572392.832015:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 21 00000100:00100000:1.0:1788572392.832026:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+66:162678:x1875444569516928:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572392.832441:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+67:162678:x1875444569516928:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 415us (653us total) trans 21474837509 rc 0/0 00000100:00100000:1.0:1788572392.832450:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 21 00000100:00100000:1.0:1788572392.837166:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.837307:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569517184 00000100:00100000:0.0:1788572392.837318:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569517184 00000100:00100000:0.0:1788572392.837382:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1123 00000100:00100000:0.0:1788572392.837392:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+67:162678:x1875444569517184:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572392.837418:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572392.837442:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109be664 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb438 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.837584:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.837599:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.837612:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.837624:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xc977908d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.837630:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.837637:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572392.838232:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x249:0x0], index 1: 0 00010000:00010000:1.0:1788572392.838744:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be679 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838757:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be679 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838766:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be679 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838813:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838821:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838828:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838835:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572392.838839:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838847:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838860:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a122fb100) 00010000:00010000:1.0:1788572392.838863:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572392.838868:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838875:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109be66b lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572392.838888:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ced1c92 reply state 000000005e48e5d5 transno 21474837510 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838899:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838905:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xc977908d (ffff8e5a122fb500) 00010000:00010000:1.0:1788572392.838907:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572392.838910:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572392.838943:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109be664 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb438 expref: 70 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838962:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be679 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb438 expref: 69 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572392.838971:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x11:0x0].0x0 (ffff8e5a36d24000) 00010000:00010000:1.0:1788572392.838973:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572392.838975:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164f600, rc 0) 00000100:00100000:1.0:1788572392.839051:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+70:162678:x1875444569517184:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1658us (1893us total) trans 21474837510 rc 0/0 00000100:00100000:1.0:1788572392.839059:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1123 00000100:00100000:1.0:1788572392.843072:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.843212:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569517440 00000100:00100000:3.0:1788572392.843226:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569517440 00000100:00100000:3.0:1788572392.843287:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22 00000100:00100000:3.0:1788572392.843298:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+70:162678:x1875444569517440:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572392.845087:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+71:162678:x1875444569517440:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 1782us (2018us total) trans 21474837511 rc 0/0 00000100:00100000:3.0:1788572392.845099:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22 00000100:00100000:0.0:1788572392.850202:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.850531:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569517696 00000100:00100000:2.0:1788572392.850541:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569517696 00000100:00100000:2.0:1788572392.850591:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1124 00000100:00100000:2.0:1788572392.850602:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+71:162678:x1875444569517696:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572392.850628:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.850650:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be687 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb43f expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.850777:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.850947:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.850965:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.850984:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.850992:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.850998:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.851674:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24a:0x0], index 0: 0 00010000:00010000:2.0:1788572392.852025:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be69c lrc: 3/1,0 mode: --/PR res: [0x240002729:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852037:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be69c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852046:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be69c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852083:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852090:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852096:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852101:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.852105:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852111:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852122:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a02ffbe00) 00010000:00010000:2.0:1788572392.852125:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.852129:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852145:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be68e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572392.852158:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebd36e9e reply state 000000003bd0e47e transno 21474837512 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852168:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852174:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xec45d8e7 (ffff8e5a02ffba00) 00010000:00010000:2.0:1788572392.852176:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572392.852179:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572392.852212:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be687 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb43f expref: 74 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852231:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be69c lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb43f expref: 73 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.852239:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x12:0x0].0x0 (ffff8e5a02ffbc00) 00010000:00010000:2.0:1788572392.852241:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572392.852243:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255600, rc 0) 00000100:00100000:2.0:1788572392.852434:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+74:162678:x1875444569517696:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1832us (2243us total) trans 21474837512 rc 0/0 00000100:00100000:2.0:1788572392.852443:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1124 00000100:00100000:1.0:1788572392.861074:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.861158:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569517952 00000100:00100000:0.0:1788572392.861168:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569517952 00000100:00100000:0.0:1788572392.861225:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 23 00000100:00100000:0.0:1788572392.861237:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+74:162678:x1875444569517952:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572392.862938:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+75:162678:x1875444569517952:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 1694us (1865us total) trans 21474837513 rc 0/0 00000100:00100000:0.0:1788572392.862951:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 23 00000100:00100000:1.0:1788572392.884060:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.884159:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569518208 00000100:00100000:3.0:1788572392.884171:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569518208 00000100:00100000:3.0:1788572392.884237:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1125 00000100:00100000:3.0:1788572392.884247:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+75:162678:x1875444569518208:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572392.884275:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572392.884300:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109be6aa lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb446 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.884408:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.884423:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.884435:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.884448:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xf142140 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.884455:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.884462:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572392.884835:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x24a:0x0], index 1: 0 00010000:00010000:3.0:1788572392.884983:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109be6bf lrc: 3/1,0 mode: --/PR res: [0x240002729:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.884994:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109be6bf lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885001:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109be6bf lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885034:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885042:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885048:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885054:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572392.885058:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885066:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885076:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e590430cc00) 00010000:00010000:3.0:1788572392.885080:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572392.885084:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885090:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be6b1 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572392.885110:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7deca51 reply state 0000000089cb0130 transno 21474837514 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885120:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885127:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xf142140 (ffff8e590430c200) 00010000:00010000:3.0:1788572392.885129:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572392.885144:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572392.885174:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109be6aa lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb446 expref: 78 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885196:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109be6bf lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb446 expref: 77 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572392.885205:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x13:0x0].0x0 (ffff8e590430cd00) 00010000:00010000:3.0:1788572392.885207:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572392.885210:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcfe00, rc 0) 00000100:00100000:3.0:1788572392.885278:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+78:162678:x1875444569518208:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1032us (1227us total) trans 21474837514 rc 0/0 00000100:00100000:3.0:1788572392.885286:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1125 00000100:00100000:1.0:1788572392.892256:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572392.892411:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569518464 00000100:00100000:3.0:1788572392.892422:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569518464 00000100:00100000:3.0:1788572392.892538:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 24 00000100:00100000:3.0:1788572392.892549:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+78:162678:x1875444569518464:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572392.893780:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+79:162678:x1875444569518464:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 1225us (1527us total) trans 21474837515 rc 0/0 00000100:00100000:2.0:1788572392.893801:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 24 00000100:00100000:1.0:1788572392.897599:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.897733:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569518720 00000100:00100000:0.0:1788572392.897744:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569518720 00000100:00100000:0.0:1788572392.897818:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1126 00000100:00100000:0.0:1788572392.897828:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+79:162678:x1875444569518720:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572392.897856:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572392.897883:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be6cd lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb44d expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.897990:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898004:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898017:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898029:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x31e2699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898037:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898043:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572392.898375:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24b:0x0], index 0: 0 00010000:00010000:0.0:1788572392.898702:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be6e2 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898717:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be6e2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898728:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be6e2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898764:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898771:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898777:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898782:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572392.898786:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898906:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898919:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a122fb100) 00010000:00010000:0.0:1788572392.898923:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572392.898928:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898935:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6d4 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572392.898950:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d627caf reply state 000000000a7cac7a transno 21474837516 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898960:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.898967:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x31e2699a (ffff8e5a122fb000) 00010000:00010000:0.0:1788572392.898969:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572392.898971:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572392.899006:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be6cd lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb44d expref: 82 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.899027:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be6e2 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb44d expref: 81 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.899034:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x14:0x0].0x0 (ffff8e5a122fb900) 00010000:00010000:0.0:1788572392.899037:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572392.899039:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcea00, rc 0) 00000100:00100000:0.0:1788572392.899110:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+82:162678:x1875444569518720:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1284us (1521us total) trans 21474837516 rc 0/0 00000100:00100000:0.0:1788572392.899117:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1126 00000100:00100000:1.0:1788572392.903895:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.907005:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569518976 00000100:00100000:0.0:1788572392.907022:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569518976 00000100:00100000:0.0:1788572392.907097:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 25 00000100:00100000:0.0:1788572392.907109:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+82:162678:x1875444569518976:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572392.907434:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+83:162678:x1875444569518976:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 326us (3552us total) trans 21474837517 rc 0/0 00000100:00100000:0.0:1788572392.907442:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 25 00000100:00100000:2.0:1788572392.917063:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.917179:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569519232 00000100:00100000:0.0:1788572392.917190:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569519232 00000100:00100000:0.0:1788572392.917255:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1127 00000100:00100000:0.0:1788572392.917266:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+83:162678:x1875444569519232:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572392.917293:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572392.917321:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be6f0 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb454 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.917434:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.917451:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.917462:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.917522:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.917531:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.917538:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572392.918108:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x24b:0x0], index 1: 0 00010000:00010000:2.0:1788572392.918270:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be705 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918280:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be705 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918288:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be705 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918323:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918331:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918338:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918344:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572392.918348:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918355:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918367:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a122fb100) 00010000:00010000:2.0:1788572392.918370:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572392.918375:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918381:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be6f7 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572392.918395:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a71bae24 reply state 000000005f67fc2b transno 21474837518 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918404:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918410:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x54b0b1f4 (ffff8e59019b4600) 00010000:00010000:2.0:1788572392.918412:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572392.918415:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572392.918443:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be6f0 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb454 expref: 86 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918462:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be705 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb454 expref: 85 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.918470:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x15:0x0].0x0 (ffff8e5a02ffbe00) 00010000:00010000:2.0:1788572392.918472:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572392.918474:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255400, rc 0) 00000100:00100000:2.0:1788572392.918599:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+86:162678:x1875444569519232:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1335us (1546us total) trans 21474837518 rc 0/0 00000100:00100000:2.0:1788572392.918607:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1127 00000100:00100000:1.0:1788572392.926006:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.926678:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569519488 00000100:00100000:0.0:1788572392.926689:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569519488 00000100:00100000:0.0:1788572392.926753:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 26 00000100:00100000:0.0:1788572392.926765:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+86:162678:x1875444569519488:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572392.927071:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+87:162678:x1875444569519488:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 307us (1076us total) trans 21474837519 rc 0/0 00000100:00100000:0.0:1788572392.927080:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 26 00000100:00100000:1.0:1788572392.951297:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.951427:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569519744 00000100:00100000:2.0:1788572392.951438:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569519744 00000100:00100000:2.0:1788572392.951551:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1128 00000100:00100000:2.0:1788572392.951563:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+87:162684:x1875444569519744:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572392.951591:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572392.951616:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be713 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb45b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572392.951721:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788572392.951820:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be713 lrc: 1/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb45b expref: 89 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.951837:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a02ffbf00) 00010000:00010000:2.0:1788572392.951840:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572392.951845:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be713 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb45b expref: 89 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.951869:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254600, rc 0) 00000100:00100000:2.0:1788572392.951931:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+88:162684:x1875444569519744:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 370us (647us total) trans 21474837520 rc 301/301 00000100:00100000:2.0:1788572392.951938:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1128 00000100:00100000:1.0:1788572392.961760:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.961855:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569520000 00000100:00100000:0.0:1788572392.961866:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569520000 00000100:00100000:0.0:1788572392.961973:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1129 00000100:00100000:0.0:1788572392.961985:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+88:162684:x1875444569520000:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572392.962011:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572392.962035:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be721 lrc: 2/0,0 mode: --/CR res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb462 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.962187:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be728 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.962203:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be728 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.962215:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be728 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572392.962226:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x3:0x0]: returning size 0 00010000:00010000:0.0:1788572392.962335:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be721 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb462 expref: 91 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.962360:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be728 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb462 expref: 90 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572392.962369:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3:0x0].0x0 (ffff8e590b95ff00) 00010000:00010000:0.0:1788572392.962372:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572392.962376:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffce200, rc 0) 00000100:00100000:0.0:1788572392.962442:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+90:162684:x1875444569520000:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 459us (691us total) trans 21474837521 rc 0/0 00000100:00100000:0.0:1788572392.962452:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1129 00000100:00100000:1.0:1788572392.968818:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.969413:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569520256 00000100:00100000:0.0:1788572392.969426:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569520256 00000100:00100000:0.0:1788572392.969513:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 27 00000100:00100000:0.0:1788572392.969525:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+90:162684:x1875444569520256:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:0.0:1788572392.969786:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+91:162684:x1875444569520256:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 262us (978us total) trans 21474837522 rc 0/0 00000100:00100000:0.0:1788572392.969794:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 27 00000100:00100000:1.0:1788572392.973883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572392.974122:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569520384 00000100:00100000:2.0:1788572392.974142:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569520384 00000100:00100000:2.0:1788572392.974881:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4661 00000100:00100000:2.0:1788572392.974895:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+91:2397:x1875444569520384:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572392.974916:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572392.974942:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be728 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb462 expref: 91 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572392.974964:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3:0x0].0x0 (ffff8e590b95ff00) 00010000:00010000:2.0:1788572392.974969:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572392.975121:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+90:2397:x1875444569520384:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 229us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572392.975129:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4661 00000100:00100000:1.0:1788572392.976206:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572392.976334:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569520640 00000100:00100000:0.0:1788572392.976342:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569520640 00000100:00100000:0.0:1788572392.976392:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 28 00000100:00100000:0.0:1788572392.976401:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+90:162684:x1875444569520640:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:1.0:1788572392.976830:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+91:162684:x1875444569520640:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 428us (628us total) trans 21474837523 rc 0/0 00000100:00100000:1.0:1788572392.976837:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 28 00000100:00100000:1.0:1788572393.019859:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572393.019948:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569520896 00000100:00100000:3.0:1788572393.019960:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569520896 00000100:00100000:3.0:1788572393.020038:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1130 00000100:00100000:3.0:1788572393.020049:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:162685:x1875444569520896:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572393.020071:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572393.020092:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109be736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb469 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572393.020219:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788572393.020343:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109be736 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb469 expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.020358:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572393.020362:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572393.020367:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109be736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb469 expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.020382:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf000, rc 0) 00000100:00100000:3.0:1788572393.020451:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:162685:x1875444569520896:12345-192.168.202.57@tcp:101:rm.0 Request processed in 404us (603us total) trans 347892350981 rc 301/301 00000100:00100000:3.0:1788572393.020458:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1130 00000100:00080000:1.0:1788572393.020738:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572393.020784:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572393.024741:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.024855:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569521024 00000100:00100000:1.0:1788572393.024868:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569521024 00000100:00100000:1.0:1788572393.024926:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 29 00000100:00100000:1.0:1788572393.024937:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:162685:x1875444569521024:12345-192.168.202.57@tcp:37:rm.0 00000100:00100000:1.0:1788572393.033242:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:162685:x1875444569521024:12345-192.168.202.57@tcp:37:rm.0 Request processed in 8196us (8401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572393.033259:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 29 00000100:00100000:0.0:1788572393.042562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.042724:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569521280 00000100:00100000:2.0:1788572393.042734:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569521280 00000100:00100000:2.0:1788572393.042781:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 30 00000100:00100000:2.0:1788572393.042791:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:162685:x1875444569521280:12345-192.168.202.57@tcp:35:rm.0 00000100:00100000:2.0:1788572393.043066:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:162685:x1875444569521280:12345-192.168.202.57@tcp:35:rm.0 Request processed in 275us (514us total) trans 347892350982 rc 0/0 00000100:00100000:2.0:1788572393.043078:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 30 00000100:00100000:2.0:1788572393.053445:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572393.053583:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569521536 00000100:00100000:0.0:1788572393.053595:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569521536 00000100:00100000:0.0:1788572393.053660:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1131 00000100:00100000:0.0:1788572393.053670:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:162685:x1875444569521536:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:0.0:1788572393.053697:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572393.053735:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be744 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb470 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.053847:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be74b lrc: 3/1,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.053862:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be74b lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.053882:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be74b lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572393.053894:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788572393.054001:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be744 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb470 expref: 14 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.054021:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be74b lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb470 expref: 13 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.054030:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e590b95f500) 00010000:00010000:0.0:1788572393.054032:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788572393.054036:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf000, rc 0) 00000100:00100000:0.0:1788572393.054101:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:162685:x1875444569521536:12345-192.168.202.57@tcp:101:rm.0 Request processed in 432us (666us total) trans 347892350983 rc 0/0 00000100:00100000:0.0:1788572393.054108:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1131 00000100:00100000:0.0:1788572393.078940:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.079291:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569521664 00000100:00100000:1.0:1788572393.079302:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569521664 00000100:00100000:1.0:1788572393.079392:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1132 00000100:00100000:1.0:1788572393.079404:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+91:162685:x1875444569521664:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572393.079426:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572393.079448:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be759 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb477 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572393.079639:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788572393.079969:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be760 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.079984:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be760 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.079996:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be760 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572393.080045:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788572393.080050:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572393.080090:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be760 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.080121:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be759 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb477 expref: 93 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.080156:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be760 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb477 expref: 92 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.080166:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.080168:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788572393.080172:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164e000, rc 0) 00000100:00100000:1.0:1788572393.080287:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:162685:x1875444569521664:12345-192.168.202.57@tcp:101:rm.0 Request processed in 885us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572393.080295:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1132 00000100:00100000:1.0:1788572393.092925:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.095289:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569521920 00000100:00100000:2.0:1788572393.095305:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569521920 00000100:00100000:2.0:1788572393.095394:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1133 00000100:00100000:2.0:1788572393.095405:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:162685:x1875444569521920:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:2.0:1788572393.095425:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572393.095449:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be767 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb47e expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572393.095605:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788572393.095725:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be767 lrc: 1/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb47e expref: 94 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.095741:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a02ffbf00) 00010000:00010000:2.0:1788572393.095745:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572393.095750:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be767 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb47e expref: 94 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.095781:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255800, rc 0) 00000100:00100000:2.0:1788572393.095847:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:162685:x1875444569521920:12345-192.168.202.57@tcp:101:rm.0 Request processed in 443us (2932us total) trans 21474837524 rc 301/301 00000100:00100000:2.0:1788572393.095855:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1133 00000100:00100000:2.0:1788572393.102147:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.102335:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569522048 00000100:00100000:1.0:1788572393.102345:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569522048 00000100:00100000:1.0:1788572393.102406:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 31 00000100:00100000:1.0:1788572393.102416:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:162685:x1875444569522048:12345-192.168.202.57@tcp:37:rm.0 00000100:00100000:0.0:1788572393.115355:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:162685:x1875444569522048:12345-192.168.202.57@tcp:37:rm.0 Request processed in 12930us (13221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572393.115368:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 31 00000100:00100000:0.0:1788572393.118400:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.118471:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569522304 00000100:00100000:2.0:1788572393.118622:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569522304 00000100:00100000:2.0:1788572393.118707:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 32 00000100:00100000:2.0:1788572393.118718:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:162685:x1875444569522304:12345-192.168.202.57@tcp:35:rm.0 00000100:00100000:2.0:1788572393.118958:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+94:162685:x1875444569522304:12345-192.168.202.57@tcp:35:rm.0 Request processed in 242us (567us total) trans 21474837525 rc 0/0 00000100:00100000:2.0:1788572393.118965:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 32 00000100:00100000:1.0:1788572393.122434:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.122616:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569522560 00000100:00100000:2.0:1788572393.122627:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569522560 00000100:00100000:2.0:1788572393.122732:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1134 00000100:00100000:2.0:1788572393.122745:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+94:162685:x1875444569522560:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:2.0:1788572393.122770:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572393.122794:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be775 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb485 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.122914:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be77c lrc: 3/1,0 mode: --/CR res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.122928:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be77c lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.122942:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be77c lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572393.122953:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788572393.123058:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be775 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb485 expref: 97 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.123082:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be77c lrc: 3/0,0 mode: CR/CR res: [0x240002729:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb485 expref: 96 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.123098:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:2.0:1788572393.123101:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572393.123106:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254600, rc 0) 00000100:00100000:2.0:1788572393.123174:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+96:162685:x1875444569522560:12345-192.168.202.57@tcp:101:rm.0 Request processed in 432us (750us total) trans 21474837526 rc 0/0 00000100:00100000:2.0:1788572393.123182:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1134 00000100:00100000:3.0:1788572393.127108:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.127284:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569522816 00000100:00100000:1.0:1788572393.127295:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569522816 00000100:00100000:1.0:1788572393.127364:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1135 00000100:00100000:1.0:1788572393.127375:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+96:162685:x1875444569522816:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.127435:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788572393.127462:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be633 lrc: 0/0,0 mode: --/PR res: [0x240002729:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb42a expref: 96 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127504:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xf:0x0].0x0 (ffff8e5a02ffb900) 00010000:00010000:1.0:1788572393.127536:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be760 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb477 expref: 95 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127545:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.127549:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.127571:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127582:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127591:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127602:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127609:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127615:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127691:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 3/0,1 mode: --/EX res: [0x240002729:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127877:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.127886:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572393.128171:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].2, 64 off8320 00000004:00080000:1.0:1788572393.128183:0:188049:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 9146122702678ns, next at 9147122699735ns, rc = 0 00010000:00010000:1.0:1788572393.128400:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 3/0,1 mode: --/PW res: [0x240002729:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.128410:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.128418:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.128426:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.128432:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.128443:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.128472:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572393.129285:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129296:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129303:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129308:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.129313:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129321:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129343:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xf:0x0].0x0 (ffff8e5a36d24400) 00010000:00010000:1.0:1788572393.129347:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572393.129352:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 2/0,0 mode: --/EX res: [0x240002729:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129358:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be798 lrc: 0/0,0 mode: --/EX res: [0x240002729:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129379:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129388:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129393:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129398:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.129401:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129408:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129416:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.129418:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572393.129421:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129426:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be78a lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.129435:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050db6064 reply state 0000000095eab4ad transno 21474837527 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129446:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.129451:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x83daffd9 (ffff8e5a02ffb300) 00010000:00010000:1.0:1788572393.129453:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572393.129456:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572393.129739:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572393.129746:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.130037:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572393.130041:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.130053:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.130063:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xf:0x0].0x0 (ffff8e5a36d24400) 00010000:00010000:3.0:1788572393.130066:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572393.130069:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 1/0,0 mode: --/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.130075:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be79f lrc: 0/0,0 mode: --/PW res: [0x240002729:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.130095:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.130097:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.130099:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572393.130396:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+96:162685:x1875444569522816:12345-192.168.202.57@tcp:36:rm.0 Request processed in 3017us (3636us total) trans 21474837527 rc 0/0 00000100:00100000:1.0:1788572393.130405:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1135 00000100:00100000:0.0:1788572393.141003:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.141085:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569523072 00000100:00100000:1.0:1788572393.141095:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569523072 00000100:00100000:1.0:1788572393.141166:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1136 00000100:00100000:1.0:1788572393.141176:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+96:162685:x1875444569523072:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.141244:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.141269:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be4b2 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3dd expref: 96 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.141289:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x4:0x0].0x0 (ffff8e590b95fd00) 00010000:00010000:1.0:1788572393.141300:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.141333:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.141349:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.141361:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.141372:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.141379:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.141385:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.141475:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.141510:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.141518:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572393.141761:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].2, 64 off8320 00000004:00080000:1.0:1788572393.141774:0:188050:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 9146136293952ns, next at 9147136291013ns, rc = 0 00010000:00010000:1.0:1788572393.142001:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 3/0,1 mode: --/PW res: [0x240002729:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142012:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142020:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142028:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142034:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142040:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142066:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572393.142085:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.142086:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572393.142098:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.142099:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142113:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.142117:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572393.142123:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142124:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ec00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.142131:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.142145:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142151:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.142161:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x4:0x0].0x0 (ffff8e5a36d24900) 00010000:00010000:2.0:1788572393.142164:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572393.142168:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 1/0,0 mode: --/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.142173:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be7bb lrc: 0/0,0 mode: --/PW res: [0x240002729:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.142184:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572393.142186:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572393.142187:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.142977:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x4:0x0].0x0 (ffff8e5a36d24900) 00010000:00010000:1.0:1788572393.142983:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572393.142988:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.142994:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be7b4 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.143016:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.143023:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.143029:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.143035:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.143039:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.143045:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.143052:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.143054:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572393.143057:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.143063:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be7a6 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.143071:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d7adf3f reply state 00000000d8f156ff transno 21474837528 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.143082:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.143088:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xc1e56442 (ffff8e590b95f200) 00010000:00010000:1.0:1788572393.143090:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572393.143093:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572393.143310:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+97:162685:x1875444569523072:12345-192.168.202.57@tcp:36:rm.0 Request processed in 2131us (2311us total) trans 21474837528 rc 0/0 00000100:00100000:1.0:1788572393.143320:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1136 00000100:00100000:3.0:1788572393.146600:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.146938:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569523328 00000100:00100000:1.0:1788572393.146948:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569523328 00000100:00100000:1.0:1788572393.147046:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1137 00000100:00100000:1.0:1788572393.147057:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+97:162685:x1875444569523328:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.147117:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.147156:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f400/0x265cfe11109be561 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb400 expref: 97 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.147178:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x9:0x0].0x0 (ffff8e5a0a54b400) 00010000:00010000:1.0:1788572393.147202:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.147222:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.147234:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.147244:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.147253:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xa3936bac bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.147260:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.147265:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.147360:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.147368:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.147375:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572393.147698:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].3, 64 off8384 00010000:00010000:0.0:1788572393.147746:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147756:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147764:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147770:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147776:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147781:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147805:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572393.147821:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147827:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147833:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147838:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572393.147842:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147849:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147856:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x9:0x0].0x0 (ffff8e5a36d24e00) 00010000:00010000:0.0:1788572393.147858:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572393.147862:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147867:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be7d0 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147880:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147885:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147890:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147895:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572393.147898:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147903:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147910:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:0.0:1788572393.147912:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572393.147914:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147918:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be7c2 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572393.147925:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aad88271 reply state 00000000edadf24a transno 21474837529 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147937:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.147942:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xa3936bac (ffff8e5a0a54b000) 00010000:00010000:0.0:1788572393.147944:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572393.147946:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572393.148072:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572393.148080:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.148086:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572393.148090:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.148097:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.148106:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x9:0x0].0x0 (ffff8e5a36d24e00) 00010000:00010000:3.0:1788572393.148108:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572393.148111:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.148120:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7d7 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.148133:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.148135:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.148136:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572393.148217:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+98:162685:x1875444569523328:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1159us (1625us total) trans 21474837529 rc 0/0 00000100:00100000:0.0:1788572393.148224:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1137 00000100:00100000:2.0:1788572393.150884:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.150956:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569523584 00000100:00100000:1.0:1788572393.150965:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569523584 00000100:00100000:1.0:1788572393.151034:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1138 00000100:00100000:1.0:1788572393.151045:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+98:162685:x1875444569523584:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.151102:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.151128:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be6e2 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb44d expref: 98 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151157:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x14:0x0].0x0 (ffff8e5a122fb900) 00010000:00010000:1.0:1788572393.151168:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.151199:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151212:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151221:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151232:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x31e2699a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151238:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151245:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151319:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 3/0,1 mode: --/EX res: [0x240002729:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151338:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151347:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572393.151583:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].3, 64 off8384 00010000:00010000:1.0:1788572393.151630:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151638:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151645:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151652:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151657:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151662:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151682:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572393.151711:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151717:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151722:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151731:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.151735:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151741:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151749:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x14:0x0].0x0 (ffff8e5a36d24600) 00010000:00010000:1.0:1788572393.151751:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572393.151755:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 2/0,0 mode: --/EX res: [0x240002729:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151760:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be7ec lrc: 0/0,0 mode: --/EX res: [0x240002729:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151775:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151780:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151785:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.151789:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.151791:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.152077:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572393.152083:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.152089:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572393.152092:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.152099:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.152109:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x14:0x0].0x0 (ffff8e5a36d24600) 00010000:00010000:2.0:1788572393.152111:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572393.152114:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.152120:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be7f3 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.152136:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572393.152147:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572393.152149:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.152240:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.152255:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.152257:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572393.152260:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.152265:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be7de lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.152275:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004089cdc1 reply state 00000000cc7a7282 transno 21474837530 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.152286:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.152293:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x31e2699a (ffff8e5a122fb000) 00010000:00010000:1.0:1788572393.152295:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572393.152298:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572393.152584:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+99:162685:x1875444569523584:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1536us (1704us total) trans 21474837530 rc 0/0 00000100:00100000:1.0:1788572393.152592:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1138 00000100:00100000:3.0:1788572393.155947:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572393.156413:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569523840 00000100:00100000:0.0:1788572393.156424:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569523840 00000100:00100000:0.0:1788572393.156654:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1139 00000100:00100000:0.0:1788572393.156677:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+99:162685:x1875444569523840:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572393.157128:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572393.157166:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616ee00/0x265cfe11109be4d5 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3e4 expref: 99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.157283:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x5:0x0].0x0 (ffff8e5a0a54b900) 00010000:00010000:0.0:1788572393.157299:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572393.157321:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.157409:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.157421:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.157439:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xef08328a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.157447:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.157453:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.157638:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.157646:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.157653:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572393.158300:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].4, 64 off8448 00010000:00010000:0.0:1788572393.158438:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 3/0,1 mode: --/PW res: [0x240002729:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158449:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158458:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158464:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158470:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158476:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158647:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572393.158669:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158675:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158680:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158686:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572393.158690:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158696:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158707:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x5:0x0].0x0 (ffff8e59019b4a00) 00010000:00010000:0.0:1788572393.158717:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572393.158721:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158727:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be808 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158743:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158760:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158765:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158769:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572393.158771:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158776:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158782:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:0.0:1788572393.158784:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572393.158787:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158792:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be7fa lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572393.158871:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000759d4ce6 reply state 0000000008ce3dd7 transno 21474837531 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158883:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.158890:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xef08328a (ffff8e590b95f100) 00010000:00010000:0.0:1788572393.158893:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572393.158896:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572393.159110:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+100:162685:x1875444569523840:12345-192.168.202.57@tcp:36:rm.0 Request processed in 2433us (3166us total) trans 21474837531 rc 0/0 00000100:00100000:0.0:1788572393.159120:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1139 00010000:00010000:1.0:1788572393.159464:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572393.159472:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.159515:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572393.159519:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.159526:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.159540:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x5:0x0].0x0 (ffff8e59019b4a00) 00010000:00010000:1.0:1788572393.159542:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788572393.159545:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 1/0,0 mode: --/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.159550:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109be80f lrc: 0/0,0 mode: --/PW res: [0x240002729:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.159567:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.159569:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.159571:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572393.164019:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.164115:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569524096 00000100:00100000:2.0:1788572393.164125:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569524096 00000100:00100000:2.0:1788572393.164293:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1140 00000100:00100000:2.0:1788572393.164306:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+100:162685:x1875444569524096:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572393.164444:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572393.164474:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be69c lrc: 0/0,0 mode: --/PR res: [0x240002729:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb43f expref: 100 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.164572:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x12:0x0].0x0 (ffff8e5a02ffbc00) 00010000:00010000:2.0:1788572393.164584:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572393.164605:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.164619:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.164629:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.164639:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.164645:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.164651:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.164957:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.164966:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.164973:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572393.165275:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].4, 64 off8448 00010000:00010000:2.0:1788572393.165464:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 3/0,1 mode: --/PW res: [0x240002729:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165475:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165548:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165556:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165562:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165569:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165694:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572393.165726:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165733:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165739:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165744:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.165748:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165770:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165781:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x12:0x0].0x0 (ffff8e5a02ffbf00) 00010000:00010000:2.0:1788572393.165784:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572393.165789:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165795:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be824 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165885:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165891:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165896:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165901:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.165904:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165909:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165917:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:2.0:1788572393.165920:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.165924:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165929:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be816 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572393.165939:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ee7fdc1 reply state 0000000012ef6e4f transno 21474837532 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165955:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.165961:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xec45d8e7 (ffff8e5a02ffba00) 00010000:00010000:2.0:1788572393.165963:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572393.165967:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572393.166089:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+101:162685:x1875444569524096:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1783us (2077us total) trans 21474837532 rc 0/0 00000100:00100000:2.0:1788572393.166098:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1140 00010000:00010000:3.0:1788572393.166754:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572393.166762:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.166770:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572393.166775:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.166783:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.166794:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x12:0x0].0x0 (ffff8e5a02ffbf00) 00010000:00010000:3.0:1788572393.166943:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572393.166949:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 1/0,0 mode: --/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.166955:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be82b lrc: 0/0,0 mode: --/PW res: [0x240002729:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.166976:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.166979:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.166982:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572393.170047:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572393.170134:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569524352 00000100:00100000:0.0:1788572393.170156:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569524352 00000100:00100000:0.0:1788572393.170323:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1141 00000100:00100000:0.0:1788572393.170344:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+101:162685:x1875444569524352:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572393.170405:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572393.170431:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109be4f8 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3eb expref: 101 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.170450:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x6:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:0.0:1788572393.170462:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572393.170664:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.170678:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.170688:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.170713:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.170720:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.170727:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.170837:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.170845:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.170851:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572393.171069:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].5, 64 off8512 00010000:00010000:0.0:1788572393.171127:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171137:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171157:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171164:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171170:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171176:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171211:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572393.171230:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171239:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171245:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171250:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572393.171254:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171262:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171271:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x6:0x0].0x0 (ffff8e59019b4500) 00010000:00010000:0.0:1788572393.171273:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572393.171277:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171282:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109be840 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171299:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171306:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171311:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171316:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171322:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.171593:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572393.171601:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.171607:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572393.171611:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.171617:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.171625:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x6:0x0].0x0 (ffff8e59019b4500) 00010000:00010000:1.0:1788572393.171628:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788572393.171630:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.171636:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109be847 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.171652:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.171654:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.171656:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.171704:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171711:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171720:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:0.0:1788572393.171722:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572393.171724:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171730:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109be832 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572393.171740:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b8b5f3a reply state 00000000855d1078 transno 21474837533 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171750:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.171757:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x1c2b00d3 (ffff8e5a122fbe00) 00010000:00010000:0.0:1788572393.171759:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572393.171762:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572393.171901:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+102:162685:x1875444569524352:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1556us (1862us total) trans 21474837533 rc 0/0 00000100:00100000:0.0:1788572393.171910:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1141 00000100:00100000:0.0:1788572393.178410:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.178693:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569524608 00000100:00100000:1.0:1788572393.178943:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569524608 00000100:00100000:1.0:1788572393.179040:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1142 00000100:00100000:1.0:1788572393.179052:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+102:162685:x1875444569524608:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.179119:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.179182:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be679 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb438 expref: 102 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.179211:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x11:0x0].0x0 (ffff8e5a36d24000) 00010000:00010000:1.0:1788572393.179224:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.179247:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.179443:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.179459:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.179472:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xc977908d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.179599:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.179605:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.179711:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 3/0,1 mode: --/EX res: [0x240002729:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.179719:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.179726:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572393.180031:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].5, 64 off8512 00010000:00010000:1.0:1788572393.180081:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180090:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180098:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180106:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180112:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180118:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180204:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572393.180224:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180232:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180242:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180247:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ec00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.180251:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180258:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180268:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x11:0x0].0x0 (ffff8e5a36d24900) 00010000:00010000:1.0:1788572393.180271:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572393.180275:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 2/0,0 mode: --/EX res: [0x240002729:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180281:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be85c lrc: 0/0,0 mode: --/EX res: [0x240002729:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180296:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180302:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180307:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180311:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.180313:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180323:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180403:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.180405:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572393.180407:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180411:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be84e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.180418:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000955f8929 reply state 00000000f84dd545 transno 21474837534 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180426:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.180430:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xc977908d (ffff8e5a122fb500) 00010000:00010000:1.0:1788572393.180431:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572393.180433:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572393.180783:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+103:162685:x1875444569524608:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1729us (2379us total) trans 21474837534 rc 0/0 00000100:00100000:1.0:1788572393.180792:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1142 00000100:00100000:3.0:1788572393.185065:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1788572393.185257:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572393.185268:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.185278:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572393.185283:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.185293:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.185312:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x11:0x0].0x0 (ffff8e5a36d24900) 00010000:00010000:0.0:1788572393.185315:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572393.185320:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.185584:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be863 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.185613:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.185615:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.185617:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572393.185909:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569524864 00000100:00100000:1.0:1788572393.185919:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569524864 00000100:00100000:1.0:1788572393.185983:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1143 00000100:00100000:1.0:1788572393.185994:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+103:162685:x1875444569524864:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.186055:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.186074:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be46c lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3cf expref: 103 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.186090:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2:0x0].0x0 (ffff8e5a122fb800) 00010000:00010000:1.0:1788572393.186098:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.186121:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.186134:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.186156:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.186168:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.186174:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.186180:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.186573:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.186582:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.186589:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572393.187311:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].6, 64 off8576 00010000:00010000:1.0:1788572393.188148:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188166:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188176:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188252:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188260:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188266:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188342:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572393.188369:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188376:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188382:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188388:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.188394:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188402:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188419:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2:0x0].0x0 (ffff8e5a36d24500) 00010000:00010000:1.0:1788572393.188421:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572393.188426:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188433:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be878 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188452:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188457:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188463:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188468:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.188471:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188501:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188509:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.188511:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572393.188514:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188520:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be86a lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.188535:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d735850 reply state 00000000de44b06d transno 21474837535 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188546:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.188552:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x679fc7b1 (ffff8e5a122fb600) 00010000:00010000:1.0:1788572393.188554:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572393.188558:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572393.188652:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+104:162685:x1875444569524864:12345-192.168.202.57@tcp:36:rm.0 Request processed in 2656us (3594us total) trans 21474837535 rc 0/0 00000100:00100000:1.0:1788572393.188661:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1143 00000100:00100000:2.0:1788572393.193201:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.193277:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569525120 00000100:00100000:1.0:1788572393.193286:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569525120 00000100:00100000:1.0:1788572393.193354:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1144 00000100:00100000:1.0:1788572393.193364:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+104:162685:x1875444569525120:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.193441:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.193466:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109be584 lrc: 0/0,0 mode: --/PR res: [0x240002729:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb407 expref: 104 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.193508:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xa:0x0].0x0 (ffff8e5a122fbc00) 00010000:00010000:1.0:1788572393.193521:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.193543:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.193557:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.193572:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.193583:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.193591:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.193597:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.193671:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 3/0,1 mode: --/EX res: [0x240002729:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.193678:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.193684:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572393.194063:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].7, 64 off8640 00010000:00010000:1.0:1788572393.194109:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 3/0,1 mode: --/PW res: [0x240002729:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.194118:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.194125:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.194133:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.194152:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.194159:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195060:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572393.195069:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195077:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572393.195082:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195092:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195104:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2:0x0].0x0 (ffff8e5a36d24500) 00010000:00010000:0.0:1788572393.195109:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572393.195113:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 1/0,0 mode: --/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195120:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be87f lrc: 0/0,0 mode: --/PW res: [0x240002729:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195136:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572393.195150:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 4/0,0 mode: PW/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195155:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572393.195158:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 4/0,0 mode: PW/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195163:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 5/0,0 mode: PW/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195170:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xa:0x0].0x0 (ffff8e5a36d24c00) 00010000:00010000:0.0:1788572393.195172:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572393.195174:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 3/0,0 mode: --/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.195181:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.195182:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.195194:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.195441:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572393.195448:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109be89b lrc: 0/0,0 mode: --/PW res: [0x240002729:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195503:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195510:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195515:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195520:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.195524:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195529:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195539:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xa:0x0].0x0 (ffff8e5a36d24c00) 00010000:00010000:1.0:1788572393.195541:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572393.195544:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 2/0,0 mode: --/EX res: [0x240002729:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195554:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109be894 lrc: 0/0,0 mode: --/EX res: [0x240002729:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195578:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195583:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195588:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195593:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195598:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.195600:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195606:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195612:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.195615:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572393.195617:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195623:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be886 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.195633:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000253b8d9 reply state 00000000ba33e509 transno 21474837536 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195645:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.195652:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xd0b639f4 (ffff8e5a0a54bd00) 00010000:00010000:1.0:1788572393.195654:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572393.195657:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572393.195770:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+105:162685:x1875444569525120:12345-192.168.202.57@tcp:36:rm.0 Request processed in 2402us (2584us total) trans 21474837536 rc 0/0 00000100:00100000:1.0:1788572393.195778:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1144 00010000:00010000:3.0:1788572393.201288:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572393.201876:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.201980:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569525376 00000100:00100000:2.0:1788572393.201990:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569525376 00000100:00100000:2.0:1788572393.202083:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1145 00000100:00100000:2.0:1788572393.202094:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+105:162685:x1875444569525376:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572393.202186:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572393.202219:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be5a7 lrc: 0/0,0 mode: --/PR res: [0x240002729:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb40e expref: 105 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.202242:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xb:0x0].0x0 (ffff8e590b95fa00) 00010000:00010000:2.0:1788572393.202254:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572393.202279:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.202293:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.202303:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.202316:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.202323:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.202424:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.202638:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 3/0,1 mode: --/EX res: [0x240002729:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.202647:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.202654:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572393.203131:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].6, 64 off8576 00010000:00010000:2.0:1788572393.203200:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 3/0,1 mode: --/PW res: [0x240002729:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203210:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203218:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203226:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203232:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203238:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203265:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572393.203282:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203288:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203294:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203300:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.203304:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203311:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203320:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xb:0x0].0x0 (ffff8e5a02ffbc00) 00010000:00010000:2.0:1788572393.203323:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572393.203337:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 2/0,0 mode: --/EX res: [0x240002729:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203343:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be8b0 lrc: 0/0,0 mode: --/EX res: [0x240002729:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203360:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203370:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203374:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203379:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.203381:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203387:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203394:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:2.0:1788572393.203396:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.203400:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203405:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be8a2 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572393.203413:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002219a08b reply state 00000000b892d01f transno 21474837537 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203424:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.203429:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xfdd9083c (ffff8e590b95f800) 00010000:00010000:2.0:1788572393.203431:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572393.203434:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572393.203551:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+106:162685:x1875444569525376:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1456us (1680us total) trans 21474837537 rc 0/0 00000100:00100000:2.0:1788572393.203559:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1145 00010000:00010000:3.0:1788572393.206109:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572393.206123:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.206134:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572393.206147:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.206158:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.206177:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xb:0x0].0x0 (ffff8e5a02ffbc00) 00010000:00010000:3.0:1788572393.206179:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572393.206185:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 1/0,0 mode: --/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.206191:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8b7 lrc: 0/0,0 mode: --/PW res: [0x240002729:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.206218:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.206219:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.206221:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572393.206373:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.206427:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569525632 00000100:00100000:1.0:1788572393.206440:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569525632 00000100:00100000:1.0:1788572393.206543:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1146 00000100:00100000:1.0:1788572393.206552:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+106:162685:x1875444569525632:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.206610:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.206626:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be5ed lrc: 0/0,0 mode: --/PR res: [0x240002729:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb41c expref: 106 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.206637:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xd:0x0].0x0 (ffff8e5a02ffbb00) 00010000:00010000:1.0:1788572393.206642:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.206670:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.206682:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.206690:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.206713:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.206718:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.206722:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.206796:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 3/0,1 mode: --/EX res: [0x240002729:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.206801:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.206805:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572393.207033:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].7, 64 off8640 00010000:00010000:1.0:1788572393.207089:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 3/0,1 mode: --/PW res: [0x240002729:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207097:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207105:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207112:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207117:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207124:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207151:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572393.207168:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207175:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 2/0,0 mode: EX/EX res: [0x240002729:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207180:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207185:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.207189:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207196:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 4/0,0 mode: EX/EX res: [0x240002729:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207205:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xd:0x0].0x0 (ffff8e5a36d24000) 00010000:00010000:1.0:1788572393.207207:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572393.207211:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 2/0,0 mode: --/EX res: [0x240002729:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207217:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be8cc lrc: 0/0,0 mode: --/EX res: [0x240002729:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207232:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207239:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207242:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207245:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.207247:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207250:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207254:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.207255:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572393.207257:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207260:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be8be lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.207265:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfc78ed9 reply state 00000000ab798e96 transno 21474837538 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207273:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.207277:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x3e3e6f26 (ffff8e590b95f400) 00010000:00010000:1.0:1788572393.207278:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572393.207280:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572393.207342:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+107:162685:x1875444569525632:12345-192.168.202.57@tcp:36:rm.0 Request processed in 790us (974us total) trans 21474837538 rc 0/0 00000100:00100000:1.0:1788572393.207347:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1146 00010000:00010000:3.0:1788572393.208122:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572393.208131:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.208150:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572393.208154:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.208163:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.208175:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xd:0x0].0x0 (ffff8e5a36d24000) 00010000:00010000:3.0:1788572393.208178:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572393.208182:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 1/0,0 mode: --/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.208190:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be8d3 lrc: 0/0,0 mode: --/PW res: [0x240002729:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.208207:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.208208:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.208210:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572393.210082:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.210210:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569525888 00000100:00100000:1.0:1788572393.210220:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569525888 00000100:00100000:1.0:1788572393.210274:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1147 00000100:00100000:1.0:1788572393.210284:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+107:162685:x1875444569525888:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.210407:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.210426:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255400/0x265cfe11109be705 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb454 expref: 107 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.210441:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x15:0x0].0x0 (ffff8e5a02ffbe00) 00010000:00010000:1.0:1788572393.210449:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.210467:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.210633:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.210642:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.210651:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.210656:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.210660:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.210790:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.210796:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.210801:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572393.210973:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].8, 64 off8704 00010000:00010000:1.0:1788572393.211016:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 3/0,1 mode: --/PW res: [0x240002729:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211024:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211032:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211040:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211046:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211052:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211065:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572393.211081:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211092:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211098:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211104:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.211108:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211115:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211124:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x15:0x0].0x0 (ffff8e5a36d24c00) 00010000:00010000:1.0:1788572393.211127:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572393.211131:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211137:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109be8e8 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211170:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211177:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211184:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211189:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211195:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ec00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.211198:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.211202:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572393.211204:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.211208:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211211:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.211214:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572393.211217:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 3/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.211219:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572393.211223:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211223:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109be8da lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.211231:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.211233:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbf9bee1 reply state 0000000006477d16 transno 21474837539 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.211239:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x15:0x0].0x0 (ffff8e5a36d24c00) 00010000:00010000:0.0:1788572393.211241:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788572393.211243:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.211244:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 1/0,0 mode: --/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.211250:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109be8ef lrc: 0/0,0 mode: --/PW res: [0x240002729:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.211250:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x54b0b1f4 (ffff8e59019b4600) 00010000:00010000:1.0:1788572393.211252:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572393.211255:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572393.211262:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.211264:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.211265:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572393.211348:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+108:162685:x1875444569525888:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1063us (1272us total) trans 21474837539 rc 0/0 00000100:00100000:1.0:1788572393.211355:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1147 00000100:00100000:0.0:1788572393.214198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.214279:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569526144 00000100:00100000:2.0:1788572393.214290:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569526144 00000100:00100000:2.0:1788572393.214359:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1148 00000100:00100000:2.0:1788572393.214370:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+108:162685:x1875444569526144:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572393.214433:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572393.214460:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109be6bf lrc: 0/0,0 mode: --/PR res: [0x240002729:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb446 expref: 108 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214518:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x13:0x0].0x0 (ffff8e590430cd00) 00010000:00010000:2.0:1788572393.214530:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572393.214553:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214566:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214577:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214590:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xf142140 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214597:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214603:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214691:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214711:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214718:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572393.214919:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].9, 64 off8768 00010000:00010000:2.0:1788572393.214972:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 3/0,1 mode: --/PW res: [0x240002729:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214981:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214988:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.214995:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215000:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215007:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215025:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572393.215044:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215053:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215058:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215063:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.215067:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215075:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215084:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x13:0x0].0x0 (ffff8e5a02ffb500) 00010000:00010000:2.0:1788572393.215087:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572393.215090:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215096:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255800/0x265cfe11109be904 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215111:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215117:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215122:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215126:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.215129:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215135:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215154:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:2.0:1788572393.215156:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.215159:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215164:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030400/0x265cfe11109be8f6 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572393.215175:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bc671bf reply state 00000000d104a359 transno 21474837540 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215184:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.215190:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xf142140 (ffff8e590430c200) 00010000:00010000:2.0:1788572393.215192:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572393.215194:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572393.215267:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+109:162685:x1875444569526144:12345-192.168.202.57@tcp:36:rm.0 Request processed in 898us (1078us total) trans 21474837540 rc 0/0 00000100:00100000:2.0:1788572393.215275:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1148 00010000:00010000:0.0:1788572393.216027:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572393.216035:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.216043:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572393.216047:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.216055:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.216065:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x13:0x0].0x0 (ffff8e5a02ffb500) 00010000:00010000:0.0:1788572393.216069:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572393.216072:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 1/0,0 mode: --/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.216078:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109be90b lrc: 0/0,0 mode: --/PW res: [0x240002729:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.216093:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.216095:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.216096:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572393.218649:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.218967:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569526400 00000100:00100000:2.0:1788572393.218977:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569526400 00000100:00100000:2.0:1788572393.219039:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1149 00000100:00100000:2.0:1788572393.219049:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+109:162685:x1875444569526400:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572393.219106:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572393.219131:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031800/0x265cfe11109be48f lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3d6 expref: 109 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219163:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3:0x0].0x0 (ffff8e590b95ff00) 00010000:00010000:2.0:1788572393.219174:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572393.219195:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219208:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219219:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219232:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x94c295fa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219239:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219246:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219343:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219352:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219358:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572393.219589:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].10, 64 off8832 00010000:00010000:2.0:1788572393.219641:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219650:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219656:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219662:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219668:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219674:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219693:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572393.219721:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219727:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219733:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219738:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.219743:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219760:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219771:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3:0x0].0x0 (ffff8e5a02ffb600) 00010000:00010000:2.0:1788572393.219774:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572393.219778:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219785:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109be920 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219799:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219805:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219811:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219816:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.219818:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219823:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219831:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:2.0:1788572393.219833:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.219836:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219841:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254000/0x265cfe11109be912 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572393.219855:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000254bbc33 reply state 000000003e09300e transno 21474837541 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219865:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.219871:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x94c295fa (ffff8e590b95f300) 00010000:00010000:2.0:1788572393.219873:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572393.219876:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572393.219948:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+110:162685:x1875444569526400:12345-192.168.202.57@tcp:36:rm.0 Request processed in 898us (1306us total) trans 21474837541 rc 0/0 00000100:00100000:2.0:1788572393.219957:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1149 00010000:00010000:1.0:1788572393.220156:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572393.220163:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.220174:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7be00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572393.220178:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.220184:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.220194:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3:0x0].0x0 (ffff8e5a02ffb600) 00010000:00010000:1.0:1788572393.220197:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788572393.220200:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.220205:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109be927 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.220219:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.220221:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.220222:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572393.223073:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.223295:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569526656 00000100:00100000:1.0:1788572393.223304:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569526656 00000100:00100000:1.0:1788572393.223454:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1150 00000100:00100000:1.0:1788572393.223465:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+110:162685:x1875444569526656:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572393.223560:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.223586:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f800/0x265cfe11109be5ca lrc: 0/0,0 mode: --/PR res: [0x240002729:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb415 expref: 110 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.223607:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xc:0x0].0x0 (ffff8e5a0a54bf00) 00010000:00010000:1.0:1788572393.223620:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572393.223640:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.223653:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.223662:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.223673:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.223680:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.223687:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.223788:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 3/0,1 mode: --/EX res: [0x240002729:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.223797:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.223805:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572393.224002:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].8, 64 off8704 00010000:00010000:1.0:1788572393.224050:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 3/0,1 mode: --/PW res: [0x240002729:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224058:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224069:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224076:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224082:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224089:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224103:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572393.224119:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224125:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 2/0,0 mode: EX/EX res: [0x240002729:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224132:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224137:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.224151:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224158:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 4/0,0 mode: EX/EX res: [0x240002729:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224167:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xc:0x0].0x0 (ffff8e5a36d24200) 00010000:00010000:1.0:1788572393.224170:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572393.224174:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 2/0,0 mode: --/EX res: [0x240002729:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224180:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109be93c lrc: 0/0,0 mode: --/EX res: [0x240002729:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224199:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224205:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224211:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224217:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224222:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572393.224224:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224230:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224238:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:1.0:1788572393.224240:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572393.224243:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 3/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224249:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109be92e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.224259:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003318a8fe reply state 00000000f3f6680b transno 21474837542 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224270:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.224276:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x1b7026cc (ffff8e5a0a54b800) 00010000:00010000:1.0:1788572393.224278:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572393.224281:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572393.224363:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+111:162685:x1875444569526656:12345-192.168.202.57@tcp:36:rm.0 Request processed in 898us (1299us total) trans 21474837542 rc 0/0 00000100:00100000:1.0:1788572393.224370:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1150 00010000:00010000:3.0:1788572393.224439:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572393.224446:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.224452:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572393.224456:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.224463:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.224472:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xc:0x0].0x0 (ffff8e5a36d24200) 00010000:00010000:3.0:1788572393.224474:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572393.224506:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 1/0,0 mode: --/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.224513:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a01670400/0x265cfe11109be943 lrc: 0/0,0 mode: --/PW res: [0x240002729:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.224532:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.224534:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572393.224535:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572393.227451:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.227558:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569526912 00000100:00100000:2.0:1788572393.227569:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569526912 00000100:00100000:2.0:1788572393.227625:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1151 00000100:00100000:2.0:1788572393.227636:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+111:162685:x1875444569526912:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572393.227696:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572393.227736:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109be656 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb431 expref: 111 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.227772:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x10:0x0].0x0 (ffff8e590430ce00) 00010000:00010000:2.0:1788572393.227785:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572393.227809:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.227823:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.227838:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.227849:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.227856:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.227863:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.227948:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.227956:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.227963:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572393.228184:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].9, 64 off8768 00010000:00010000:2.0:1788572393.228234:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 3/0,1 mode: --/PW res: [0x240002729:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228243:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228250:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228257:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228264:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228269:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228429:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572393.228448:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228455:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228462:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228468:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.228472:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228498:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228508:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x10:0x0].0x0 (ffff8e5a02ffb100) 00010000:00010000:2.0:1788572393.228511:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572393.228514:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228519:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109be958 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228540:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228546:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228553:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228558:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.228561:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228567:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228574:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:2.0:1788572393.228576:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.228579:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228585:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109be94a lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572393.228594:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087762a78 reply state 00000000145b4a81 transno 21474837543 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228604:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.228610:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xa6a94833 (ffff8e590430c900) 00010000:00010000:2.0:1788572393.228613:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572393.228615:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572393.228682:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+112:162685:x1875444569526912:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1047us (1239us total) trans 21474837543 rc 0/0 00000100:00100000:2.0:1788572393.228689:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1151 00000100:00100000:3.0:1788572393.231038:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.231164:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569527168 00000100:00100000:2.0:1788572393.231173:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569527168 00000100:00100000:2.0:1788572393.231233:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1152 00000100:00100000:2.0:1788572393.231244:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+112:162685:x1875444569527168:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572393.231298:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572393.231324:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254200/0x265cfe11109be51b lrc: 0/0,0 mode: --/PR res: [0x240002729:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3f2 expref: 112 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.231359:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x7:0x0].0x0 (ffff8e590b95f700) 00010000:00010000:2.0:1788572393.231369:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572393.231389:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.231400:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.231409:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.231418:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.231424:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.231429:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.231525:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.231533:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.231539:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572393.232176:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].11, 64 off8896 00010000:00010000:2.0:1788572393.232238:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 3/0,1 mode: --/PW res: [0x240002729:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232249:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232257:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232265:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232271:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232277:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232437:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572393.232445:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232453:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572393.232457:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232465:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232499:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x10:0x0].0x0 (ffff8e5a02ffb100) 00010000:00010000:0.0:1788572393.232502:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572393.232507:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 1/0,0 mode: --/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232513:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109be95f lrc: 0/0,0 mode: --/PW res: [0x240002729:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232529:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572393.232533:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 4/0,0 mode: PW/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232539:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572393.232542:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 4/0,0 mode: PW/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232547:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 5/0,0 mode: PW/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232554:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x7:0x0].0x0 (ffff8e5a02ffb400) 00010000:00010000:0.0:1788572393.232556:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572393.232559:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 3/0,0 mode: --/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.232564:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.232566:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.232568:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572393.232919:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572393.232925:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109be97b lrc: 0/0,0 mode: --/PW res: [0x240002729:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232955:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232961:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232967:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232972:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.232976:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232982:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.232991:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x7:0x0].0x0 (ffff8e5a02ffb400) 00010000:00010000:2.0:1788572393.232994:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572393.232997:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233003:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109be974 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233022:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233029:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233034:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233040:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.233043:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233049:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233057:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:2.0:1788572393.233059:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.233062:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233067:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b200/0x265cfe11109be966 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572393.233088:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000044f784e reply state 000000004b10f4e6 transno 21474837544 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233098:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.233105:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x494dcf1b (ffff8e590b95f600) 00010000:00010000:2.0:1788572393.233107:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572393.233110:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572393.233214:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+113:162685:x1875444569527168:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1969us (2182us total) trans 21474837544 rc 0/0 00000100:00100000:2.0:1788572393.233222:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1152 00010000:00010000:0.0:1788572393.235584:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572393.236247:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.236350:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569527424 00000100:00100000:2.0:1788572393.236360:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569527424 00000100:00100000:2.0:1788572393.236427:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1153 00000100:00100000:2.0:1788572393.236438:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+113:162685:x1875444569527424:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572393.236532:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572393.236560:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109be610 lrc: 0/0,0 mode: --/PR res: [0x240002729:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb423 expref: 113 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.236578:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xe:0x0].0x0 (ffff8e5a122fb400) 00010000:00010000:2.0:1788572393.236587:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572393.236608:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.236619:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.236629:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.236638:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x610cb780 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.236643:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.236649:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.236743:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 3/0,1 mode: --/EX res: [0x240002729:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.236763:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.236775:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572393.236970:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].10, 64 off8832 00010000:00010000:2.0:1788572393.237022:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 3/0,1 mode: --/PW res: [0x240002729:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237031:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237038:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237046:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237052:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237059:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237077:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572393.237093:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237099:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237105:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237114:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.237118:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237126:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237134:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xe:0x0].0x0 (ffff8e5a02ffb200) 00010000:00010000:2.0:1788572393.237137:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572393.237152:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 2/0,0 mode: --/EX res: [0x240002729:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237158:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109be990 lrc: 0/0,0 mode: --/EX res: [0x240002729:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237174:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237180:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237185:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237190:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.237192:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237198:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237209:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:2.0:1788572393.237211:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.237214:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237219:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109be982 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572393.237227:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a7677ad reply state 00000000884b01af transno 21474837545 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237238:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.237244:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x610cb780 (ffff8e5a122fb700) 00010000:00010000:2.0:1788572393.237245:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572393.237248:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572393.237327:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+114:162685:x1875444569527424:12345-192.168.202.57@tcp:36:rm.0 Request processed in 888us (1085us total) trans 21474837545 rc 0/0 00000100:00100000:2.0:1788572393.237335:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1153 00010000:00010000:0.0:1788572393.238197:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572393.238205:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.238213:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7aa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572393.238217:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.238225:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.238236:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0xe:0x0].0x0 (ffff8e5a02ffb200) 00010000:00010000:0.0:1788572393.238238:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572393.238243:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 1/0,0 mode: --/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.238248:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109be997 lrc: 0/0,0 mode: --/PW res: [0x240002729:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.238262:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.238264:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572393.238265:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572393.243941:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572393.244028:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569527680 00000100:00100000:0.0:1788572393.244039:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569527680 00000100:00100000:0.0:1788572393.244105:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1154 00000100:00100000:0.0:1788572393.244116:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+114:162685:x1875444569527680:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572393.244192:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572393.244220:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254e00/0x265cfe11109be53e lrc: 0/0,0 mode: --/PR res: [0x240002729:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3f9 expref: 114 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244240:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x8:0x0].0x0 (ffff8e590b95fc00) 00010000:00010000:0.0:1788572393.244250:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572393.244272:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244286:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244295:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244305:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1:0x0].0x76709d63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244316:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244321:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244402:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 3/0,1 mode: --/EX res: [0x240002729:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244410:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244417:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572393.244653:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].11, 64 off8896 00010000:00010000:0.0:1788572393.244717:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244726:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244733:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244740:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244746:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244763:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244777:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572393.244794:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244799:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244805:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244811:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572393.244815:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244823:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244831:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x8:0x0].0x0 (ffff8e59019b4000) 00010000:00010000:0.0:1788572393.244834:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572393.244837:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 2/0,0 mode: --/EX res: [0x240002729:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244842:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109be9ac lrc: 0/0,0 mode: --/EX res: [0x240002729:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244858:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244863:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244868:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244875:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244880:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572393.244882:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244888:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244895:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:0.0:1788572393.244897:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572393.244899:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 3/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244904:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109be99e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572393.244912:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006d1023a reply state 00000000307a86c3 transno 21474837546 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244921:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.244927:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x76709d63 (ffff8e5a0a54be00) 00010000:00010000:0.0:1788572393.244929:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572393.244932:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572393.245185:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:162685:x1875444569527680:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1068us (1251us total) trans 21474837546 rc 0/0 00000100:00100000:0.0:1788572393.245193:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1154 00010000:00010000:1.0:1788572393.245321:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572393.245327:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.245334:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572393.245337:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.245344:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.245353:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x8:0x0].0x0 (ffff8e59019b4000) 00010000:00010000:1.0:1788572393.245356:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788572393.245358:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.245363:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109be9b3 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.245379:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.245381:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.245382:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572393.255306:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.255459:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569527808 00000100:00100000:2.0:1788572393.255470:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569527808 00000100:00100000:2.0:1788572393.255629:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1155 00000100:00100000:2.0:1788572393.255641:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:162685:x1875444569527808:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:2.0:1788572393.255665:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572393.255687:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109be9ba lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb48c expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.255968:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 3/1,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.255985:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.255997:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256014:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256021:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256028:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256091:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b800/0x265cfe11109be9cf lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256099:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b800/0x265cfe11109be9cf lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256106:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b800/0x265cfe11109be9cf lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572393.256127:0:196070:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b800/0x265cfe11109be9cf lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256151:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256158:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 2/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256169:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256176:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.256179:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256187:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256198:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e590b95f500) 00010000:00010000:2.0:1788572393.256202:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.256207:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256213:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109be9c1 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256229:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256235:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256240:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256245:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.256248:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256260:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256268:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0xf7117594 (ffff8e5a02ffb400) 00010000:00010000:2.0:1788572393.256270:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.256273:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256278:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109be9c8 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256310:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109be9ba lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb48c expref: 15 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256324:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b800/0x265cfe11109be9cf lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb48c expref: 14 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.256344:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b100) 00010000:00010000:2.0:1788572393.256346:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572393.256349:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7b800, rc 0) 00000100:00100000:2.0:1788572393.256420:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:162685:x1875444569527808:12345-192.168.202.57@tcp:101:rm.0 Request processed in 781us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572393.256428:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1155 00000100:00100000:2.0:1788572393.261817:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.261862:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572393.262118:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569528064 00000100:00100000:0.0:1788572393.262128:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569528064 00000100:00100000:0.0:1788572393.262203:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4662 00000100:00100000:0.0:1788572393.262213:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:2399:x1875444569528064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572393.262229:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572393.262253:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b800/0x265cfe11109be9cf lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb48c expref: 14 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.262271:0:152004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b100) 00010000:00010000:0.0:1788572393.262276:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572393.262327:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:2399:x1875444569528064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 115us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572393.262346:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4662 00000100:00100000:3.0:1788572393.263058:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569527936 00000100:00100000:3.0:1788572393.263065:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569527936 00000100:00100000:3.0:1788572393.263112:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1156 00000100:00100000:3.0:1788572393.263120:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:162685:x1875444569527936:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572393.263150:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572393.263168:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109be9d6 lrc: 2/0,0 mode: --/CR res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb493 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.263224:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be9dd lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.263237:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be9dd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.263248:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be9dd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572393.263290:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788572393.263295:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788572393.263395:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109be9d6 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb493 expref: 117 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.263413:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be9dd lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb493 expref: 116 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.263423:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:3.0:1788572393.263426:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788572393.263430:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce600, rc 0) 00000100:00100000:3.0:1788572393.263467:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+116:162685:x1875444569527936:12345-192.168.202.57@tcp:101:rm.0 Request processed in 348us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572393.263474:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1156 00000100:00100000:2.0:1788572393.268018:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.268064:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572393.268134:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569528448 00000100:00100000:0.0:1788572393.268155:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569528448 00000100:00100000:0.0:1788572393.268212:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 33 00000100:00100000:0.0:1788572393.268224:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+116:162685:x1875444569528448:12345-192.168.202.57@tcp:35:rm.0 00000100:00100000:0.0:1788572393.268458:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+117:162685:x1875444569528448:12345-192.168.202.57@tcp:35:rm.0 Request processed in 235us (392us total) trans 21474837547 rc 0/0 00000100:00100000:0.0:1788572393.268465:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 33 00000100:00100000:3.0:1788572393.269077:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569528192 00000100:00100000:3.0:1788572393.269084:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569528192 00000100:00100000:3.0:1788572393.269157:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4663 00000100:00100000:3.0:1788572393.269166:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:2398:x1875444569528192:12345-192.168.202.57@tcp:103:rm.0 00010000:00010000:3.0:1788572393.269178:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572393.269203:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616e000/0x265cfe11109be434 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3c1 expref: 13 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.269222:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a0a54b100) 00010000:00010000:3.0:1788572393.269234:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572393.269393:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2398:x1875444569528192:12345-192.168.202.57@tcp:103:rm.0 Request processed in 228us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572393.269400:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4663 00000100:00100000:1.0:1788572393.271690:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572393.272919:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569528704 00000100:00100000:0.0:1788572393.272933:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569528704 00000100:00100000:0.0:1788572393.273037:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1157 00000100:00100000:0.0:1788572393.273048:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+117:162685:x1875444569528704:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572393.273108:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788572393.273136:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109be9dd lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb493 expref: 117 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.273195:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109be77c lrc: 0/0,0 mode: --/CR res: [0x240002729:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb485 expref: 116 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.273213:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e5a36d24b00) 00010000:00010000:0.0:1788572393.273227:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572393.273282:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 3/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.273289:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 3/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.273299:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 3/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572393.273320:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584386944:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788572393.273445:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572393.273502:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788572393.273567:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584386944 00000100:00100000:3.0:1788572393.273573:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584386944 00000100:00100000:3.0:1788572393.273614:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1788572393.273622:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:188048:x1875444584386944:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788572393.273632:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572393.273647:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcec00/0x265cfe11109be9eb lrc: 2/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109be9e4 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.273670:0:188053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ba expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.273680:0:188053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcec00/0x265cfe11109be9eb lrc: 4/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be9e4 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.273714:0:188053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ba expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.273724:0:188053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ba expref: 11 pid: 188049 timeout: 9246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572393.273733:0:188053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:188053:1875444584387072:192.168.202.57@tcp:104: 00000100:00100000:3.0:1788572393.273794:0:188053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572393.277032:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572393.277121:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569528832 00000100:00100000:0.0:1788572393.277131:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569528832 00010000:00010000:0.0:1788572393.277183:0:43930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 5/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ba expref: 12 pid: 188049 timeout: 9246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572393.277227:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12905 00000100:00100000:0.0:1788572393.277236:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a04f36050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2398:x1875444569528832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572393.277251:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572393.277258:0:43930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 5/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ba expref: 12 pid: 188049 timeout: 9246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.277275:0:43930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ba expref: 12 pid: 188049 timeout: 9246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.277298:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e590b95f500) 00010000:00010000:0.0:1788572393.277303:0:43930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcec00/0x265cfe11109be9eb lrc: 3/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be9e4 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.277314:0:43930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcec00/0x265cfe11109be9eb lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109be9e4 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.277322:0:43930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcec00/0x265cfe11109be9eb lrc: 4/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109be9e4 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.277362:0:43930:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcec00/0x265cfe11109be9eb lrc: 4/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be9e4 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572393.277375:0:43930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:43930:1875444584387200:0@lo:105: 00000100:00100000:0.0:1788572393.277418:0:43930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572393.277451:0:43930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572393.277719:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584387200 00000100:00100000:3.0:1788572393.277724:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584387200 00010000:00010000:2.0:1788572393.277968:0:188053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109be418 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ba expref: 12 pid: 188049 timeout: 9246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572393.277991:0:188053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:188053:1875444584387072:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572393.278017:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcec00/0x265cfe11109be9eb lrc: 4/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be9e4 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.278028:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e590b95f500) 00010000:00010000:2.0:1788572393.278030:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.278033:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcec00, rc 0) 00000100:00100000:2.0:1788572393.278083:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584386944:12345-0@lo:101:mdt00_000.0 Request processed in 4461us (4638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572393.278090:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1788572393.278134:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584386944:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788572393.278166:0:188048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 4/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.278176:0:188048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 4/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572393.278223:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5399 00000100:00100000:3.0:1788572393.278233:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:43930:x1875444584387200:12345-0@lo:105: 00010000:00010000:3.0:1788572393.278243:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 5/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.278252:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 5/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.278260:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 5/0,1 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.278272:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 5/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.278278:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 6/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.278285:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 6/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.278312:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a4117e400) 00000100:00100000:3.0:1788572393.279055:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:43930:x1875444584387200:12345-0@lo:105: Request processed in 820us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572393.279063:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5399 00000100:00100000:3.0:1788572393.279103:0:43930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:43930:1875444584387200:0@lo:105: 00010000:00010000:3.0:1788572393.279118:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572393.279176:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a04f36050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2398:x1875444569528832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1939us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572393.279184:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12905 00010000:00010000:2.0:1788572393.279849:0:188048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.279861:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572393.279885:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x2:0x0] 00010000:00010000:2.0:1788572393.279927:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.279934:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.279944:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572393.279963:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584387328:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1788572393.280000:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572393.280033:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590d7b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572393.280219:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584387328 00000100:00100000:0.0:1788572393.280225:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584387328 00000100:00100000:0.0:1788572393.280273:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1788572393.280282:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188048:x1875444584387328:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788572393.280300:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572393.280318:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109be9f9 lrc: 2/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109be9f2 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.280360:0:189111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109be9f9 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109be9f2 expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.280375:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109be9f9 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be9f2 expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.280383:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0xf7117594 (ffff8e59019b4100) 00010000:00010000:0.0:1788572393.280386:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572393.280390:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117f800, rc 0) 00000100:00100000:0.0:1788572393.280435:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:188048:x1875444584387328:12345-0@lo:101:mdt00_000.0 Request processed in 154us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572393.280441:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1788572393.280939:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584387328:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788572393.280955:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be9f9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.280964:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be9f9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572393.280984:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x2:0x0] 00000100:00100000:3.0:1788572393.281020:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584387456:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572393.281053:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572393.281079:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572393.281123:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584387456 00000100:00100000:2.0:1788572393.281128:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584387456 00000100:00100000:2.0:1788572393.281176:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1788572393.281184:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:188048:x1875444584387456:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572393.281251:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:188048:x1875444584387456:12345-0@lo:1000:mdt00_000.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572393.281259:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1788572393.281351:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584387456:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572393.281391:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584387584:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572393.281415:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572393.281436:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572393.281694:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584387584 00000100:00100000:2.0:1788572393.281707:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584387584 00000100:00100000:2.0:1788572393.281738:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1788572393.281746:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:188048:x1875444584387584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572393.281976:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:188048:x1875444584387584:12345-0@lo:1000:mdt00_000.0 Request processed in 231us (559us total) trans 0 rc 1/1 00000100:00100000:2.0:1788572393.281983:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1788572393.282046:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584387584:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788572393.282097:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.282106:0:188048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.282114:0:188048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572393.282128:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584387712:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1788572393.282166:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572393.282190:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31dc2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572393.282230:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584387712 00000100:00100000:0.0:1788572393.282235:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584387712 00000100:00100000:0.0:1788572393.282268:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1788572393.282275:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:188048:x1875444584387712:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788572393.282284:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572393.282299:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bea07 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bea00 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.282319:0:189111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bea07 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bea00 expref: 10 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.282340:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bea07 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bea00 expref: 10 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.282353:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e59019b4d00) 00010000:00010000:0.0:1788572393.282356:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572393.282359:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117f000, rc 0) 00000100:00100000:0.0:1788572393.282397:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:188048:x1875444584387712:12345-0@lo:101:mdt00_000.0 Request processed in 122us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572393.282403:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1788572393.282593:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:188048:1875444584387712:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788572393.282607:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.282617:0:188048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.282638:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.282645:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.282652:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572393.283103:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x24000272a:0x1:0x0].2, 424 off34288 00000040:00080000:3.0:1788572393.283166:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027502:0x1:0x0].2, 504 off34512 00000004:00080000:3.0:1788572393.283173:0:188048:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a31dc2b40 with version 5 00000004:00080000:0.0:1788572393.283472:0:188074:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e590639b300 version 5 rpc_version 5 00000020:00100000:0.0:1788572393.283524:0:188074:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572393.283534:0:188074:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36eab480 x1875444584387968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572393.283551:0:188074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584387968:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572393.283599:0:188074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572393.283623:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a24cdff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572393.283678:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584387968 00000100:00100000:2.0:1788572393.283684:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584387968 00000100:00100000:2.0:1788572393.283735:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1788572393.283744:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a73450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:188074:x1875444584387968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788572393.284283:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a73450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:188074:x1875444584387968:12345-0@lo:1000:osp_up0-1.0 Request processed in 539us (682us total) trans 347892350984 rc 0/0 00000100:00100000:2.0:1788572393.284291:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1788572393.285685:0:188074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584387968:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1788572393.285963:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788572393.285987:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.285997:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286004:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286011:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572393.286015:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286023:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286038:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e590430c500) 00010000:00010000:3.0:1788572393.286042:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572393.286047:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 2/0,0 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286054:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bea0e lrc: 0/0,0 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286077:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286085:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286091:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286162:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788572393.286177:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x2:0x0] 00010000:00010000:3.0:1788572393.286183:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286190:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.286197:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.286227:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572393.286234:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.286241:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce800 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:1.0:1788572393.286245:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.286253:0:82817:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.286285:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.286290:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572393.286323:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 1/0,0 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572393.286417:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584388096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572393.286474:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572393.286605:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584388096 00000100:00100000:0.0:1788572393.286612:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584388096 00000100:00100000:0.0:1788572393.286662:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4664 00000100:00100000:0.0:1788572393.286670:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3642:x1875444584388096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572393.286683:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572393.286707:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bea07 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bea00 expref: 11 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572393.286720:0:152004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x0 (ffff8e59019b4d00) 00010000:00010000:0.0:1788572393.286731:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572393.286908:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3642:x1875444584388096:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572393.286915:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4664 00000100:00100000:2.0:1788572393.286979:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584388096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572393.287042:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dce800/0x265cfe11109bea00 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bea07 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.287057:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572393.287061:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 4/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.287067:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e400 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:1.0:1788572393.287072:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 5/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572393.287080:0:82817:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 5/0,0 mode: CW/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.287099:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 4/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.287105:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572393.287132:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 3/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.287150:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.287151:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572393.287153:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572393.287186:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572393.287196:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584388224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572393.287225:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572393.287286:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584388224 00000100:00100000:1.0:1788572393.287290:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584388224 00000100:00100000:1.0:1788572393.287434:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4665 00000100:00100000:1.0:1788572393.287444:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3644:x1875444584388224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572393.287453:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572393.287466:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcec00/0x265cfe11109be9eb lrc: 0/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be9e4 expref: 10 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572393.287502:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e590b95f500) 00010000:00010000:1.0:1788572393.287506:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572393.287539:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584388224:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (313us total) trans 0 rc 0/0 00010000:00010000:3.0:1788572393.287636:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572393.287643:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117e400/0x265cfe11109be9e4 lrc: 0/0,0 mode: --/CW res: [0x200027501:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109be9eb expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572393.287668:0:188048:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x2:0x0] 00010000:00010000:3.0:1788572393.287676:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be9f9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.287683:0:188048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109be9f9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572393.287780:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+116:162685:x1875444569528704:12345-192.168.202.57@tcp:36:rm.0 Request processed in 14732us (16098us total) trans 21474837548 rc 0/0 00000100:00100000:3.0:1788572393.287787:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1157 00010000:00010000:0.0:1788572393.287839:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572393.289642:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584388224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572393.290738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572393.291013:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569528960 00000100:00100000:3.0:1788572393.291020:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569528960 00000100:00100000:3.0:1788572393.291081:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1158 00000100:00100000:3.0:1788572393.291091:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:162685:x1875444569528960:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572393.291112:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572393.291132:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bea15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb49a expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291204:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291220:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291230:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291252:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291260:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291266:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291367:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf200/0x265cfe11109bea2a lrc: 3/1,0 mode: --/PR res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291377:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf200/0x265cfe11109bea2a lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291384:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf200/0x265cfe11109bea2a lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572393.291422:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1788572393.291425:0:196070:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572393.291444:0:196070:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf200/0x265cfe11109bea2a lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291453:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291459:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291465:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291473:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572393.291518:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291527:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291540:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572393.291543:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572393.291547:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291553:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bea1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291566:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291571:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291577:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291582:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572393.291584:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291590:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291600:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8e590430ca00) 00010000:00010000:3.0:1788572393.291602:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572393.291605:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291610:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bea23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291641:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bea15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb49a expref: 13 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291655:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf200/0x265cfe11109bea2a lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb49a expref: 12 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572393.291663:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e590b95f500) 00010000:00010000:3.0:1788572393.291665:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572393.291668:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf200, rc 0) 00000100:00100000:3.0:1788572393.292204:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:162685:x1875444569528960:12345-192.168.202.57@tcp:101:rm.0 Request processed in 1111us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572393.292212:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1158 00000100:00100000:1.0:1788572393.292426:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4665 00000100:00100000:0.0:1788572393.295621:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572393.295872:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569529216 00000100:00100000:1.0:1788572393.295883:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569529216 00000100:00100000:1.0:1788572393.295988:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 34 00000100:00100000:1.0:1788572393.295999:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:162685:x1875444569529216:12345-192.168.202.57@tcp:35:rm.0 00000100:00100000:1.0:1788572393.296279:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:162685:x1875444569529216:12345-192.168.202.57@tcp:35:rm.0 Request processed in 281us (666us total) trans 347892350985 rc 0/0 00000100:00100000:1.0:1788572393.296288:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 34 00000100:00100000:0.0:1788572393.298671:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572393.298957:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569529472 00000100:00100000:2.0:1788572393.298967:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569529472 00000100:00100000:2.0:1788572393.299061:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1159 00000100:00100000:2.0:1788572393.299072:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:162685:x1875444569529472:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572393.299130:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788572393.299171:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf200/0x265cfe11109bea2a lrc: 0/0,0 mode: --/PR res: [0x200027501:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb49a expref: 13 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299199:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf000/0x265cfe11109be74b lrc: 0/0,0 mode: --/CR res: [0x200027501:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb470 expref: 12 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299214:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e590b95f500) 00010000:00010000:2.0:1788572393.299229:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fa00/0x265cfe11109be3ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3b3 expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299238:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:2.0:1788572393.299242:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572393.299263:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299278:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299288:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299302:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299309:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299316:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299434:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 3/0,1 mode: --/EX res: [0x200027501:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299444:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.299451:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572393.300116:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788572393.300134:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300152:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300159:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300165:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.300170:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300177:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300188:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0x0 (ffff8e5a02ffb200) 00010000:00010000:2.0:1788572393.300190:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572393.300194:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 2/0,0 mode: --/EX res: [0x200027501:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300199:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bea3f lrc: 0/0,0 mode: --/EX res: [0x200027501:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300218:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300224:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300229:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300234:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572393.300236:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300246:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300253:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:2.0:1788572393.300255:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572393.300258:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300262:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109bea31 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572393.300272:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b356fd23 reply state 00000000e850d68d transno 347892350986 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300282:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572393.300289:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8e5a02ffb000) 00010000:00010000:2.0:1788572393.300290:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572393.300293:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572393.300378:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:162685:x1875444569529472:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1306us (1713us total) trans 347892350986 rc 0/0 00000100:00100000:2.0:1788572393.300386:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1159 00000100:00100000:2.0:1788572393.343979:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584388352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572393.344055:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572393.344171:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584388352 00000100:00100000:1.0:1788572393.344180:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584388352 00000100:00100000:1.0:1788572393.344249:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6362 00000100:00100000:1.0:1788572393.344260:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584388352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572393.344293:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572393.344359:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584388352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572393.344367:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6362 00000100:00100000:1.0:1788572393.344410:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584388352:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572393.344607:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788572394.044683:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572395.068731:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572395.900682:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584388480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572395.900794:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572395.900861:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584388480 00000100:00100000:2.0:1788572395.900869:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584388480 00000100:00100000:2.0:1788572395.900920:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1788572395.900929:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584388480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572395.900962:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446014976 avail 1299775488 00000100:00100000:2.0:1788572395.901007:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584388480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572395.901014:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1788572395.901060:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584388480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572395.901518:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584388736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.901556:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.901587:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584389248:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.901613:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.901631:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584389760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.901656:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.901677:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572395.901682:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584388864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.901704:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.901730:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584389376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.901765:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.901785:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584389888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.901808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.901840:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584388736 00000100:00100000:3.0:1788572395.901845:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584388736 00000100:00100000:3.0:1788572395.901876:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788572395.901884:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584388736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.901921:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584388736:12345-0@lo:400:kworker.0 Request processed in 37us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.901928:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788572395.901958:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584389248 00000100:00100000:3.0:1788572395.901962:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584389248 00000100:00100000:3.0:1788572395.901997:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584389376 00000100:00100000:3.0:1788572395.902000:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584389376 00000100:00100000:3.0:1788572395.902019:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584389888 00000100:00100000:3.0:1788572395.902021:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584389888 00000100:00100000:3.0:1788572395.902041:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7772 00000100:00100000:3.0:1788572395.902048:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584389248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902080:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584389248:12345-0@lo:400:kworker.0 Request processed in 33us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.902086:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7772 00000100:00100000:3.0:1788572395.902097:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7773 00000100:00100000:3.0:1788572395.902104:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584389376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902132:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584389376:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.902138:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7773 00000100:00100000:3.0:1788572395.902147:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7774 00000100:00100000:3.0:1788572395.902153:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584389888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902177:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584389888:12345-0@lo:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.902183:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7774 00000100:00100000:3.0:1788572395.902210:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584389760 00000100:00100000:3.0:1788572395.902214:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584389760 00000100:00100000:3.0:1788572395.902241:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584388864 00000100:00100000:3.0:1788572395.902244:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584388864 00000100:00100000:3.0:1788572395.902271:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788572395.902278:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584389760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902309:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584389760:12345-0@lo:400:kworker.0 Request processed in 31us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.902315:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788572395.902328:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788572395.902334:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584388864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902360:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584388864:12345-0@lo:400:kworker.0 Request processed in 27us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.902365:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:3.0:1788572395.902386:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572395.902390:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572395.902392:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572395.902394:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572395.902415:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584388992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.902459:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584389504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902504:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.902522:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902541:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.902562:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788572395.902567:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584388608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572395.902587:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.902602:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584389120:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902618:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.902631:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584389632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902648:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.902662:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902680:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572395.902702:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584390016 00000100:00100000:3.0:1788572395.902706:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584390016 00000100:00100000:3.0:1788572395.902735:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7775 00000100:00100000:3.0:1788572395.902740:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584390016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902774:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584390016:12345-0@lo:400:kworker.0 Request processed in 32us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.902780:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7775 00000100:00100000:3.0:1788572395.902800:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584388992 00000100:00100000:3.0:1788572395.902803:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584388992 00000100:00100000:3.0:1788572395.902821:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584389504 00000100:00100000:3.0:1788572395.902823:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584389504 00000100:00100000:3.0:1788572395.902832:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584389632 00000100:00100000:3.0:1788572395.902835:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584389632 00000100:00100000:3.0:1788572395.902849:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584390144 00000100:00100000:3.0:1788572395.902851:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584390144 00000100:00100000:3.0:1788572395.902861:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788572395.902866:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584388992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902896:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584388992:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.902901:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788572395.902913:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788572395.902919:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584389504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902945:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584389504:12345-0@lo:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.902951:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788572395.902961:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788572395.902967:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584389632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.902993:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584389632:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.902999:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788572395.903010:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788572395.903015:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584390144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903042:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584390144:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572395.903048:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:3.0:1788572395.903063:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572395.903066:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572395.903068:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572395.903097:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584388864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903110:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584389376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903119:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584389888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903127:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584388736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903136:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584389248:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903145:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584389760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903180:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584389632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903188:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903211:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584388992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903221:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584389504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572395.903229:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584390016:0@lo:400:kworker.0 00000100:00100000:2.0:1788572395.903654:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584388608 00000100:00100000:2.0:1788572395.903660:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584388608 00000100:00100000:2.0:1788572395.903688:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584389120 00000100:00100000:2.0:1788572395.903691:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584389120 00000100:00100000:2.0:1788572395.903704:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1788572395.903712:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:3641:x1875444584388608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572395.903742:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445621760 avail 1299382272 00000100:00100000:2.0:1788572395.903809:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:3641:x1875444584388608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572395.903815:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1788572395.903830:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1788572395.903836:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584389120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572395.903865:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584389120:12345-0@lo:400:kworker.0 Request processed in 30us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572395.903871:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1788572395.903916:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584388608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572395.903926:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584389120:0@lo:400:kworker.0 00010000:00010000:1.0:1788572396.093395:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572396.414265:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584390272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572396.414347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572396.414408:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584390272 00000100:00100000:1.0:1788572396.414417:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584390272 00000100:00100000:1.0:1788572396.414468:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6363 00000100:00100000:1.0:1788572396.414496:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584390272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572396.414534:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572396.414593:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584390272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572396.414603:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6363 00000100:00100000:1.0:1788572396.414670:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584390272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572396.417354:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:2.0:1788572396.417436:0:188080:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 9149411954898ns, next at 9150411951988ns, rc = 0 00000100:00100000:2.0:1788572396.417536:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584390528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572396.417602:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572396.417658:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584390528 00000100:00100000:2.0:1788572396.417666:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584390528 00000100:00100000:2.0:1788572396.417710:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6364 00000100:00100000:2.0:1788572396.417719:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584390528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572396.417750:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572396.417791:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584390528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572396.417798:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6364 00000100:00100000:2.0:1788572396.417839:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584390528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572396.425396:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584390400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572396.425507:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572396.427331:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584390400 00000100:00100000:3.0:1788572396.427346:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584390400 00000100:00100000:3.0:1788572396.427404:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6365 00000100:00100000:3.0:1788572396.427414:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584390400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572396.427439:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572396.427531:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584390400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572396.427538:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6365 00000100:00100000:0.0:1788572396.427663:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584390400:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788572396.447699:0:188042:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00010000:00010000:2.0:1788572396.447753:0:188042:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109be9f9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572396.447780:0:188042:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109be9f9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.447827:0:188042:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 2/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109be9f9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.447834:0:188042:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572396.447858:0:188042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7ae00/0x265cfe11109be9f2 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109be9f9 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572396.447875:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837548 is committed 00000004:00080000:2.0:1788572396.447932:0:188042:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000004:00080000:2.0:1788572396.447942:0:188042:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000100:00100000:2.0:1788572396.448043:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584390656:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1788572396.448128:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572396.448187:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584390656 00000100:00100000:2.0:1788572396.448194:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584390656 00000100:00100000:2.0:1788572396.448259:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4666 00000100:00100000:2.0:1788572396.448269:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3642:x1875444584390656:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1788572396.448284:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572396.448305:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109be9f9 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be9f2 expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.448319:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x2:0x0].0xf7117594 (ffff8e59019b4100) 00010000:00010000:2.0:1788572396.448331:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572396.448364:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3642:x1875444584390656:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 97us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572396.448371:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4666 00000100:00100000:2.0:1788572396.448422:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584390656:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1788572396.449100:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584391040:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572396.449136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572396.449158:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584391552:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572396.449179:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572396.449198:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572396.449215:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584391168:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572396.449237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572396.449267:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584391680:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572396.449289:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572396.449321:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584391040 00000100:00100000:0.0:1788572396.449325:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584391040 00000100:00100000:0.0:1788572396.449359:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584391552 00000100:00100000:0.0:1788572396.449362:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584391552 00000100:00100000:0.0:1788572396.449379:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584391168 00000100:00100000:0.0:1788572396.449381:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584391168 00000100:00100000:0.0:1788572396.449396:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584391680 00000100:00100000:0.0:1788572396.449399:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584391680 00000100:00100000:0.0:1788572396.449418:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22667 00000100:00100000:0.0:1788572396.449425:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584391040:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1788572396.449447:0:177559:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:579 count 1 00002000:00010000:0.0:1788572396.449497:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572396.449504:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449518:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:0.0:1788572396.449522:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572396.449529:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449545:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449555:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449562:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449579:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572396.449728:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584391040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 303us (591us total) trans 4294975678 rc 0/0 00000100:00100000:0.0:1788572396.449738:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22667 00000100:00100000:0.0:1788572396.449754:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22668 00000100:00100000:0.0:1788572396.449761:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584391552:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1788572396.449774:0:177559:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:587 count 1 00002000:00010000:0.0:1788572396.449788:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572396.449793:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449801:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24b:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:0.0:1788572396.449804:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572396.449808:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449818:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449826:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449832:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449856:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572396.449924:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584391552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 164us (744us total) trans 4294975679 rc 0/0 00000100:00100000:0.0:1788572396.449930:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22668 00000100:00100000:0.0:1788572396.449942:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22669 00000100:00100000:0.0:1788572396.449949:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584391168:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1788572396.449961:0:177559:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:585 count 1 00002000:00010000:0.0:1788572396.449976:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572396.449981:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.449989:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x249:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:0.0:1788572396.449993:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572396.449997:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450007:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450015:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450022:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450036:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572396.450093:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584391168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 145us (854us total) trans 4294975680 rc 0/0 00000100:00100000:0.0:1788572396.450099:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22669 00000100:00100000:0.0:1788572396.450111:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22670 00000100:00100000:0.0:1788572396.450116:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584391680:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1788572396.450127:0:177559:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:586 count 1 00002000:00010000:0.0:1788572396.450140:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572396.450144:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450151:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24a:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:0.0:1788572396.450154:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572396.450158:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450167:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450174:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450181:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450195:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788572396.450244:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572396.450252:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450262:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e600 already unused, calling callback (ffffffffc0c114f0) 00000100:00100000:0.0:1788572396.450268:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584391680:12345-0@lo:6:osp-syn-1-1.0 Request processed in 152us (977us total) trans 4294975681 rc 0/0 00010000:00010000:2.0:1788572396.450268:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572396.450275:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22670 00010000:00010000:2.0:1788572396.450280:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450302:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450310:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ad88324/0x265cfe11109bea46 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450331:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572396.450334:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450340:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572396.450343:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450349:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450357:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450363:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f09fca3/0x265cfe11109bea4d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450372:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572396.450375:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.450382:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572396.450384:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450510:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572396.450516:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450528:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572396.450532:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450539:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450550:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450556:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7775266/0x265cfe11109bea5b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.450569:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572396.450571:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572396.450573:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572396.450579:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572396.450612:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a36eaad80/2, rc 0, transno 4294975680 00000100:00100000:0.0:1788572396.450625:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584391168:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1788572396.450636:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a84e300/2, rc 0, transno 4294975681 00000100:00100000:0.0:1788572396.450639:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584391680:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1788572396.450649:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a36ea8700/2, rc 0, transno 4294975678 00000100:00100000:0.0:1788572396.450653:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584391040:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1788572396.450662:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a84df80/2, rc 0, transno 4294975679 00000100:00100000:0.0:1788572396.450667:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584391552:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572396.450742:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584390784:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572396.450774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572396.450799:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584391296:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572396.450818:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572396.450837:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584391808:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572396.450856:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572396.450865:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572396.450875:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00010000:00010000:2.0:1788572396.450879:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572396.450880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584390912:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1788572396.450887:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bea54 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572396.450900:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572396.450901:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572396.450902:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572396.450904:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572396.450914:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584391424:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1788572396.450915:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584390784 00000100:00100000:2.0:1788572396.450920:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584390784 00000100:00100000:0.0:1788572396.450931:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572396.450945:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584391936:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1788572396.450948:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584391296 00000100:00100000:2.0:1788572396.450951:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584391296 00000100:00100000:0.0:1788572396.450965:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572396.450965:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584391808 00000100:00100000:2.0:1788572396.450968:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584391808 00000100:00100000:2.0:1788572396.450981:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584390912 00000100:00100000:2.0:1788572396.450984:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584390912 00000100:00100000:0.0:1788572396.450987:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584391424 00000100:00100000:0.0:1788572396.450990:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584391424 00000100:00100000:2.0:1788572396.450996:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584391936 00000100:00100000:2.0:1788572396.450998:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584391936 00000100:00100000:0.0:1788572396.451009:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22671 00000100:00100000:2.0:1788572396.451014:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22672 00000100:00100000:0.0:1788572396.451016:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:3643:x1875444584390784:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1788572396.451019:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+14:3643:x1875444584391296:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1788572396.451030:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:584 count 1 00002000:00080000:2.0:1788572396.451030:0:43926:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:582 count 1 00002000:00010000:0.0:1788572396.451048:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788572396.451048:0:43926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572396.451054:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.451054:0:43926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.451067:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x248:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:2.0:1788572396.451067:0:43926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x246:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:0.0:1788572396.451071:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572396.451071:0:43926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572396.451077:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.451077:0:43926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.451089:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.451089:0:43926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.451098:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.451099:0:43926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.451107:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.451107:0:43926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.451121:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572396.452037:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452060:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452068:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452074:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452079:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452087:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452101:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x679fc7b1 (ffff8e5a122fb600) 00010000:00010000:1.0:1788572396.452104:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452109:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452115:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109be465 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452135:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452141:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452148:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452153:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452156:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452162:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452169:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x94c295fa (ffff8e590b95f300) 00010000:00010000:1.0:1788572396.452171:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452174:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452180:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031a00/0x265cfe11109be488 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452193:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452199:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452215:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452220:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452223:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452233:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452240:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xc1e56442 (ffff8e590b95f200) 00010000:00010000:1.0:1788572396.452242:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452245:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452251:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030200/0x265cfe11109be4ab lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452264:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452269:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452274:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452279:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452281:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452287:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452293:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xef08328a (ffff8e590b95f100) 00010000:00010000:1.0:1788572396.452296:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452299:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452305:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031000/0x265cfe11109be4ce lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452315:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452320:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452326:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452330:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452333:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452339:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452345:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x1c2b00d3 (ffff8e5a122fbe00) 00010000:00010000:1.0:1788572396.452347:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452350:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452356:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109be4f1 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452365:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452371:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452377:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452382:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452385:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452391:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452398:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x494dcf1b (ffff8e590b95f600) 00010000:00010000:1.0:1788572396.452400:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452403:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452408:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109be514 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452422:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452428:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452434:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452438:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452441:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452451:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452458:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x76709d63 (ffff8e5a0a54be00) 00010000:00010000:1.0:1788572396.452460:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452463:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452468:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e200/0x265cfe11109be537 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452503:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452510:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452515:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452521:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452523:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452529:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452537:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xa3936bac (ffff8e5a0a54b000) 00010000:00010000:1.0:1788572396.452539:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452542:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452548:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616f600/0x265cfe11109be55a lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452558:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452564:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452570:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452575:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452577:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452583:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452590:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xd0b639f4 (ffff8e5a0a54bd00) 00010000:00010000:1.0:1788572396.452592:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452595:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452601:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e800/0x265cfe11109be57d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452611:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452617:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452623:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452628:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452631:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452636:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452643:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xfdd9083c (ffff8e590b95f800) 00010000:00010000:1.0:1788572396.452645:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452648:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452653:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109be5a0 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452663:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452669:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452675:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452680:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1616e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452683:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452693:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452700:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x1b7026cc (ffff8e5a0a54b800) 00010000:00010000:1.0:1788572396.452702:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452705:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452711:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1616e400/0x265cfe11109be5c3 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452722:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452727:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452733:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452739:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452742:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452748:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452755:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x3e3e6f26 (ffff8e590b95f400) 00010000:00010000:1.0:1788572396.452757:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452760:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452767:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109be5e6 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452777:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452783:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452789:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452794:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452797:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452804:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452811:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x610cb780 (ffff8e5a122fb700) 00010000:00010000:1.0:1788572396.452813:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452815:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452820:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109be609 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452831:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452837:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452843:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452848:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452850:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452856:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452862:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x83daffd9 (ffff8e5a02ffb300) 00010000:00010000:1.0:1788572396.452864:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452867:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452872:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109be62c lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452883:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452889:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452895:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452899:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452902:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452912:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452919:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xa6a94833 (ffff8e590430c900) 00010000:00010000:1.0:1788572396.452921:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452924:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452929:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109be64f lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452940:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452946:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452951:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452956:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.452959:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452964:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452971:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xc977908d (ffff8e5a122fb500) 00010000:00010000:1.0:1788572396.452973:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.452976:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452982:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109be672 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452991:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.452997:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453020:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453026:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453029:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453035:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453043:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xec45d8e7 (ffff8e5a02ffba00) 00010000:00010000:1.0:1788572396.453045:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453048:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453053:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109be695 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453064:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453071:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453077:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453082:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453085:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453090:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453097:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xf142140 (ffff8e590430c200) 00010000:00010000:1.0:1788572396.453099:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453102:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453108:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce400/0x265cfe11109be6b8 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453117:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453123:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453129:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453134:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453136:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453145:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453152:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x31e2699a (ffff8e5a122fb000) 00010000:00010000:1.0:1788572396.453154:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453157:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453162:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109be6db lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453173:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453180:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453186:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453191:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453194:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453200:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453219:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x54b0b1f4 (ffff8e59019b4600) 00010000:00010000:1.0:1788572396.453221:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453224:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453230:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109be6fe lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453241:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453246:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453252:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453257:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453260:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453266:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453274:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x83daffd9 (ffff8e5a02ffb300) 00010000:00010000:1.0:1788572396.453276:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453279:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453285:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109be791 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453304:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453311:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453318:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453323:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453326:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453332:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453339:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xc1e56442 (ffff8e590b95f200) 00010000:00010000:1.0:1788572396.453341:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453344:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453349:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109be7ad lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453362:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453369:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453375:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453379:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453382:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453391:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453397:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xa3936bac (ffff8e5a0a54b000) 00010000:00010000:1.0:1788572396.453400:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453402:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453408:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109be7c9 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453424:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453429:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453434:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453438:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453441:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453446:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453451:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x31e2699a (ffff8e5a122fb000) 00010000:00010000:1.0:1788572396.453453:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453455:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453461:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109be7e5 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453473:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453506:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453512:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453517:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453519:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453525:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453533:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xef08328a (ffff8e590b95f100) 00010000:00010000:1.0:1788572396.453535:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453537:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453542:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109be801 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453554:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453560:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453566:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453570:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453572:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453579:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453585:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xec45d8e7 (ffff8e5a02ffba00) 00010000:00010000:1.0:1788572396.453587:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453589:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453594:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00031200/0x265cfe11109be81d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453606:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453613:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453617:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453622:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ec00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453625:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453635:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453642:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x1c2b00d3 (ffff8e5a122fbe00) 00010000:00010000:1.0:1788572396.453644:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453647:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453653:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109be839 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453667:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453673:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453679:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453684:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453687:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453693:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453700:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xc977908d (ffff8e5a122fb500) 00010000:00010000:1.0:1788572396.453702:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453704:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453711:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109be855 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453723:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453728:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453733:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453738:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453740:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453746:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453753:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x679fc7b1 (ffff8e5a122fb600) 00010000:00010000:1.0:1788572396.453755:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453757:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453762:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109be871 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453775:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453781:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453787:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453792:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453794:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453800:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453807:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xd0b639f4 (ffff8e5a0a54bd00) 00010000:00010000:1.0:1788572396.453809:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453811:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453817:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce200/0x265cfe11109be88d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453830:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453836:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453841:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453845:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453847:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453855:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453862:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xfdd9083c (ffff8e590b95f800) 00010000:00010000:1.0:1788572396.453864:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453867:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453872:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109be8a9 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453886:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453892:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453897:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453902:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453904:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453910:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453916:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x3e3e6f26 (ffff8e590b95f400) 00010000:00010000:1.0:1788572396.453919:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453921:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453927:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109be8c5 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453939:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453944:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453950:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453955:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.453957:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453963:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453969:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x54b0b1f4 (ffff8e59019b4600) 00010000:00010000:1.0:1788572396.453971:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.453974:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453979:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109be8e1 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453992:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.453998:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454004:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454009:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.454012:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454017:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454023:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xf142140 (ffff8e590430c200) 00010000:00010000:1.0:1788572396.454025:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.454028:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454034:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a00030c00/0x265cfe11109be8fd lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454050:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454056:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454062:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454066:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.454069:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454079:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454087:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x94c295fa (ffff8e590b95f300) 00010000:00010000:1.0:1788572396.454090:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.454092:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454099:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109be919 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454114:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454120:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454126:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454130:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.454133:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454139:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454146:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x1b7026cc (ffff8e5a0a54b800) 00010000:00010000:1.0:1788572396.454148:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.454152:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454157:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109be935 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454170:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454176:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454181:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454187:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.454189:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454196:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454217:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0xa6a94833 (ffff8e590430c900) 00010000:00010000:1.0:1788572396.454219:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.454223:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454228:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109be951 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454243:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454249:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454255:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454260:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ac00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.454262:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454267:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454275:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x494dcf1b (ffff8e590b95f600) 00010000:00010000:1.0:1788572396.454277:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.454280:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454286:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ac00/0x265cfe11109be96d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454299:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454304:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454310:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454314:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.454316:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454325:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454331:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x610cb780 (ffff8e5a122fb700) 00010000:00010000:1.0:1788572396.454333:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.454335:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454340:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109be989 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454351:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454356:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454361:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454366:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572396.454369:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454374:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454380:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1:0x0].0x76709d63 (ffff8e5a0a54be00) 00010000:00010000:1.0:1788572396.454382:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572396.454385:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454390:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109be9a5 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572396.454578:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22673 00000100:00100000:1.0:1788572396.454593:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3643:x1875444584391808:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1788572396.454620:0:43917:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:578 count 1 00002000:00010000:1.0:1788572396.454652:0:43917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572396.454659:0:43917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454673:0:43917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:1.0:1788572396.454677:0:43917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572396.454683:0:43917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454695:0:43917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454702:0:43917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572396.454709:0:43917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572396.457391:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584392064:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1788572396.457506:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572396.457590:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584392064 00000100:00100000:0.0:1788572396.457599:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584392064 00000100:00100000:0.0:1788572396.457649:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22674 00000100:00100000:0.0:1788572396.457659:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+14:3643:x1875444584390912:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1788572396.457688:0:177560:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:581 count 1 00002000:00010000:0.0:1788572396.457721:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572396.457729:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.457745:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x245:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:0.0:1788572396.457749:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572396.457756:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.457771:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.457783:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572396.457791:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.457860:0:43926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788572396.457875:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22675 00000100:00100000:3.0:1788572396.457884:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+14:3643:x1875444584391424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1788572396.457898:0:43925:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:583 count 1 00002000:00010000:3.0:1788572396.457915:0:43925:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572396.457919:0:43925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.457928:0:43925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x247:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:3.0:1788572396.457930:0:43925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572396.457934:0:43925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.457942:0:43925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.457950:0:43925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.457957:0:43925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.457973:0:43925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1788572396.458088:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+16:3643:x1875444584391296:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7067us (7267us total) trans 4294975682 rc 0/0 00000100:00100000:2.0:1788572396.458095:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22672 00000100:00100000:2.0:1788572396.458114:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22676 00000100:00100000:2.0:1788572396.458121:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584391936:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1788572396.458134:0:43926:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:580 count 1 00002000:00010000:2.0:1788572396.458149:0:43926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572396.458154:0:43926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458162:0:43926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x244:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:2.0:1788572396.458165:0:43926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x244:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572396.458170:0:43926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458179:0:43926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458185:0:43926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458192:0:43926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458217:0:43926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1788572396.458305:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+16:3643:x1875444584391936:12345-0@lo:6:osp-syn-1-1.0 Request processed in 184us (7338us total) trans 4294975684 rc 0/0 00000100:00100000:2.0:1788572396.458312:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22676 00000100:00100000:2.0:1788572396.458325:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22677 00000100:00100000:2.0:1788572396.458332:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584392064:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1788572396.458345:0:43926:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:579 count 1 00010000:00010000:2.0:1788572396.458589:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788572396.458598:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458609:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572396.458614:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458625:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458642:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458649:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6b84253/0x265cfe11109bea62 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458675:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572396.458678:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458684:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572396.458687:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458693:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458702:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.458709:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e514d65c/0x265cfe11109bea69 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572396.458768:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584391424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 884us (7833us total) trans 4294975683 rc 0/0 00000100:00100000:3.0:1788572396.458777:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22675 00010000:00010000:3.0:1788572396.458801:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572396.458808:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458814:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572396.458818:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458826:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458837:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458845:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572396.458848:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458854:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572396.458857:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458865:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458875:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458882:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572396.458885:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458896:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572396.458899:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458906:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458915:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458922:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bea7e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458936:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572396.458939:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458945:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572396.458948:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458955:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458963:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458970:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002d249d2/0x265cfe11109bea85 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.458983:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572396.458985:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572396.458987:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572396.459130:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572396.459132:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572396.459134:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572396.459140:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572396.459176:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a84d880/2, rc 0, transno 4294975683 00000100:00100000:2.0:1788572396.459183:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584391424:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1788572396.459196:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a84ca80/2, rc 0, transno 4294975684 00000100:00100000:2.0:1788572396.459199:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584391936:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1788572396.459219:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a84c380/2, rc 0, transno 4294975682 00000100:00100000:2.0:1788572396.459223:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584391296:0@lo:6:osp-syn-1-1.0 00002000:00010000:3.0:1788572396.460415:0:43926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572396.460427:0:43926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.460443:0:43926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x243:0x0].0x0 since=9149s v=(0 0) 00010000:00010000:3.0:1788572396.460447:0:43926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572396.460454:0:43926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.460469:0:43926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.460559:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572396.460628:0:43926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.460638:0:43926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572396.460669:0:43926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572396.460785:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572396.460792:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.460799:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572396.460803:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.460811:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.460831:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.460838:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bea8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.460856:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572396.460858:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572396.460859:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572396.460876:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584392064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2542us (3368us total) trans 38654705669 rc 0/0 00000100:00100000:3.0:1788572396.460883:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22677 00010000:00010000:1.0:1788572396.462297:0:43917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572396.462309:0:43917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5abfd8e/0x265cfe11109bea70 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.462405:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572396.462538:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584391808:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7947us (11676us total) trans 4294975685 rc 0/0 00000100:00100000:1.0:1788572396.462546:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22673 00010000:00010000:1.0:1788572396.462577:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572396.462906:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a84ea00/2, rc 0, transno 4294975685 00000100:00100000:2.0:1788572396.462914:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584391808:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1788572396.463555:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31cd3480/2, rc 0, transno 38654705669 00000100:00100000:2.0:1788572396.463570:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584392064:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1788572396.472996:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572396.473028:0:177560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e146b85/0x265cfe11109bea77 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572396.473255:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572396.473358:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584390912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15697us (22452us total) trans 4294975686 rc 0/0 00000100:00100000:0.0:1788572396.473369:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22674 00000100:00100000:0.0:1788572396.473516:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584390784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 22463us (22705us total) trans 4294975687 rc 0/0 00000100:00100000:0.0:1788572396.473524:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22671 00000004:00080000:2.0:1788572396.473550:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a36ea9180/2, rc 0, transno 4294975686 00000100:00100000:2.0:1788572396.473559:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584390912:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1788572396.473571:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a36ea9500/2, rc 0, transno 4294975687 00000100:00100000:2.0:1788572396.473575:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584390784:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572396.907274:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572396.907323:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572396.907363:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572396.907393:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572396.907454:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572396.907543:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569530112 00000100:00100000:0.0:1788572396.907553:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569530112 00000100:00100000:0.0:1788572396.907609:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569529984 00000100:00100000:0.0:1788572396.907613:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569529984 00000100:00100000:0.0:1788572396.907642:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7776 00000100:00100000:0.0:1788572396.907652:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569530112:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572396.907731:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569530112:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 81us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572396.907738:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7776 00000100:00100000:0.0:1788572396.907758:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7777 00000100:00100000:0.0:1788572396.907765:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569529984:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572396.907882:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569529856 00000100:00100000:1.0:1788572396.907886:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569529856 00000100:00100000:1.0:1788572396.907923:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569529728 00000100:00100000:1.0:1788572396.907925:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569529728 00000100:00100000:1.0:1788572396.907947:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 382 00000100:00100000:1.0:1788572396.907954:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569529856:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572396.907990:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569529856:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 36us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572396.907996:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 382 00000100:00100000:1.0:1788572396.908009:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 383 00000100:00100000:1.0:1788572396.908015:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2400:x1875444569529728:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572396.908041:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2400:x1875444569529728:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572396.908047:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 383 00000100:00100000:0.0:1788572396.908415:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569529984:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 649us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572396.908424:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7777 00000100:00100000:3.0:1788572396.909030:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569529600 00000100:00100000:3.0:1788572396.909036:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569529600 00000100:00100000:3.0:1788572396.909088:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 84 00000100:00100000:3.0:1788572396.909097:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569529600:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572396.909127:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569529600:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572396.909134:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 84 00000100:00080000:3.0:1788572396.909167:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572396.909172:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572396.909175:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572396.909177:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572397.116771:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572398.143645:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572398.460958:0:188078:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 9151455475420ns, next at 9152455472202ns, rc = 0 00000100:00100000:3.0:1788572398.461023:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572398.461046:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584392192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572398.461127:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572398.461272:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584392192 00000100:00100000:1.0:1788572398.461281:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584392192 00000100:00100000:1.0:1788572398.461350:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6366 00000100:00100000:1.0:1788572398.461360:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584392192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572398.461390:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572398.461435:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584392192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572398.461443:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6366 00000100:00080000:3.0:1788572398.461517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572398.461559:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584392192:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788572398.980386:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350986 is committed 00000001:00080000:1.0:1788572398.980405:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350984 is committed 00010000:00010000:0.0:1788572398.981305:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572398.981321:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572398.981329:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572398.981336:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572398.981341:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572398.981349:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572398.981368:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8e5a02ffb000) 00010000:00010000:0.0:1788572398.981371:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572398.981376:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572398.981383:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109bea38 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572399.164728:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.189909:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572400.319387:0:197404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80b: DNE: create remote dir, drop update rep from MDT0, fail MDT1 ========================================================== 21:39:59 (1788572399) 00000100:00100000:3.0:1788572400.409247:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572400.409336:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569530240 00000100:00100000:1.0:1788572400.409347:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569530240 00000100:00100000:1.0:1788572400.409433:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1160 00000100:00100000:1.0:1788572400.409444:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163266:x1875444569530240:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572400.409469:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572400.409525:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bea93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4a1 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.409603:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bea9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.409622:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bea9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.409639:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bea9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572400.409697:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572400.409700:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572400.409721:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bea9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.409748:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bea93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4a1 expref: 8 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.409767:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bea9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4a1 expref: 7 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.409777:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572400.409781:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572400.409786:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254a00, rc 0) 00000100:00100000:1.0:1788572400.409846:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:163266:x1875444569530240:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 404us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572400.409853:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1160 00000100:00080000:3.0:1788572400.410192:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572400.413895:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572400.413988:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569530368 00000100:00100000:0.0:1788572400.413998:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569530368 00000100:00100000:0.0:1788572400.414066:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1161 00000100:00100000:0.0:1788572400.414078:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:163266:x1875444569530368:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572400.414104:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572400.414129:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117ee00/0x265cfe11109beaa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4a8 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.414205:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.414221:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.414233:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.414249:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.414262:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.414268:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415034:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415046:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415052:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415057:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572400.415062:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415069:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415083:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572400.415086:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572400.415091:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415096:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beaa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415112:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415118:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415123:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415128:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572400.415131:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415147:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415154:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8e5a36aabe00) 00010000:00010000:1.0:1788572400.415156:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572400.415159:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415164:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109beaaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415200:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117ee00/0x265cfe11109beaa1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4a8 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415210:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572400.415212:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572400.415216:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117ee00/0x265cfe11109beaa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4a8 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.415225:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117ee00, rc 0) 00000100:00100000:1.0:1788572400.415296:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:163266:x1875444569530368:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1220us (1410us total) trans 0 rc 301/301 00000100:00100000:1.0:1788572400.415304:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1161 00000100:00100000:1.0:1788572400.422579:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572400.422663:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569530624 00000100:00100000:3.0:1788572400.422674:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569530624 00000100:00100000:3.0:1788572400.422743:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1162 00000100:00100000:3.0:1788572400.422763:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:163266:x1875444569530624:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:3.0:1788572400.422824:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572400.422853:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bea9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4a1 expref: 7 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.422873:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572400.422879:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572400.422962:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.422976:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.422987:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423002:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423009:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423017:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423655:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423671:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423680:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572400.423696:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db721820 reply state 0000000039e393ad transno 347892350987 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423706:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423713:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:3.0:1788572400.423716:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572400.423718:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788572400.423724:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1788572400.423733:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423740:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423747:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423753:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423759:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572400.423765:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423772:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423782:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572400.423784:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.423788:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423798:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beab6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572400.423808:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db721820 reply state 0000000039e393ad transno 347892350987 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423815:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.423822:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8e590430ca00) 00010000:00010000:3.0:1788572400.423824:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572400.423826:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788572400.423911:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163266:x1875444569530624:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 1158us (1342us total) trans 347892350987 rc 0/0 00000100:00100000:3.0:1788572400.423918:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1162 00000100:00100000:1.0:1788572401.020961:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584392320:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.021036:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572401.021084:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584392832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.021110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572401.021130:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584393344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.021156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572401.021179:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572401.021185:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584392448:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.021206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572401.021222:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584392960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.021241:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572401.021258:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584393472:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.021280:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572401.021326:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584392320 00000100:00100000:1.0:1788572401.021335:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584392320 00000100:00100000:0.0:1788572401.021645:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584392576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.021673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572401.021691:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584393088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.021709:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572401.021724:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584393600:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.021740:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572401.021756:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572401.021761:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584392704:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.021778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572401.021795:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584393216:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.021813:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572401.021829:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584393728:0@lo:400:kworker.0 00000100:00100000:3.0:1788572401.022328:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584393856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572401.022373:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.022403:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572401.022409:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584393984:0@lo:400:kworker.0 00000100:00100000:3.0:1788572401.022431:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572401.023429:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572401.023496:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584394112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572401.023673:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788572401.023685:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584392320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.024065:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584392320:12345-0@lo:400:kworker.0 Request processed in 381us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.024074:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788572401.024114:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584393344 00000100:00100000:1.0:1788572401.024121:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584393344 00000100:00100000:0.0:1788572401.024512:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572401.025699:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584392832 00000100:00100000:0.0:1788572401.025708:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584392832 00000100:00100000:0.0:1788572401.025764:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584392960 00000100:00100000:0.0:1788572401.025768:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584392960 00000100:00100000:0.0:1788572401.025789:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584393600 00000100:00100000:0.0:1788572401.025792:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584393600 00000100:00100000:0.0:1788572401.025810:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584393728 00000100:00100000:0.0:1788572401.025814:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584393728 00000100:00100000:0.0:1788572401.025839:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7778 00000100:00100000:0.0:1788572401.025860:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584392832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.025928:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584392832:12345-0@lo:400:kworker.0 Request processed in 81us (4816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.025935:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7778 00000100:00100000:0.0:1788572401.025952:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7779 00000100:00100000:0.0:1788572401.025958:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584392960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.025987:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584392960:12345-0@lo:400:kworker.0 Request processed in 29us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.025993:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7779 00000100:00100000:0.0:1788572401.026003:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7780 00000100:00100000:0.0:1788572401.026009:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584393600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.026042:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584393600:12345-0@lo:400:kworker.0 Request processed in 34us (4300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.026047:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7780 00000100:00100000:0.0:1788572401.026059:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7781 00000100:00100000:0.0:1788572401.026065:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584393728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.026088:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584393728:12345-0@lo:400:kworker.0 Request processed in 24us (4237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.026094:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7781 00000100:00100000:0.0:1788572401.026114:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584392448 00000100:00100000:0.0:1788572401.026117:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584392448 00000100:00100000:0.0:1788572401.026136:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584392576 00000100:00100000:0.0:1788572401.026139:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584392576 00000100:00100000:0.0:1788572401.026151:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584393088 00000100:00100000:0.0:1788572401.026153:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584393088 00000100:00100000:0.0:1788572401.026162:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584393216 00000100:00100000:0.0:1788572401.026165:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584393216 00000100:00100000:0.0:1788572401.026174:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584393984 00000100:00100000:0.0:1788572401.026176:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584393984 00000100:00100000:0.0:1788572401.026189:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788572401.026195:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584392448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.026226:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584392448:12345-0@lo:400:kworker.0 Request processed in 32us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.026233:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788572401.026244:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788572401.026249:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584392576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.026274:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584392576:12345-0@lo:400:kworker.0 Request processed in 26us (4600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.026280:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788572401.026291:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788572401.026311:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584393088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.026338:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584393088:12345-0@lo:400:kworker.0 Request processed in 28us (4627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.026355:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788572401.026367:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788572401.026372:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584393216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.026401:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584393216:12345-0@lo:400:kworker.0 Request processed in 30us (4587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.026407:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788572401.026419:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788572401.026425:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584393984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.026465:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584393984:12345-0@lo:400:kworker.0 Request processed in 40us (4032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.026470:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788572401.026658:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584393984:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.027672:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788572401.027685:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584393344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.027746:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584393344:12345-0@lo:400:kworker.0 Request processed in 65us (6588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.027752:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788572401.027783:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584393472 00000100:00100000:1.0:1788572401.027789:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584393472 00000100:00100000:1.0:1788572401.027812:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584392704 00000100:00100000:1.0:1788572401.027816:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584392704 00000100:00100000:1.0:1788572401.027830:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584393856 00000100:00100000:1.0:1788572401.027833:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584393856 00000100:00100000:1.0:1788572401.027842:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584394112 00000100:00100000:1.0:1788572401.027845:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584394112 00000100:00100000:1.0:1788572401.027856:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1788572401.027862:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584393472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.027897:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584393472:12345-0@lo:400:kworker.0 Request processed in 34us (6616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.027903:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1788572401.027915:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1788572401.027921:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584392704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.028284:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584392704:12345-0@lo:400:kworker.0 Request processed in 362us (6503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.028291:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1788572401.028317:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1788572401.028324:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3644:x1875444584393856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572401.028410:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445617664 avail 1299378176 00000100:00100000:1.0:1788572401.028459:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3644:x1875444584393856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (6085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.028466:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1788572401.028731:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1788572401.028740:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584394112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572401.028759:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446014976 avail 1299775488 00000100:00100000:1.0:1788572401.028792:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584394112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (4312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.044791:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00080000:1.0:1788572401.045072:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572401.045078:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572401.045081:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572401.045084:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572401.045110:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350984 gen 2 00000004:00080000:1.0:1788572401.045116:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350984 committed transno 347892350984 00000020:00080000:1.0:1788572401.045122:0:3644:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e5a31dc20c0 refcount 2 committed 0 result 0 batchid 17179873001 00000020:00080000:1.0:1788572401.045127:0:3644:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a244a8000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5a31dc2b40 00000020:00080000:1.0:1788572401.045130:0:3644:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027502:0x1:0x0].2 00000020:00080000:1.0:1788572401.045133:0:3644:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a244a8700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5a09827800 00000020:00080000:1.0:1788572401.045136:0:3644:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x24000272a:0x1:0x0].2 00000100:00100000:1.0:1788572401.045169:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584393856:0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788572401.045196:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 17179873001 committed batchid 17179873000 00000020:00080000:1.0:1788572401.045264:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873000 00000100:00100000:1.0:1788572401.045418:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584392448:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.045434:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584392960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.045446:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584393472:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.045455:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584392320:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.045467:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584392832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572401.045477:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584393344:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.045928:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584394112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572401.045955:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584392704:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.045967:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584393216:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.045979:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584393728:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.045991:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584392576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.046002:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584393088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572401.046014:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584393600:0@lo:400:kworker.0 00010000:00010000:2.0:1788572401.229688:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572401.434802:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572401.434879:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569530752 00000100:00100000:0.0:1788572401.434889:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569530752 00000100:00100000:0.0:1788572401.434948:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1163 00000100:00100000:0.0:1788572401.434958:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163277:x1875444569530752:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572401.434981:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572401.435003:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e000/0x265cfe11109beacb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4af expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572401.435067:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e600/0x265cfe11109bead2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572401.435081:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e600/0x265cfe11109bead2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572401.435093:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e600/0x265cfe11109bead2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572401.435138:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1788572401.435141:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572401.435158:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e600/0x265cfe11109bead2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572401.435185:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e000/0x265cfe11109beacb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4af expref: 10 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572401.435200:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e600/0x265cfe11109bead2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4af expref: 9 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572401.435208:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:0.0:1788572401.435211:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572401.435216:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e600, rc 0) 00000100:00100000:0.0:1788572401.435284:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:163277:x1875444569530752:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 327us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.435292:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1163 00000100:00100000:1.0:1788572401.439910:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572401.440009:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569530880 00000100:00100000:2.0:1788572401.440019:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569530880 00000100:00100000:2.0:1788572401.440080:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1164 00000100:00100000:2.0:1788572401.440091:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:163277:x1875444569530880:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572401.440114:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572401.440137:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bead9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4b6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440207:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440220:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440231:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440241:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440248:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440255:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440371:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109beaee lrc: 3/1,0 mode: --/PR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440381:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109beaee lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440388:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109beaee lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572401.440426:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1788572401.440430:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572401.440449:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109beaee lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440462:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440469:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440475:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440508:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572401.440513:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440632:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440648:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:2.0:1788572401.440651:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572401.440657:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440664:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440676:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440687:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440692:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440696:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572401.440699:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440705:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440712:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8e590430ca00) 00010000:00010000:2.0:1788572401.440715:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572401.440718:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440723:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beae7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440748:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bead9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4b6 expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440761:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109beaee lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4b6 expref: 10 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.440768:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:2.0:1788572401.440770:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788572401.440773:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7b200, rc 0) 00000100:00100000:2.0:1788572401.440869:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163277:x1875444569530880:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 779us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572401.440877:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1164 00000100:00100000:3.0:1788572401.449442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572401.449608:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569531008 00000100:00100000:1.0:1788572401.449619:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569531008 00000100:00100000:1.0:1788572401.449691:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1165 00000100:00100000:1.0:1788572401.449702:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163277:x1875444569531008:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572401.449728:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572401.449762:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109beaf5 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4bd expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.449837:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 3/1,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.449852:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.449864:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.449902:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.449915:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450037:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450077:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450083:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 2/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450089:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450094:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572401.450098:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450105:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450115:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:1.0:1788572401.450117:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572401.450122:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450128:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109beafc lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450136:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450142:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450147:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450150:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572401.450152:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450157:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450162:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0xf7117594 (ffff8e590d445200) 00010000:00010000:1.0:1788572401.450163:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572401.450166:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450171:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109beb03 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450201:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109beaf5 lrc: 1/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4bd expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450211:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:1.0:1788572401.450213:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572401.450216:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109beaf5 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4bd expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.450229:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255400, rc 0) 00000100:00100000:1.0:1788572401.450284:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163277:x1875444569531008:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 584us (851us total) trans 0 rc 301/301 00000100:00100000:1.0:1788572401.450292:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1165 00000100:00100000:2.0:1788572401.460744:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572401.460966:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569531136 00000100:00100000:3.0:1788572401.460977:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569531136 00000100:00100000:3.0:1788572401.461067:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1166 00000100:00100000:3.0:1788572401.461078:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163277:x1875444569531136:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572401.461101:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572401.461125:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beb0a lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4c4 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461196:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 3/1,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461214:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461226:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461241:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461247:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461253:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461295:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461313:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 2/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461321:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461327:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcea00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572401.461333:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461342:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461354:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:3.0:1788572401.461358:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572401.461363:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461370:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109beb11 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461380:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461386:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461392:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461397:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572401.461400:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461405:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461414:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0xf7117594 (ffff8e590430c400) 00010000:00010000:3.0:1788572401.461416:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572401.461420:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461425:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109beb18 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461460:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beb0a lrc: 1/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4c4 expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461470:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:3.0:1788572401.461472:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572401.461476:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109beb0a lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4c4 expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.461513:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf400, rc 0) 00000100:00100000:3.0:1788572401.461692:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163277:x1875444569531136:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 615us (1225us total) trans 0 rc 301/301 00000100:00100000:3.0:1788572401.461700:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1166 00000100:00100000:0.0:1788572401.464409:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572401.464506:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569531264 00000100:00100000:2.0:1788572401.464517:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569531264 00000100:00100000:2.0:1788572401.464641:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1167 00000100:00100000:2.0:1788572401.464652:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163277:x1875444569531264:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572401.464675:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572401.464697:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4cb expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.464836:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.464851:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.464862:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572401.464902:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1788572401.464905:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572401.464924:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.464950:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4cb expref: 12 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.464973:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4cb expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.464981:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:2.0:1788572401.464984:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572401.464987:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7a400, rc 0) 00000100:00100000:2.0:1788572401.465047:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:163277:x1875444569531264:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 396us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572401.465054:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1167 00000100:00100000:0.0:1788572401.478391:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572401.478527:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569531520 00000100:00100000:1.0:1788572401.478537:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569531520 00000100:00100000:1.0:1788572401.478601:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1168 00000100:00100000:1.0:1788572401.478612:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:163277:x1875444569531520:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572401.478634:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572401.478655:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109beb2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4d2 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572401.479017:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1788572401.479127:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109beb2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4d2 expref: 13 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.479142:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572401.479145:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572401.479151:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109beb2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4d2 expref: 13 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.479163:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255400, rc 0) 00000100:00100000:1.0:1788572401.479225:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:163277:x1875444569531520:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 615us (842us total) trans 347892350988 rc 301/301 00000100:00100000:1.0:1788572401.479233:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1168 00000100:00100000:2.0:1788572401.482001:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572401.482087:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569531776 00000100:00100000:3.0:1788572401.482097:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569531776 00000100:00100000:3.0:1788572401.482169:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1169 00000100:00100000:3.0:1788572401.482179:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:163277:x1875444569531776:12345-192.168.202.57@tcp:36:lfs.0 00000100:00100000:3.0:1788572401.482321:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584394240:0@lo:1000:mdt00_004.0 00000100:00080000:2.0:1788572401.482340:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572401.482373:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.482408:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572401.482465:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584394240 00000100:00100000:2.0:1788572401.482470:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584394240 00000100:00100000:2.0:1788572401.482598:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1788572401.482607:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:196070:x1875444584394240:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788572401.482679:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:196070:x1875444584394240:12345-0@lo:1000:mdt00_004.0 Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572401.482687:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1788572401.482721:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584394240:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.483023:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584394368:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.483053:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.483078:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572401.483128:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584394368 00000100:00100000:1.0:1788572401.483133:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584394368 00000100:00100000:1.0:1788572401.483217:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1788572401.483226:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:196070:x1875444584394368:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788572401.483300:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:196070:x1875444584394368:12345-0@lo:1000:mdt00_004.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.483321:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1788572401.483378:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584394368:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.483417:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584394496:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.483441:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.483619:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572401.483683:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584394496 00000100:00100000:2.0:1788572401.483687:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584394496 00000100:00100000:2.0:1788572401.483708:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1788572401.483714:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:196070:x1875444584394496:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788572401.483810:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:196070:x1875444584394496:12345-0@lo:1000:mdt00_004.0 Request processed in 95us (367us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572401.483817:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1788572401.484153:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584394496:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788572401.484209:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 3/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.484219:0:196070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 3/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.484229:0:196070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 3/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572401.484242:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584394624:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1788572401.484268:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.484339:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572401.484379:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584394624 00000100:00100000:2.0:1788572401.484383:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584394624 00000100:00100000:2.0:1788572401.484442:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1788572401.484450:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:196070:x1875444584394624:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788572401.484460:0:188054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572401.484473:0:188054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109beb3b expref: -99 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.484520:0:188054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 2/0,1 mode: TXN/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.484532:0:188054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4cb expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.484542:0:188054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 5/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109beb3b expref: 8 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.484567:0:188054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4cb expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.484581:0:188054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4cb expref: 11 pid: 188050 timeout: 9254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572401.484592:0:188054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:188054:1875444584394752:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572401.484699:0:188054:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1788572401.484733:0:188054:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788572401.484778:0:188054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a011ca240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572401.488713:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572401.488963:0:188054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095d180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:188054:1875444584394752:192.168.202.57@tcp:104: 00010000:00010000:1.0:1788572401.488996:0:188054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 3/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109beb3b expref: 8 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489008:0:188054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:1.0:1788572401.489012:0:188054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572401.489016:0:188054:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 3/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109beb3b expref: 8 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489027:0:188054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7a800, rc 0) 00000100:00100000:1.0:1788572401.489080:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196070:x1875444584394624:12345-0@lo:101:mdt00_004.0 Request processed in 4630us (4810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.489088:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1788572401.489134:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584394624:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1788572401.489152:0:196070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 4/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489164:0:196070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 4/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788572401.489525:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350988 is committed 00010000:00010000:1.0:1788572401.489547:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489556:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489563:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489569:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572401.489574:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489583:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489598:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8e590430ca00) 00010000:00010000:1.0:1788572401.489601:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572401.489605:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489611:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109beabd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489629:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489635:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 2/0,0 mode: TXN/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489645:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489649:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572401.489652:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489659:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 4/0,0 mode: TXN/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489666:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:1.0:1788572401.489668:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572401.489672:0:3628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109beb3b expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489680:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 2/0,0 mode: --/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572401.489686:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109beac4 lrc: 0/0,0 mode: --/TXN res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572401.492345:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569531904 00000100:00100000:2.0:1788572401.492360:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569531904 00010000:00010000:2.0:1788572401.492426:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4cb expref: 9 pid: 188050 timeout: 9254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572401.492464:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12906 00000100:00100000:2.0:1788572401.492474:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:2398:x1875444569531904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572401.492504:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572401.492511:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4cb expref: 9 pid: 188050 timeout: 9254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.492536:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4cb expref: 9 pid: 188050 timeout: 9254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.492557:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beb26 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4cb expref: 9 pid: 188050 timeout: 9254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.492570:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:2.0:1788572401.492575:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109beb3b expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.492584:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 2/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109beb3b expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.492592:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109beb3b expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.492631:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109beb3b expref: 7 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572401.492644:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6502:1875444584394880:0@lo:105: 00000100:00100000:2.0:1788572401.492708:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.492737:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584394880 00000100:00100000:2.0:1788572401.492739:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a011ca240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572401.492742:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584394880 00000100:00100000:3.0:1788572401.492781:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5400 00000100:00100000:3.0:1788572401.492789:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6502:x1875444584394880:12345-0@lo:105: 00010000:00010000:3.0:1788572401.492810:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 5/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.492819:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 5/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.492828:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 5/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.492835:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 5/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.492842:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 6/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.492850:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 6/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.492877:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a40dcf400) 00000100:00100000:3.0:1788572401.492917:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6502:x1875444584394880:12345-0@lo:105: Request processed in 128us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572401.493125:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5400 00010000:00010000:3.0:1788572401.493147:0:196070:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.493154:0:196070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572401.493173:0:196070:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x4:0x0] 00010000:00010000:3.0:1788572401.493201:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.493206:0:196070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.493213:0:196070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572401.493224:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395008:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1788572401.493246:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.493267:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572401.493285:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584395008 00000100:00100000:2.0:1788572401.493289:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584395008 00000100:00100000:3.0:1788572401.493295:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6502:1875444584394880:0@lo:105: 00010000:00010000:3.0:1788572401.493320:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572401.493331:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1788572401.493337:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:196070:x1875444584395008:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788572401.493352:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788572401.493358:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2398:x1875444569531904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 886us (4654us total) trans 0 rc 0/0 00010000:00010000:2.0:1788572401.493366:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beb50 lrc: 2/0,0 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109beb49 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.493383:0:188053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beb50 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109beb49 expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.493394:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beb50 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109beb49 expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572401.493401:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0xf7117594 (ffff8e5a02ffb400) 00010000:00010000:2.0:1788572401.493404:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572401.493407:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7a600, rc 0) 00000100:00100000:2.0:1788572401.493438:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395008:12345-0@lo:101:mdt00_004.0 Request processed in 101us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572401.493444:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1788572401.495881:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12906 00000100:00100000:3.0:1788572401.498007:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395008:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1788572401.498039:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109beb50 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572401.498060:0:196070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109beb50 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572401.498085:0:196070:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x4:0x0] 00000100:00100000:3.0:1788572401.498142:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395136:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.498203:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.498285:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572401.498342:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584395136 00000100:00100000:2.0:1788572401.498349:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584395136 00000100:00100000:2.0:1788572401.498443:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1788572401.498453:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395136:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788572401.498559:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395136:12345-0@lo:1000:mdt00_004.0 Request processed in 106us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572401.498566:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1788572401.498691:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395136:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.498736:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395264:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.498761:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.498778:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572401.498791:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584395264 00000100:00100000:3.0:1788572401.498795:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584395264 00000100:00100000:3.0:1788572401.498818:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1788572401.498824:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395264:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.498883:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395264:12345-0@lo:1000:mdt00_004.0 Request processed in 59us (121us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572401.498889:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1788572401.498912:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395264:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.498979:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395392:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499002:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.499015:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572401.499027:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584395392 00000100:00100000:3.0:1788572401.499031:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584395392 00000100:00100000:3.0:1788572401.499048:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1788572401.499053:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395392:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499103:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395392:12345-0@lo:1000:mdt00_004.0 Request processed in 49us (100us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572401.499111:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1788572401.499134:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395392:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499174:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395520:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499195:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.499208:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572401.499219:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584395520 00000100:00100000:3.0:1788572401.499222:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584395520 00000100:00100000:3.0:1788572401.499237:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1788572401.499242:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499289:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395520:12345-0@lo:1000:mdt00_004.0 Request processed in 46us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572401.499295:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1788572401.499330:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395520:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499367:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395648:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499388:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.499400:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572401.499409:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584395648 00000100:00100000:3.0:1788572401.499412:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584395648 00000100:00100000:3.0:1788572401.499427:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1788572401.499431:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395648:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499494:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395648:12345-0@lo:1000:mdt00_004.0 Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572401.499501:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1788572401.499536:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395648:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499572:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395776:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499594:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.499607:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbcac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572401.499618:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584395776 00000100:00100000:3.0:1788572401.499621:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584395776 00000100:00100000:3.0:1788572401.499638:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1788572401.499644:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572401.499693:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:196070:x1875444584395776:12345-0@lo:1000:mdt00_004.0 Request processed in 48us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572401.499700:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1788572401.499724:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:196070:1875444584395776:0@lo:1000:mdt00_004.0 00000040:00080000:3.0:1788572401.500271:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x24000272a:0x1:0x0].3, 1096 off35384 00000040:00080000:3.0:1788572401.500341:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027502:0x1:0x0].3, 1240 off35752 00000004:00080000:3.0:1788572401.500347:0:196070:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a3fbcae40 with version 6 00000004:00080000:3.0:1788572401.500365:0:188074:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e590639b300 version 6 rpc_version 6 00000020:00100000:3.0:1788572401.500387:0:188074:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572401.500395:0:188074:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590a2d1500 x1875444584396032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572401.500409:0:188074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584396032:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572401.500442:0:188074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572401.500459:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572401.500472:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584396032 00000100:00100000:3.0:1788572401.500476:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584396032 00000100:00100000:3.0:1788572401.500518:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1788572401.500587:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:188074:x1875444584396032:12345-0@lo:1000:osp_up0-1.0 00010000:02000000:3.0:1788572401.500827:0:188053:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00010000:00020000:3.0:1788572401.503423:0:188053:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8e590a2d0a80 x1875444584396032/t347892350989(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:62/0 lens 2520/4320 e 0 to 0 dl 1788572412 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572401.517209:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:188074:x1875444584396032:12345-0@lo:1000:osp_up0-1.0 Request processed in 16615us (16757us total) trans 347892350989 rc 0/0 00000100:00100000:3.0:1788572401.517227:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1788572401.533035:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584396160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572401.533148:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572401.533646:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584396288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572401.533682:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572401.533719:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584396160 00000100:00100000:1.0:1788572401.533726:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584396160 00000100:00100000:1.0:1788572401.533768:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584396288 00000100:00100000:1.0:1788572401.533771:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584396288 00000100:00100000:1.0:1788572401.533786:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6367 00000100:00100000:1.0:1788572401.533794:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3642:x1875444584396160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572401.533827:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572401.533883:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3642:x1875444584396160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.533892:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6367 00000100:00100000:1.0:1788572401.533910:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6368 00000100:00100000:1.0:1788572401.533916:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584396288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572401.533936:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572401.533967:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584396288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.533974:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6368 00000100:00100000:1.0:1788572401.534017:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584396288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572401.534049:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584396160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572401.534689:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584396416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572401.534728:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572401.534766:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584396416 00000100:00100000:1.0:1788572401.534770:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584396416 00000100:00100000:1.0:1788572401.534798:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6369 00000100:00100000:1.0:1788572401.534805:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584396416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572401.534818:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572401.534849:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584396416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572401.534855:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6369 00000100:00100000:1.0:1788572401.534898:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584396416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572402.029026:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572402.029082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572402.029117:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572402.029141:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572402.029180:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572402.029208:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569532416 00000100:00100000:2.0:1788572402.029217:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569532416 00000100:00100000:2.0:1788572402.029270:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569532544 00000100:00100000:2.0:1788572402.029273:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569532544 00000100:00100000:2.0:1788572402.029298:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7782 00000100:00100000:2.0:1788572402.029308:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569532416:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572402.029388:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569532416:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572402.029396:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7782 00000100:00100000:2.0:1788572402.029415:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7783 00000100:00100000:2.0:1788572402.029422:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569532544:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572402.029444:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569532544:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572402.029450:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7783 00000100:00100000:2.0:1788572402.029469:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569532160 00000100:00100000:2.0:1788572402.029472:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569532160 00000100:00100000:2.0:1788572402.029666:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569532288 00000100:00100000:2.0:1788572402.029670:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569532288 00000100:00100000:2.0:1788572402.029687:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 390 00000100:00100000:2.0:1788572402.029693:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2400:x1875444569532160:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572402.029726:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2400:x1875444569532160:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 34us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572402.029732:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 390 00000100:00100000:2.0:1788572402.029743:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 391 00000100:00100000:2.0:1788572402.029749:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569532288:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572402.029773:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569532288:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 24us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572402.029779:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 391 00000100:00080000:2.0:1788572402.029799:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572402.029804:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572402.029805:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572402.029910:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569532032 00000100:00100000:3.0:1788572402.029915:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569532032 00000100:00100000:3.0:1788572402.029943:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 86 00000100:00100000:3.0:1788572402.029951:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569532032:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572402.029982:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569532032:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572402.029989:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 86 00000001:00080000:3.0:1788572402.046104:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705669 is committed 00000001:00080000:0.0:1788572402.049947:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975687 is committed 00000001:00080000:3.0:1788572402.111406:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350989 is committed 00000001:00080000:1.0:1788572402.111659:0:188042:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474837549 is committed 00000020:00080000:1.0:1788572402.111670:0:188042:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 17179873001 batchid updated 00000004:00080000:1.0:1788572402.111689:0:188042:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000020:00080000:2.0:1788572402.111749:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000004:00080000:2.0:1788572402.111810:0:188089:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e590bba06c0 with version 7 00000020:00080000:2.0:1788572402.111815:0:188089:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17179873001 cancel update log [0x200027502:0x1:0x0].2: rc = 0 00000020:00080000:2.0:1788572402.111904:0:188089:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17179873001 cancel update log [0x24000272a:0x1:0x0].2: rc = 0 00000020:00080000:2.0:1788572402.111911:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000100:00100000:2.0:1788572402.112432:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584396672:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572402.112757:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584396544:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1788572402.113667:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584396800:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572402.116039:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572402.116089:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584397056:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572402.116126:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572402.116166:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584396928:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572402.116190:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572402.116208:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584397440:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572402.116228:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572402.116352:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584396544 00000100:00100000:1.0:1788572402.116359:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584396544 00000100:00100000:1.0:1788572402.116399:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584397056 00000100:00100000:1.0:1788572402.116402:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584397056 00000100:00100000:1.0:1788572402.116416:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584396928 00000100:00100000:1.0:1788572402.116418:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584396928 00000100:00100000:1.0:1788572402.116432:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584397440 00000100:00100000:1.0:1788572402.116434:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584397440 00000100:00100000:1.0:1788572402.116452:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22678 00000100:00100000:1.0:1788572402.116460:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584396544:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1788572402.116592:0:177556:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:587 count 1 00000100:00100000:1.0:1788572402.116748:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22679 00000100:00100000:1.0:1788572402.116756:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584397056:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1788572402.116773:0:43919:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:582 count 1 00000100:00100000:1.0:1788572402.116833:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22680 00000100:00100000:1.0:1788572402.116841:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584396928:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1788572402.116854:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:578 count 1 00000100:00100000:1.0:1788572402.116913:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22681 00000100:00100000:1.0:1788572402.116921:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584397440:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1788572402.116934:0:43925:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:584 count 1 00002000:00010000:1.0:1788572402.117763:0:177556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572402.117773:0:177556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.117790:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24b:0x0].0x0 since=9155s v=(0 0) 00010000:00010000:1.0:1788572402.117794:0:177556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572402.117800:0:177556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.117818:0:177556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.117829:0:177556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.117838:0:177556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.117858:0:177556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572402.118054:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584396544:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1592us (2020us total) trans 38654705670 rc 0/0 00000100:00100000:1.0:1788572402.118062:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22678 00002000:00010000:1.0:1788572402.118127:0:43919:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572402.118133:0:43919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118144:0:43919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x246:0x0].0x0 since=9155s v=(0 0) 00010000:00010000:1.0:1788572402.118148:0:43919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572402.118152:0:43919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118162:0:43919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118170:0:43919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118176:0:43919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118190:0:43919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572402.118259:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584397056:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1504us (2132us total) trans 38654705671 rc 0/0 00000100:00100000:1.0:1788572402.118265:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22679 00002000:00010000:1.0:1788572402.118327:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572402.118333:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118342:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=9155s v=(0 0) 00010000:00010000:1.0:1788572402.118346:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572402.118350:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118364:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118372:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118379:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.118393:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788572402.118419:0:43925:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572402.118426:0:43925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.118434:0:43925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x248:0x0].0x0 since=9155s v=(0 0) 00010000:00010000:3.0:1788572402.118454:0:43925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572402.118459:0:43925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572402.118463:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584396928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1623us (2271us total) trans 38654705672 rc 0/0 00000100:00100000:1.0:1788572402.118469:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22680 00010000:00010000:3.0:1788572402.118470:0:43925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.118498:0:43925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.118507:0:43925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.118522:0:43925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788572402.118614:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705669 gen 2 00000004:00080000:1.0:1788572402.118620:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a31cd3480, transno 38654705669 00000100:00100000:1.0:1788572402.118635:0:3644:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e59028ece00 x1875444584396928/t38654705672(38654705672) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572418 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788572402.118647:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e59028ece00/2, rc 0, transno 38654705672 00000100:00100000:1.0:1788572402.118652:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584396928:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572402.118773:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584397568:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1788572402.118778:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584397440:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1858us (2549us total) trans 38654705673 rc 0/0 00000100:00100000:3.0:1788572402.118784:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22681 00000100:00100000:1.0:1788572402.118803:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572402.118828:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584397568 00000100:00100000:3.0:1788572402.118834:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584397568 00000004:00080000:1.0:1788572402.118837:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a2d0380/2, rc 0, transno 38654705670 00000100:00100000:1.0:1788572402.118841:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584396544:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1788572402.118849:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e59028ed180/2, rc 0, transno 38654705671 00000100:00100000:1.0:1788572402.118852:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584397056:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1788572402.118867:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22682 00000004:00080000:1.0:1788572402.118871:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e59028ec700/2, rc 0, transno 38654705673 00000100:00100000:1.0:1788572402.118874:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584397440:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1788572402.118874:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584397568:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1788572402.118894:0:177560:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:581 count 1 00000100:00100000:2.0:1788572402.119134:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572402.119164:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584397184:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1788572402.119191:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572402.119220:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572402.119227:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119236:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572402.119240:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572402.119249:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572402.119250:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.119255:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.119263:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x245:0x0].0x0 since=9155s v=(0 0) 00010000:00010000:2.0:1788572402.119266:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.119266:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572402.119271:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119274:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd3fb37/0x265cfe11109beb57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.119280:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.119288:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119292:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572402.119296:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.119296:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119303:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572402.119306:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.119311:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788572402.119313:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119340:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119347:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c44ea910/0x265cfe11109beb5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119360:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572402.119363:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119369:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572402.119372:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119380:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572402.119388:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+10:3641:x1875444584397568:12345-0@lo:6:osp-syn-0-1.0 Request processed in 515us (585us total) trans 38654705674 rc 0/0 00010000:00010000:2.0:1788572402.119390:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572402.119394:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22682 00010000:00010000:2.0:1788572402.119397:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e000a329/0x265cfe11109beb65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572402.119407:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584396672 00010000:00010000:2.0:1788572402.119411:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788572402.119411:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584396672 00010000:00010000:2.0:1788572402.119414:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119421:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572402.119424:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572402.119430:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584397184 00010000:00010000:2.0:1788572402.119432:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572402.119432:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584397184 00010000:00010000:2.0:1788572402.119441:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119449:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beb6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119462:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572402.119465:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.119471:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572402.119474:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572402.119614:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22683 00000100:00100000:1.0:1788572402.119624:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+11:3642:x1875444584396672:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1788572402.119639:0:179391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:586 count 1 00000100:00100000:3.0:1788572402.119647:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22684 00000100:00100000:3.0:1788572402.119654:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+11:3642:x1875444584397184:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1788572402.119665:0:177560:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:583 count 1 00000004:00080000:1.0:1788572402.119747:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a27263b80/2, rc 0, transno 38654705674 00000100:00100000:1.0:1788572402.119753:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584397568:0@lo:6:osp-syn-0-1.0 00002000:00010000:1.0:1788572402.120037:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572402.120042:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.120053:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24a:0x0].0x0 since=9155s v=(0 0) 00010000:00010000:1.0:1788572402.120056:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572402.120060:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.120070:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.120079:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.120086:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.120099:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572402.120188:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+12:3642:x1875444584396672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 565us (1053us total) trans 38654705675 rc 0/0 00000100:00100000:1.0:1788572402.120194:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22683 00010000:00010000:2.0:1788572402.120244:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.120257:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.120265:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109beb73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.120279:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1788572402.120280:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a2d1880/2, rc 0, transno 38654705675 00010000:00010000:2.0:1788572402.120283:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572402.120285:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584396672:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1788572402.120290:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572402.120293:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.120300:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.120310:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.120328:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b67833d1/0x265cfe11109beb7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.120342:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572402.120344:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572402.120345:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572402.120352:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572402.120357:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572402.120364:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572402.120371:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572402.120445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572402.120499:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584397312:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1788572402.120605:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584396800 00000100:00100000:2.0:1788572402.120610:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584396800 00000100:00100000:2.0:1788572402.120638:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22685 00000100:00100000:2.0:1788572402.120645:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+12:3643:x1875444584396800:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1788572402.120661:0:177559:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:580 count 1 00002000:00010000:1.0:1788572402.120983:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572402.120990:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.121001:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x247:0x0].0x0 since=9155s v=(0 0) 00010000:00010000:1.0:1788572402.121004:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572402.121009:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.121019:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.121028:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.121035:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.121049:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572402.121146:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584397184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1492us (1953us total) trans 38654705676 rc 0/0 00000100:00100000:1.0:1788572402.121156:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22684 00000004:00080000:1.0:1788572402.121190:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e59028edf80/2, rc 0, transno 38654705676 00000100:00100000:1.0:1788572402.121195:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584397184:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1788572402.121270:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572402.121328:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584397312 00000100:00100000:0.0:1788572402.121333:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584397312 00000100:00100000:0.0:1788572402.121368:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22686 00000100:00100000:0.0:1788572402.121375:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3643:x1875444584397312:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1788572402.121391:0:17061:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:585 count 1 00002000:00010000:2.0:1788572402.121759:0:177559:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572402.121765:0:177559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.121775:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x244:0x0].0x0 since=9155s v=(0 0) 00010000:00010000:2.0:1788572402.121778:0:177559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x244:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572402.121782:0:177559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.121791:0:177559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.121798:0:177559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.121805:0:177559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.121826:0:177559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788572402.122047:0:17061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572402.122053:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.122060:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x249:0x0].0x0 since=9155s v=(0 0) 00010000:00010000:0.0:1788572402.122063:0:17061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572402.122066:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.122076:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.122083:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.122090:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.122104:0:17061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788572402.122116:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572402.122123:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122130:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572402.122135:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122144:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572402.122188:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584397312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 812us (917us total) trans 38654705678 rc 0/0 00000100:00100000:0.0:1788572402.122195:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22686 00000004:00080000:0.0:1788572402.122230:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e59028ee680/2, rc 0, transno 38654705678 00010000:00010000:3.0:1788572402.122230:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572402.122234:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584397312:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1788572402.122238:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee74e34d/0x265cfe11109beb81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122258:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572402.122262:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122269:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572402.122273:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122279:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122289:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122296:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109beb88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122309:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788572402.122312:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+14:3643:x1875444584396800:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1667us (1867us total) trans 38654705677 rc 0/0 00010000:00010000:3.0:1788572402.122313:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122330:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e200 already unused, calling callback (ffffffffc0c114f0) 00000100:00100000:2.0:1788572402.122332:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22685 00010000:00010000:3.0:1788572402.122334:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122341:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572402.122349:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572402.122350:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122357:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109beb8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.122369:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572402.122370:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572402.122371:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572402.122599:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572402.122653:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1f8fc700/2, rc 0, transno 38654705677 00000100:00100000:0.0:1788572402.122659:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584396800:0@lo:6:osp-syn-0-1.0 00000001:00080000:3.0:1788572402.126969:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705678 is committed 00000100:00100000:3.0:1788572402.168679:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572402.171709:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569532672 00000100:00100000:2.0:1788572402.171727:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569532672 00000100:00100000:2.0:1788572402.171815:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1170 00000100:00100000:2.0:1788572402.171826:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163286:x1875444569532672:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:2.0:1788572402.171872:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00000100:00100000:2.0:1788572402.172112:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163286:x1875444569532672:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 287us (3444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572402.172120:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1170 00000100:00100000:2.0:1788572402.180847:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572402.180973:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569532800 00000100:00100000:3.0:1788572402.180983:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569532800 00000100:00100000:3.0:1788572402.181039:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1171 00000100:00100000:3.0:1788572402.181048:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163286:x1875444569532800:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572402.181085:0:188049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:3.0:1788572402.181149:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163286:x1875444569532800:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572402.181157:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1171 00000100:00100000:0.0:1788572402.189041:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572402.189114:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569532928 00000100:00100000:1.0:1788572402.189126:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569532928 00000100:00100000:1.0:1788572402.189187:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6370 00000100:00100000:1.0:1788572402.189198:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:163286:x1875444569532928:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:1.0:1788572402.189225:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572402.189288:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:163286:x1875444569532928:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 92us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572402.189295:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6370 00000100:00100000:3.0:1788572402.196223:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572402.196653:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569533056 00000100:00100000:0.0:1788572402.196664:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569533056 00000100:00100000:0.0:1788572402.196729:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6371 00000100:00100000:0.0:1788572402.196740:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:163286:x1875444569533056:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572402.196772:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572402.196975:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:163286:x1875444569533056:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 235us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572402.196983:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6371 00010000:00010000:2.0:1788572402.238549:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572402.277557:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572402.277647:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569533312 00000100:00100000:3.0:1788572402.277659:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569533312 00000100:00100000:3.0:1788572402.277725:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1172 00000100:00100000:3.0:1788572402.277737:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163293:x1875444569533312:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00010000:3.0:1788572402.277953:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572402.277982:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e600/0x265cfe11109bead2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4af expref: 8 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.278003:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572402.278008:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572402.278085:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.278171:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.278182:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.278199:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.278207:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.278214:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279269:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279282:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279288:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279295:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279304:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572402.279309:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279329:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279344:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572402.279347:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572402.279351:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279358:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beb96 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572402.279373:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005920b798 reply state 00000000ac21dc0e transno 347892350990 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279386:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.279394:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4c00) 00010000:00010000:3.0:1788572402.279397:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572402.279400:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572402.280061:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:163293:x1875444569533312:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 2320us (2574us total) trans 347892350990 rc 0/0 00000100:00100000:3.0:1788572402.280072:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1172 00000100:00100000:2.0:1788572402.337631:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572402.338984:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569533440 00000100:00100000:3.0:1788572402.338997:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569533440 00000100:00100000:3.0:1788572402.339059:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1173 00000100:00100000:3.0:1788572402.339071:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:163296:x1875444569533440:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572402.339106:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572402.339130:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4d9 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.339346:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bebab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.339362:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bebab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.339374:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bebab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572402.339422:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1788572402.339427:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572402.339447:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bebab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.339473:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109beba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4d9 expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.339524:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bebab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4d9 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.339534:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572402.339537:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572402.339540:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcea00, rc 0) 00000100:00100000:3.0:1788572402.339600:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163296:x1875444569533440:12345-192.168.202.57@tcp:101:rm.0 Request processed in 531us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572402.339612:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1173 00000100:00100000:1.0:1788572402.347330:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572402.347376:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569533568 00000100:00100000:1.0:1788572402.347385:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569533568 00000100:00100000:1.0:1788572402.347441:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1174 00000100:00100000:1.0:1788572402.347452:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163296:x1875444569533568:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572402.347476:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572402.347513:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bebb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4e0 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347586:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347603:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347620:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347632:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347639:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347645:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347755:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bebc7 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347763:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bebc7 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347770:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bebc7 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572402.347816:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x5:0x0]: returning size 0 00000004:00200000:1.0:1788572402.347820:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572402.347839:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bebc7 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.347851:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bebc7 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350884:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350898:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350905:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350911:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572402.350916:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350924:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350941:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572402.350944:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572402.350948:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350955:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bebb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350971:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350977:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350982:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350987:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572402.350991:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.350996:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.351002:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4c00) 00010000:00010000:1.0:1788572402.351005:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572402.351007:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.351013:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254000/0x265cfe11109bebc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.351063:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bebb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4e0 expref: 12 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.351078:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bebc7 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4e0 expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572402.351086:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x5:0x0].0x0 (ffff8e590d445f00) 00010000:00010000:1.0:1788572402.351088:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572402.351090:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254600, rc 0) 00000100:00100000:1.0:1788572402.352392:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:163296:x1875444569533568:12345-192.168.202.57@tcp:101:rm.0 Request processed in 4931us (5072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572402.352403:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1174 00000100:00100000:2.0:1788572402.365425:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572402.365687:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569533824 00000100:00100000:3.0:1788572402.365698:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569533824 00000100:00100000:3.0:1788572402.365786:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1175 00000100:00100000:3.0:1788572402.365797:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:163296:x1875444569533824:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572402.365849:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788572402.365884:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bebc7 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4e0 expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.365903:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x5:0x0].0x0 (ffff8e590d445f00) 00010000:00010000:3.0:1788572402.365917:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bebab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4d9 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.365926:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572402.365929:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572402.365948:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.365962:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.365971:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.365981:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.365987:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.365994:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366074:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 3/0,1 mode: --/EX res: [0x200027501:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366082:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366089:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366404:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366413:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366421:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366428:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366435:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366440:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366464:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572402.366551:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366559:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366564:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366570:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572402.366574:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366581:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366591:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x5:0x0].0x0 (ffff8e5a1fbf4900) 00010000:00010000:3.0:1788572402.366594:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572402.366598:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 2/0,0 mode: --/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366604:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebdc lrc: 0/0,0 mode: --/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366620:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366626:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366632:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366636:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572402.366640:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366646:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366653:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572402.366656:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572402.366659:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366665:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572402.366674:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043108578 reply state 00000000f2a415d9 transno 347892350991 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366686:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572402.366692:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4c00) 00010000:00010000:3.0:1788572402.366694:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572402.366697:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572402.366831:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572402.366838:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.366845:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572402.366848:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.366855:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.366865:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x5:0x0].0x0 (ffff8e5a1fbf4900) 00010000:00010000:0.0:1788572402.366867:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572402.366871:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 1/0,0 mode: --/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.366876:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bebe3 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572402.366890:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572402.366892:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572402.366894:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572402.366930:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:163296:x1875444569533824:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1132us (1510us total) trans 347892350991 rc 0/0 00000100:00100000:3.0:1788572402.366938:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1175 00010000:00010000:2.0:1788572403.262264:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572403.581799:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572403.581824:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584397696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572403.582027:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572403.582155:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584397696 00000100:00100000:1.0:1788572403.582162:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584397696 00000100:00100000:1.0:1788572403.582214:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6372 00000100:00100000:1.0:1788572403.582222:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584397696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572403.582250:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572403.582304:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584397696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572403.582311:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6372 00000100:00080000:3.0:1788572403.582383:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572403.582401:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 2 00000004:00080000:0.0:1788572403.582407:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a2d0380, transno 38654705670 00000004:00080000:0.0:1788572403.582422:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e59028ed180, transno 38654705671 00000004:00080000:0.0:1788572403.582425:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e59028ece00, transno 38654705672 00000004:00080000:0.0:1788572403.582427:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e59028ec700, transno 38654705673 00000004:00080000:0.0:1788572403.582430:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a27263b80, transno 38654705674 00000004:00080000:0.0:1788572403.582432:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a2d1880, transno 38654705675 00000004:00080000:0.0:1788572403.582435:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e59028edf80, transno 38654705676 00000004:00080000:0.0:1788572403.582437:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a1f8fc700, transno 38654705677 00000004:00080000:0.0:1788572403.582439:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e59028ee680, transno 38654705678 00000100:00100000:0.0:1788572403.582451:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584397696:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1788572403.582634:0:188077:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 9 done 00010000:00010000:3.0:1788572404.285680:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572405.311358:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572406.141139:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584397824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572406.141211:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.141473:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584398208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.141540:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.141562:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584398720:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.141596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.141614:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584399232:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.141636:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.141654:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788572406.141659:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584398080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.141679:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.141700:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584398592:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.141719:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.141733:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584399104:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.141754:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.141779:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584398208 00000100:00100000:1.0:1788572406.141786:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584398208 00000100:00100000:1.0:1788572406.141829:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584398720 00000100:00100000:1.0:1788572406.141832:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584398720 00000100:00100000:1.0:1788572406.141844:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584398080 00000100:00100000:1.0:1788572406.141846:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584398080 00000100:00100000:1.0:1788572406.141857:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584399104 00000100:00100000:1.0:1788572406.141859:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584399104 00000100:00100000:1.0:1788572406.141874:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788572406.141881:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584398208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572406.141923:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788572406.141931:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584398208:12345-0@lo:400:kworker.0 Request processed in 50us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572406.141932:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584398720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.141938:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788572406.141963:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00010000:00000080:3.0:1788572406.141963:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a9c000 x1875444584398720/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:67/0 lens 224/224 e 0 to 0 dl 1788572417 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572406.141969:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584398080:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572406.141980:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a9dc00 x1875444584398080/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:67/0 lens 224/224 e 0 to 0 dl 1788572417 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572406.141997:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584398720:12345-0@lo:400:kworker.0 Request processed in 67us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572406.142002:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584398080:12345-0@lo:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572406.142003:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788572406.142008:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788572406.142018:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788572406.142023:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584399104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572406.142050:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584399104:12345-0@lo:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572406.142105:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584399232 00000100:00100000:0.0:1788572406.142110:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584399232 00000100:00100000:0.0:1788572406.142140:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584398592 00000100:00100000:0.0:1788572406.142143:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584398592 00000100:00100000:0.0:1788572406.142163:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7784 00000100:00100000:0.0:1788572406.142170:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584399232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142205:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584399232:12345-0@lo:400:kworker.0 Request processed in 35us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572406.142211:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7784 00000100:00100000:0.0:1788572406.142227:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7785 00000100:00100000:0.0:1788572406.142232:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584398592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142258:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584398592:12345-0@lo:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572406.142264:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7785 00000100:00100000:0.0:1788572406.142290:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584397952:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142320:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572406.142343:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584398464:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572406.142379:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584398848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572406.142411:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572406.142427:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584399488:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142448:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572406.142460:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572406.142465:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584398336:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142502:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572406.142519:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584398976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142538:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572406.142548:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584399360:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142565:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572406.142590:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584397952 00000100:00100000:0.0:1788572406.142594:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584397952 00000100:00100000:0.0:1788572406.142620:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788572406.142626:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584397952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142657:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584397952:12345-0@lo:400:kworker.0 Request processed in 32us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572406.142664:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788572406.142690:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584398464 00000100:00100000:0.0:1788572406.142693:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584398464 00000100:00100000:0.0:1788572406.142714:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584399360 00000100:00100000:0.0:1788572406.142716:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584399360 00000100:00100000:0.0:1788572406.142734:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7786 00000100:00100000:0.0:1788572406.142740:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584398464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142767:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584398464:12345-0@lo:400:kworker.0 Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572406.142773:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7786 00000100:00100000:0.0:1788572406.142784:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7787 00000100:00100000:0.0:1788572406.142790:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584399360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.142814:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584399360:12345-0@lo:400:kworker.0 Request processed in 25us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572406.142820:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7787 00000100:00100000:0.0:1788572406.142835:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584397824 00000100:00100000:0.0:1788572406.142839:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584397824 00000100:00100000:0.0:1788572406.142856:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584398848 00000100:00100000:0.0:1788572406.142858:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584398848 00000100:00100000:0.0:1788572406.142867:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584398336 00000100:00100000:0.0:1788572406.142870:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584398336 00000100:00100000:0.0:1788572406.142881:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1788572406.142887:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584397824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572406.142910:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:0.0:1788572406.142940:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584397824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572406.142947:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1788572406.142959:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1788572406.142964:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:3644:x1875444584398848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572406.142981:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:0.0:1788572406.142991:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fdf5f80 x1875444584398848/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:67/0 lens 224/368 e 0 to 0 dl 1788572417 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572406.143020:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:3644:x1875444584398848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572406.143025:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1788572406.143038:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1788572406.143043:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584398336:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572406.143053:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fdf5c00 x1875444584398336/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:67/0 lens 224/224 e 0 to 0 dl 1788572417 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572406.143077:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584398336:12345-0@lo:400:kworker.0 Request processed in 34us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572406.143083:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1788572406.143143:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584397824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572406.143178:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584398336:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.143188:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584399360:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.143197:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584397952:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.143206:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584398464:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.143216:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584398848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572406.143698:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584399488 00000100:00100000:1.0:1788572406.143704:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584399488 00000100:00100000:1.0:1788572406.143724:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584398976 00000100:00100000:1.0:1788572406.143727:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584398976 00000100:00100000:1.0:1788572406.143740:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788572406.143746:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584399488:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572406.143759:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fdf6d80 x1875444584399488/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:67/0 lens 224/224 e 0 to 0 dl 1788572417 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572406.143799:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584399488:12345-0@lo:400:kworker.0 Request processed in 53us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572406.143806:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788572406.143818:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788572406.143824:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584398976:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572406.143834:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fdf5500 x1875444584398976/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:67/0 lens 224/224 e 0 to 0 dl 1788572417 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572406.143859:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584398976:12345-0@lo:400:kworker.0 Request processed in 36us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572406.143865:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788572406.143899:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584398080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.143910:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975687 gen 2 00000004:00080000:1.0:1788572406.143915:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a36ea8700, transno 4294975678 00000004:00080000:1.0:1788572406.143922:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a84df80, transno 4294975679 00000004:00080000:1.0:1788572406.143924:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a36eaad80, transno 4294975680 00000004:00080000:1.0:1788572406.143927:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a84e300, transno 4294975681 00000004:00080000:1.0:1788572406.143929:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a84c380, transno 4294975682 00000004:00080000:1.0:1788572406.143931:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a84d880, transno 4294975683 00000004:00080000:1.0:1788572406.143934:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a84ca80, transno 4294975684 00000004:00080000:1.0:1788572406.143936:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a84ea00, transno 4294975685 00000004:00080000:1.0:1788572406.143939:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a36ea9180, transno 4294975686 00000004:00080000:1.0:1788572406.143941:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a36ea9500, transno 4294975687 00000100:00100000:1.0:1788572406.143946:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584398592:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.145203:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584399104:0@lo:400:kworker.0 00000100:00100000:3.0:1788572406.145219:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788572406.145223:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584398208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.145235:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584398720:0@lo:400:kworker.0 00000100:00100000:1.0:1788572406.145244:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584399232:0@lo:400:kworker.0 00000100:00080000:3.0:1788572406.145257:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572406.145262:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572406.145265:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572406.145268:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788572406.146061:0:188079:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 10 done 00000100:00100000:0.0:1788572406.146111:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584398976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572406.146125:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584399488:0@lo:400:kworker.0 00010000:00010000:2.0:1788572406.342813:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572406.654192:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584399616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572406.654254:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.654286:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572406.654290:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584399744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572406.654303:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.654329:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584399616 00000100:00100000:1.0:1788572406.654336:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584399616 00000100:00100000:1.0:1788572406.654380:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584399744 00000100:00100000:1.0:1788572406.654383:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584399744 00000100:00100000:1.0:1788572406.654401:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6373 00000100:00100000:1.0:1788572406.654424:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584399616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572406.654457:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572406.654526:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584399616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572406.654531:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6373 00000100:00100000:1.0:1788572406.654544:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6374 00000100:00100000:1.0:1788572406.654548:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584399744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572406.654561:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572406.654578:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584399744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572406.654582:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6374 00000100:00100000:1.0:1788572406.654619:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584399744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572406.654631:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584399616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572406.660430:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572406.660456:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584399872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572406.660560:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572406.660593:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584399872 00000100:00100000:1.0:1788572406.660602:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584399872 00000100:00100000:1.0:1788572406.660652:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6375 00000100:00100000:1.0:1788572406.660661:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584399872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572406.660689:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572406.660738:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584399872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572406.660746:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6375 00000100:00100000:2.0:1788572406.661142:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584399872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572407.161256:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572407.161294:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572407.161321:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572407.161341:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572407.161384:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572407.161424:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569534336 00000100:00100000:3.0:1788572407.161428:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569534080 00000100:00100000:1.0:1788572407.161434:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569534336 00000100:00100000:3.0:1788572407.161434:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569534080 00000100:00100000:1.0:1788572407.161514:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569534464 00000100:00100000:1.0:1788572407.161517:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569534464 00000100:00100000:0.0:1788572407.161568:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569534208 00000100:00100000:0.0:1788572407.161573:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569534208 00000100:00100000:0.0:1788572407.171875:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 398 00000100:00100000:0.0:1788572407.171892:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569534208:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572407.171992:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569534208:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 106us (10649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572407.171999:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 398 00000100:00080000:0.0:1788572407.176620:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572407.176630:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572407.176633:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572407.176635:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572407.176666:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7788 00000100:00100000:0.0:1788572407.176686:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569534336:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572407.176778:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569534336:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 100us (15482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572407.176786:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7788 00000100:00100000:0.0:1788572407.176816:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569533952 00000100:00100000:0.0:1788572407.176824:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569533952 00000100:00100000:0.0:1788572407.176853:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 88 00000100:00100000:0.0:1788572407.176859:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569533952:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572407.176881:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569533952:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 23us (15560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572407.176887:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 88 00000100:00100000:3.0:1788572407.180073:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 399 00000100:00100000:3.0:1788572407.180088:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2399:x1875444569534080:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572407.180120:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36eadc00 x1875444569534080/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:68/0 lens 224/224 e 0 to 0 dl 1788572418 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572407.180190:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2399:x1875444569534080:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 106us (18944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572407.180199:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 399 00000100:00100000:1.0:1788572407.186658:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7789 00000100:00100000:1.0:1788572407.186676:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569534464:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572407.186764:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569534464:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 93us (25378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572407.186771:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7789 00010000:00010000:3.0:1788572407.359447:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788572408.191377:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350991 is committed 00010000:00010000:2.0:1788572408.191465:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191495:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191507:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191513:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572408.191517:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191525:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191546:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4c00) 00010000:00010000:2.0:1788572408.191548:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572408.191554:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191560:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109beb9d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191583:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191589:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191594:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191598:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572408.191601:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191610:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191617:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4c00) 00010000:00010000:2.0:1788572408.191619:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572408.191633:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.191639:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bebd5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.380688:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572408.701341:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584400000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572408.701416:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572408.701573:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584400000 00000100:00100000:1.0:1788572408.701581:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584400000 00000100:00100000:1.0:1788572408.701629:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6376 00000100:00100000:1.0:1788572408.701639:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584400000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572408.701670:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572408.701714:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584400000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572408.701724:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6376 00000100:00100000:1.0:1788572408.701775:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584400000:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788572408.702728:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788572408.968735:0:197847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:1.0:1788572409.409703:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572409.872748:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572409.872949:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569534592 00000100:00100000:0.0:1788572409.872961:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569534592 00000100:00100000:0.0:1788572409.873053:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1176 00000100:00100000:0.0:1788572409.873063:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:163377:x1875444569534592:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572409.873086:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572409.873110:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e600/0x265cfe11109bebea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4e7 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572409.873175:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f200/0x265cfe11109bebf1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572409.873191:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f200/0x265cfe11109bebf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572409.873204:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f200/0x265cfe11109bebf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572409.873261:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1788572409.873265:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572409.873284:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f200/0x265cfe11109bebf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572409.873308:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e600/0x265cfe11109bebea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4e7 expref: 9 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572409.873322:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f200/0x265cfe11109bebf1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4e7 expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572409.873329:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:0.0:1788572409.873331:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572409.873334:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117f200, rc 0) 00010000:00000080:0.0:1788572409.873340:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028ef800 x1875444569534592/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:70/0 lens 576/688 e 0 to 0 dl 1788572420 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788572409.873384:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163377:x1875444569534592:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 324us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572409.873389:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1176 00000100:00080000:1.0:1788572409.873456:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572409.888100:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572409.888610:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569534720 00000100:00100000:0.0:1788572409.888622:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569534720 00000100:00100000:0.0:1788572409.888901:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1177 00000100:00100000:0.0:1788572409.888913:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163377:x1875444569534720:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:0.0:1788572409.888957:0:188049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:0.0:1788572409.888978:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fafdc00 x1875444569534720/t0(0) o41->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:109/0 lens 224/368 e 0 to 0 dl 1788572459 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572409.889048:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163377:x1875444569534720:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 137us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572409.889056:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1177 00000100:00100000:0.0:1788572409.898397:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572409.898589:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569534848 00000100:00100000:2.0:1788572409.898600:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569534848 00000100:00100000:2.0:1788572409.898715:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1178 00000100:00100000:2.0:1788572409.898726:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163377:x1875444569534848:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:2.0:1788572409.898773:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00000100:00100000:2.0:1788572409.898850:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163377:x1875444569534848:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 125us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572409.898857:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1178 00000100:00100000:3.0:1788572409.902381:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572409.902949:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569534976 00000100:00100000:2.0:1788572409.902960:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569534976 00000100:00080000:0.0:1788572409.903064:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572409.903069:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572409.903192:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6377 00000100:00100000:2.0:1788572409.903202:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:163377:x1875444569534976:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:2.0:1788572409.903300:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572409.903369:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:163377:x1875444569534976:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 168us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572409.903381:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6377 00000100:00100000:2.0:1788572409.906211:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572409.906530:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569535104 00000100:00100000:1.0:1788572409.906541:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569535104 00000100:00100000:1.0:1788572409.906605:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6378 00000100:00100000:1.0:1788572409.906616:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:163377:x1875444569535104:12345-192.168.202.57@tcp:13:lfs.0 00000100:00080000:0.0:1788572409.906621:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1788572409.906650:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572409.906725:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:163377:x1875444569535104:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 111us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572409.906733:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6378 00000100:00100000:3.0:1788572409.991724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572409.991764:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569535360 00000100:00100000:3.0:1788572409.991775:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569535360 00000100:00100000:3.0:1788572409.991828:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1179 00000100:00100000:3.0:1788572409.991838:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163384:x1875444569535360:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00010000:3.0:1788572409.991906:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572409.991935:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f200/0x265cfe11109bebf1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4e7 expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.991955:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572409.991961:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572409.992039:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992053:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992065:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992080:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992088:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992095:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992518:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992531:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992538:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992546:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572409.992550:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992574:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992584:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572409.992587:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572409.992591:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992597:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce200/0x265cfe11109bebf8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572409.992607:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000208141bc reply state 00000000deddd9a2 transno 347892350992 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992618:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572409.992623:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4000) 00010000:00010000:3.0:1788572409.992625:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572409.992628:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1788572409.992652:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028edc00 x1875444569535360/t347892350992(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:109/0 lens 528/448 e 0 to 0 dl 1788572459 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572409.992716:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:163384:x1875444569535360:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 879us (1003us total) trans 347892350992 rc 0/0 00000100:00100000:3.0:1788572409.992723:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1179 00000100:00100000:0.0:1788572410.024828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572410.024878:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569535488 00000100:00100000:2.0:1788572410.024889:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569535488 00000100:00100000:2.0:1788572410.024949:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1180 00000100:00100000:2.0:1788572410.024961:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:163387:x1875444569535488:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:2.0:1788572410.024984:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572410.025004:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7aa00/0x265cfe11109bec06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4ee expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572410.025069:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b000/0x265cfe11109bec0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572410.025084:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b000/0x265cfe11109bec0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572410.025098:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b000/0x265cfe11109bec0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572410.025155:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572410.025159:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572410.025177:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b000/0x265cfe11109bec0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572410.025203:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7aa00/0x265cfe11109bec06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4ee expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572410.025222:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b000/0x265cfe11109bec0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4ee expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572410.025236:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:2.0:1788572410.025239:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572410.025243:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7b000, rc 0) 00010000:00000080:2.0:1788572410.025251:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fdf7b80 x1875444569535488/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:110/0 lens 576/688 e 0 to 0 dl 1788572460 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788572410.025320:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163387:x1875444569535488:12345-192.168.202.57@tcp:101:rm.0 Request processed in 361us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572410.025327:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1180 00000100:00100000:3.0:1788572410.031435:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572410.031588:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569535616 00000100:00100000:0.0:1788572410.031597:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569535616 00000100:00100000:0.0:1788572410.031646:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1181 00000100:00100000:0.0:1788572410.031654:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:163387:x1875444569535616:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:0.0:1788572410.031674:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572410.031698:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bec14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4f5 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.031764:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.031780:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.031792:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.031814:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.031823:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.031830:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032016:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109bec29 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032023:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109bec29 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032028:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109bec29 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572410.032071:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x6:0x0]: returning size 0 00000004:00200000:0.0:1788572410.032074:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572410.032088:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109bec29 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032096:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109bec29 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032101:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032106:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032110:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032114:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572410.032117:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032122:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032129:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:0.0:1788572410.032131:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572410.032133:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032140:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109bec1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032148:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032152:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032156:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032158:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572410.032160:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032163:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032167:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4000) 00010000:00010000:0.0:1788572410.032168:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572410.032170:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032173:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e400/0x265cfe11109bec22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032190:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bec14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4f5 expref: 12 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032201:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109bec29 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4f5 expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.032205:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x6:0x0].0x0 (ffff8e5a36aab700) 00010000:00010000:0.0:1788572410.032207:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572410.032208:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117fa00, rc 0) 00010000:00000080:0.0:1788572410.032214:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028ec000 x1875444569535616/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:110/0 lens 600/584 e 0 to 0 dl 1788572460 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788572410.032282:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:163387:x1875444569535616:12345-192.168.202.57@tcp:101:rm.0 Request processed in 627us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572410.032290:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1181 00000100:00100000:3.0:1788572410.038368:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572410.038436:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569535872 00000100:00100000:1.0:1788572410.038452:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569535872 00000100:00100000:1.0:1788572410.038638:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1182 00000100:00100000:1.0:1788572410.038648:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:163387:x1875444569535872:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572410.038710:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788572410.038734:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109bec29 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4f5 expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038763:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x6:0x0].0x0 (ffff8e5a36aab700) 00010000:00010000:1.0:1788572410.038779:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b000/0x265cfe11109bec0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4ee expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038790:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572410.038794:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572410.038814:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038826:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038836:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038846:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038854:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038860:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038948:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 3/0,1 mode: --/EX res: [0x200027501:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038955:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.038961:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039163:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039172:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039184:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039191:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039197:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039203:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039237:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572410.039253:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039259:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039266:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039271:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572410.039276:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039283:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.039286:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572410.039291:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x6:0x0].0x0 (ffff8e5a029f6200) 00010000:00010000:0.0:1788572410.039293:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039293:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572410.039297:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 2/0,0 mode: --/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.039299:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572410.039302:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039303:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255800/0x265cfe11109bec3e lrc: 0/0,0 mode: --/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.039309:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.039317:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x6:0x0].0x0 (ffff8e5a029f6200) 00010000:00010000:0.0:1788572410.039319:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788572410.039320:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.039323:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 1/0,0 mode: --/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039326:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.039329:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255400/0x265cfe11109bec45 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039333:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039337:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572410.039339:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039345:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039351:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572410.039353:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572410.039355:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572410.039355:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572410.039357:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572410.039358:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572410.039361:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254200/0x265cfe11109bec30 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572410.039371:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e8a2893 reply state 0000000073261e22 transno 347892350993 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039387:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572410.039393:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4000) 00010000:00010000:1.0:1788572410.039396:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572410.039399:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1788572410.039415:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028eea00 x1875444569535872/t347892350993(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:110/0 lens 512/456 e 0 to 0 dl 1788572460 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572410.039514:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:163387:x1875444569535872:12345-192.168.202.57@tcp:36:rm.0 Request processed in 866us (1152us total) trans 347892350993 rc 0/0 00000100:00100000:1.0:1788572410.039522:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1182 00010000:00010000:2.0:1788572410.429024:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572411.260971:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584400128:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261046:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261096:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584400640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261121:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261139:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584401152:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261158:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261171:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584401664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261206:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572411.261210:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584400256:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261239:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584400768:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261256:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261270:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584401280:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261289:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261312:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584400512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261331:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261343:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584401024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261360:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261371:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584401536:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261386:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261398:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572411.261402:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584400384:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261419:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261427:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584400896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261442:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261449:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584401408:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.261463:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.261514:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584400640 00000100:00100000:1.0:1788572411.261522:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584400640 00000100:00100000:1.0:1788572411.261570:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584400768 00000100:00100000:1.0:1788572411.261573:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584400768 00000100:00100000:1.0:1788572411.261587:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584401536 00000100:00100000:1.0:1788572411.261590:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584401536 00000100:00100000:1.0:1788572411.261604:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584401408 00000100:00100000:1.0:1788572411.261606:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584401408 00000100:00100000:1.0:1788572411.261624:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7790 00000100:00100000:2.0:1788572411.261776:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584400128 00000100:00100000:2.0:1788572411.261780:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584400128 00000100:00100000:2.0:1788572411.261807:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788572411.261814:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3bf45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584400128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572411.261906:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3bf45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584400128:12345-0@lo:400:kworker.0 Request processed in 93us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572411.261913:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788572411.262835:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584401152 00000100:00100000:3.0:1788572411.262842:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584401152 00000100:00100000:3.0:1788572411.262870:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584401664 00000100:00100000:3.0:1788572411.262872:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584401664 00000100:00100000:3.0:1788572411.262882:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584400256 00000100:00100000:3.0:1788572411.262884:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584400256 00000100:00100000:3.0:1788572411.262893:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584401024 00000100:00100000:3.0:1788572411.262896:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584401024 00000100:00100000:3.0:1788572411.262906:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584400384 00000100:00100000:3.0:1788572411.262909:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584400384 00000100:00100000:3.0:1788572411.262918:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584400896 00000100:00100000:3.0:1788572411.262920:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584400896 00000100:00100000:3.0:1788572411.262931:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1788572411.262938:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584401152:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572411.262956:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36eae680 x1875444584401152/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:72/0 lens 224/224 e 0 to 0 dl 1788572422 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572411.263000:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584401152:12345-0@lo:400:kworker.0 Request processed in 63us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.263006:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1788572411.263019:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1788572411.263024:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584401664:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572411.263033:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36eace00 x1875444584401664/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:72/0 lens 224/224 e 0 to 0 dl 1788572422 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572411.263054:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584401664:12345-0@lo:400:kworker.0 Request processed in 30us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.263059:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1788572411.263068:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1788572411.263073:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584400256:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572411.263082:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ead880 x1875444584400256/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:72/0 lens 224/224 e 0 to 0 dl 1788572422 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572411.263101:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584400256:12345-0@lo:400:kworker.0 Request processed in 29us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.263106:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1788572411.263114:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1788572411.263118:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584401024:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572411.263127:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590542df80 x1875444584401024/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:72/0 lens 224/224 e 0 to 0 dl 1788572422 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572411.263166:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584401024:12345-0@lo:400:kworker.0 Request processed in 47us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.263171:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1788572411.263181:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788572411.263186:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584400384:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572411.263195:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36947100 x1875444584400384/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:72/0 lens 224/224 e 0 to 0 dl 1788572422 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572411.263217:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584400384:12345-0@lo:400:kworker.0 Request processed in 31us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.263222:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788572411.263230:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1788572411.263235:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584400896:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572411.263245:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36946d80 x1875444584400896/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:72/0 lens 224/224 e 0 to 0 dl 1788572422 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572411.263264:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584400896:12345-0@lo:400:kworker.0 Request processed in 29us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.263269:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1788572411.263288:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7791 00000100:00100000:3.0:1788572411.263294:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584400768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572411.263319:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584400768:12345-0@lo:400:kworker.0 Request processed in 26us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.263324:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7791 00000100:00100000:3.0:1788572411.263335:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7792 00000100:00100000:3.0:1788572411.263340:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584401536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572411.263360:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584401536:12345-0@lo:400:kworker.0 Request processed in 20us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.263365:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7792 00000100:00100000:3.0:1788572411.263373:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7793 00000100:00100000:3.0:1788572411.263378:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584401408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572411.263399:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584401408:12345-0@lo:400:kworker.0 Request processed in 21us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.263403:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7793 00000100:00100000:1.0:1788572411.264796:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584400640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.264871:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584400640:12345-0@lo:400:kworker.0 Request processed in 95us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572411.264882:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7790 00000100:00100000:1.0:1788572411.264925:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584401280 00000100:00100000:1.0:1788572411.264932:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584401280 00000100:00100000:1.0:1788572411.264963:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584400512 00000100:00100000:1.0:1788572411.264966:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584400512 00000100:00100000:1.0:1788572411.264976:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1788572411.264982:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584401280:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572411.264997:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36eaf480 x1875444584401280/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:72/0 lens 224/224 e 0 to 0 dl 1788572422 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572411.265022:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584401280:12345-0@lo:400:kworker.0 Request processed in 40us (3732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572411.265028:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1788572411.265037:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1788572411.265042:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584400512:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572411.265052:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36eaf100 x1875444584400512/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:72/0 lens 224/224 e 0 to 0 dl 1788572422 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572411.265072:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584400512:12345-0@lo:400:kworker.0 Request processed in 30us (3740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572411.265077:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00080000:1.0:1788572411.265102:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572411.265107:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572411.265111:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572411.265114:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572411.265157:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584400256:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.265172:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584400768:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.265181:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584401280:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.265191:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584400128:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.265201:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584400640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.265213:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584401152:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.265224:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584401664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572411.265266:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572411.265275:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584401792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572411.265310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.265343:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584401792 00000100:00100000:1.0:1788572411.265347:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584401792 00000100:00100000:1.0:1788572411.265368:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1788572411.265374:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584401792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572411.265403:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00010000:00000080:1.0:1788572411.265415:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36946680 x1875444584401792/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:72/0 lens 224/368 e 0 to 0 dl 1788572422 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572411.265445:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584401792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572411.265450:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1788572411.265514:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584401792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572411.267556:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584400384:0@lo:400:kworker.0 00000100:00100000:2.0:1788572411.267574:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584400896:0@lo:400:kworker.0 00000100:00100000:2.0:1788572411.267588:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584401408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572411.267599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584400512:0@lo:400:kworker.0 00000100:00100000:2.0:1788572411.267611:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584401024:0@lo:400:kworker.0 00000100:00100000:2.0:1788572411.267622:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584401536:0@lo:400:kworker.0 00000100:00100000:2.0:1788572411.267667:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572411.267676:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584401920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572411.267727:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.267882:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584401920 00000100:00100000:1.0:1788572411.267889:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584401920 00000100:00100000:1.0:1788572411.267947:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1788572411.267956:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584401920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572411.267991:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:1.0:1788572411.268006:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fface00 x1875444584401920/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:72/0 lens 224/368 e 0 to 0 dl 1788572422 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572411.268056:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584401920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572411.268063:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1788572411.272817:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584401920:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788572411.454638:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572411.777055:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584402048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572411.777152:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.777213:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584402176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572411.777237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572411.777272:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584402048 00000100:00100000:1.0:1788572411.777280:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584402048 00000100:00100000:1.0:1788572411.781383:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584402176 00000100:00100000:1.0:1788572411.781399:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584402176 00000100:00100000:1.0:1788572411.781439:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6379 00000100:00100000:1.0:1788572411.781449:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584402048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572411.781515:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572411.781604:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584402048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (4451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572411.781610:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6379 00000100:00100000:1.0:1788572411.781629:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6380 00000100:00100000:1.0:1788572411.781635:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584402176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572411.781652:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572411.781687:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584402176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572411.781765:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6380 00000100:00100000:1.0:1788572411.781826:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584402176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572411.781873:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584402048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572411.784960:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572411.788101:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584402304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572411.788187:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572411.788404:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584402304 00000100:00100000:3.0:1788572411.788413:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584402304 00000100:00100000:3.0:1788572411.788466:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6381 00000100:00100000:3.0:1788572411.788476:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584402304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572411.788534:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572411.788583:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584402304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.788589:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6381 00000100:00100000:2.0:1788572411.790308:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584402304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572412.270205:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572412.270247:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572412.270287:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572412.270318:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572412.270348:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572412.270389:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569536512 00000100:00100000:3.0:1788572412.270399:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569536512 00000100:00100000:3.0:1788572412.270454:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569536384 00000100:00100000:3.0:1788572412.270457:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569536384 00000100:00100000:3.0:1788572412.270508:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7794 00000100:00100000:3.0:1788572412.270528:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569536512:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572412.270601:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569536512:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 84us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572412.270609:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7794 00000100:00100000:3.0:1788572412.270633:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7795 00000100:00100000:3.0:1788572412.270640:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569536384:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572412.270666:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569536384:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572412.270672:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7795 00000100:00100000:3.0:1788572412.270694:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569536256 00000100:00100000:3.0:1788572412.270697:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569536256 00000100:00100000:3.0:1788572412.270738:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569536128 00000100:00100000:3.0:1788572412.270742:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569536128 00000100:00100000:3.0:1788572412.270765:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 406 00000100:00100000:3.0:1788572412.270772:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569536256:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572412.270812:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028eed80 x1875444569536256/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:112/0 lens 224/224 e 0 to 0 dl 1788572462 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572412.270840:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569536256:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 69us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572412.270848:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 406 00000100:00100000:3.0:1788572412.270863:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 407 00000100:00100000:3.0:1788572412.270870:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2399:x1875444569536128:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572412.270886:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028ec380 x1875444569536128/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:112/0 lens 224/224 e 0 to 0 dl 1788572462 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572412.270908:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2399:x1875444569536128:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 39us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572412.270914:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 407 00000100:00080000:3.0:1788572412.270934:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572412.270938:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572412.270942:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572412.270944:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572412.271320:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569536000 00000100:00100000:0.0:1788572412.271327:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569536000 00000100:00100000:0.0:1788572412.271366:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 90 00000100:00100000:0.0:1788572412.271374:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569536000:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572412.271407:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569536000:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 34us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572412.271414:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 90 00010000:00010000:2.0:1788572412.481939:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572412.802094:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca540 going to sleep for 1 seconds 00010000:00010000:1.0:1788572413.500668:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572413.822200:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584402432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572413.822274:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572413.826650:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca540 going to sleep for 1 seconds 00000100:00100000:1.0:1788572413.826681:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584402432 00000100:00100000:1.0:1788572413.826691:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584402432 00000100:00100000:1.0:1788572413.826756:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6382 00000100:00100000:1.0:1788572413.826766:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584402432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572413.826799:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572413.826877:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584402432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (4603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572413.826885:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6382 00000100:00080000:2.0:1788572413.831244:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572413.831329:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584402432:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572414.530996:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572414.847785:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca540 going to sleep for 1 seconds 00010000:00010000:2.0:1788572415.549883:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572415.868773:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca540 going to sleep for 1 seconds 00000001:00080000:1.0:1788572415.872135:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350993 is committed 00010000:00010000:0.0:1788572415.878321:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878350:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878358:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878365:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572415.878370:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878378:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878401:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4000) 00010000:00010000:0.0:1788572415.878405:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572415.878411:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878417:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bebff lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878440:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878448:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878453:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878458:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572415.878461:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878467:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878476:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a1fbf4000) 00010000:00010000:0.0:1788572415.878499:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572415.878502:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572415.878508:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bec37 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572416.380866:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584402688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.380962:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572416.381046:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584403200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.381078:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572416.381113:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584403712:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.381142:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572416.381172:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572416.381178:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584402816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.381202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572416.381222:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584403328:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.381244:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572416.381263:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584403840:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.381288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572416.381343:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584402688 00000100:00100000:2.0:1788572416.381352:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584402688 00000100:00100000:2.0:1788572416.381413:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584402816 00000100:00100000:2.0:1788572416.381417:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584402816 00000100:00100000:2.0:1788572416.381434:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584403328 00000100:00100000:2.0:1788572416.381437:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584403328 00000100:00100000:2.0:1788572416.381457:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1788572416.381467:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584402688:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572416.381523:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905166a00 x1875444584402688/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:116/0 lens 224/224 e 0 to 0 dl 1788572466 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572416.381571:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584402688:12345-0@lo:400:kworker.0 Request processed in 104us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572416.381579:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1788572416.381612:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1788572416.381618:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584402816:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572416.381631:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905167b80 x1875444584402816/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:116/0 lens 224/224 e 0 to 0 dl 1788572466 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572416.381656:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584402816:12345-0@lo:400:kworker.0 Request processed in 39us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572416.381662:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1788572416.381673:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1788572416.381678:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584403328:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572416.381688:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905167100 x1875444584403328/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:116/0 lens 224/224 e 0 to 0 dl 1788572466 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572416.381711:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584403328:12345-0@lo:400:kworker.0 Request processed in 32us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572416.381717:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1788572416.381735:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584403200 00000100:00100000:2.0:1788572416.381739:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584403200 00000100:00100000:2.0:1788572416.381768:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584403840 00000100:00100000:2.0:1788572416.381772:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584403840 00000100:00100000:2.0:1788572416.381794:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7796 00000100:00100000:2.0:1788572416.381800:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584403200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.381830:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584403200:12345-0@lo:400:kworker.0 Request processed in 31us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572416.381836:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7796 00000100:00100000:2.0:1788572416.381847:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7797 00000100:00100000:2.0:1788572416.381852:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584403840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.381877:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584403840:12345-0@lo:400:kworker.0 Request processed in 26us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572416.381883:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7797 00000100:00100000:2.0:1788572416.381901:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584403712 00000100:00100000:2.0:1788572416.381904:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584403712 00000100:00100000:2.0:1788572416.381927:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1788572416.381933:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584403712:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572416.381947:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905166680 x1875444584403712/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:77/0 lens 224/224 e 0 to 0 dl 1788572427 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572416.381972:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584403712:12345-0@lo:400:kworker.0 Request processed in 39us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572416.381978:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00080000:2.0:1788572416.382010:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572416.382014:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572416.382018:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572416.382020:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572416.382066:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584402816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.382077:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584403328:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.382086:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584403840:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.382094:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584402688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.382102:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584403200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.382110:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584403712:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.382142:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584404224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572416.382168:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572416.382291:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584402560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572416.382330:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572416.382354:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584403072:0@lo:400:kworker.0 00000100:00100000:1.0:1788572416.382376:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572416.382390:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584403584:0@lo:400:kworker.0 00000100:00100000:1.0:1788572416.382413:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572416.382428:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584404096:0@lo:400:kworker.0 00000100:00100000:1.0:1788572416.382448:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572416.382465:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572416.382470:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584402944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572416.382514:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572416.382529:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584403456:0@lo:400:kworker.0 00000100:00100000:1.0:1788572416.382553:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572416.382568:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584403968:0@lo:400:kworker.0 00000100:00100000:1.0:1788572416.382588:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572416.382626:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584403584 00000100:00100000:1.0:1788572416.382630:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584403584 00000100:00100000:2.0:1788572416.382639:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584402560 00000100:00100000:2.0:1788572416.382642:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584402560 00000100:00100000:1.0:1788572416.382659:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584404096 00000100:00100000:1.0:1788572416.382662:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584404096 00000100:00100000:2.0:1788572416.382668:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788572416.382672:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584403456 00000100:00100000:1.0:1788572416.382675:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584403456 00000100:00100000:2.0:1788572416.382675:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584402560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572416.382689:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1788572416.382695:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584403584:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572416.382708:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36944e00 x1875444584403584/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:116/0 lens 224/224 e 0 to 0 dl 1788572466 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572416.382711:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584402560:12345-0@lo:400:kworker.0 Request processed in 37us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572416.382718:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788572416.382734:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584403584:12345-0@lo:400:kworker.0 Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572416.382740:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1788572416.382756:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1788572416.382757:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584402560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572416.382761:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.382768:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584403584:0@lo:400:kworker.0 00010000:00000080:1.0:1788572416.382771:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36944700 x1875444584404096/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:116/0 lens 224/224 e 0 to 0 dl 1788572466 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572416.382815:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584404096:12345-0@lo:400:kworker.0 Request processed in 53us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572416.382913:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584404224 00000100:00100000:3.0:1788572416.382919:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584404224 00000100:00100000:3.0:1788572416.382941:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584402944 00000100:00100000:3.0:1788572416.382944:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584402944 00000100:00100000:3.0:1788572416.382956:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1788572416.382961:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:3641:x1875444584404224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572416.382994:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:3.0:1788572416.383009:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36aadf80 x1875444584404224/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:77/0 lens 224/368 e 0 to 0 dl 1788572427 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572416.383044:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:3641:x1875444584404224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572416.383050:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1788572416.383066:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1788572416.383072:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584402944:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572416.383083:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36947b80 x1875444584402944/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:77/0 lens 224/224 e 0 to 0 dl 1788572427 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572416.383108:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584402944:12345-0@lo:400:kworker.0 Request processed in 36us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572416.383114:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1788572416.383217:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1788572416.383227:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584403456:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572416.383239:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36945880 x1875444584403456/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:116/0 lens 224/224 e 0 to 0 dl 1788572466 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572416.383267:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584403456:12345-0@lo:400:kworker.0 Request processed in 43us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572416.383290:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584403072 00000100:00100000:0.0:1788572416.383295:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584403072 00000100:00100000:0.0:1788572416.383345:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584403968 00000100:00100000:0.0:1788572416.383348:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584403968 00000100:00100000:0.0:1788572416.383373:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7798 00000100:00100000:0.0:1788572416.383380:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584403072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572416.383418:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584403072:12345-0@lo:400:kworker.0 Request processed in 39us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572416.383425:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7798 00000100:00100000:0.0:1788572416.383441:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7799 00000100:00100000:0.0:1788572416.383448:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584403968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572416.383476:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584403968:12345-0@lo:400:kworker.0 Request processed in 29us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572416.383499:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7799 00000100:00100000:3.0:1788572416.384572:0:188048:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1788572416.384589:0:188048:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:3.0:1788572416.384783:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584404352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572416.384877:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572416.384936:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584404352 00000100:00100000:3.0:1788572416.384942:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584404352 00000100:00100000:3.0:1788572416.384993:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1788572416.385009:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584404352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572416.385047:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446010880 avail 1299771392 00010000:00000080:3.0:1788572416.385063:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028ee680 x1875444584404352/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:77/0 lens 224/368 e 0 to 0 dl 1788572427 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572416.385107:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584404352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572416.385114:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1788572416.385164:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584404352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572416.385203:0:188049:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1788572416.391223:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1788572416.391233:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00080000:2.0:1788572416.391286:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572416.391293:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572416.391297:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572416.391301:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572416.391432:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584402944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.391453:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584403456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.391469:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584403968:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.391560:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584403072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.391575:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584404096:0@lo:400:kworker.0 00000100:00100000:2.0:1788572416.391655:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584404224:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788572416.576623:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572416.892948:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca540 going to sleep for 1 seconds 00000100:00100000:2.0:1788572416.892965:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572416.892983:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584404480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572416.893056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572416.893100:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584404480 00000100:00100000:2.0:1788572416.893191:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584404480 00000100:00100000:2.0:1788572416.893244:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6383 00000100:00100000:2.0:1788572416.893252:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584404480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572416.893283:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572416.893326:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584404480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572416.893337:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6383 00000100:00100000:2.0:1788572416.893382:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584404480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572416.895827:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572416.895856:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584404608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572416.895935:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572416.896007:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584404608 00000100:00100000:0.0:1788572416.896017:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584404608 00000100:00100000:0.0:1788572416.896073:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6384 00000100:00100000:0.0:1788572416.896083:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584404608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572416.896124:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572416.896176:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584404608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572416.896183:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6384 00000100:00100000:0.0:1788572416.896237:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584404608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572416.897806:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572416.897833:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584404736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572416.897885:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572416.897929:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584404736 00000100:00100000:0.0:1788572416.897935:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584404736 00000100:00100000:0.0:1788572416.897973:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6385 00000100:00100000:0.0:1788572416.897983:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584404736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572416.898015:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572416.898062:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584404736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572416.898069:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6385 00000100:00100000:0.0:1788572416.898121:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584404736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572417.388252:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572417.388304:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572417.388339:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572417.388451:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569536640 00000100:00100000:0.0:1788572417.388462:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569536640 00000100:00100000:0.0:1788572417.388535:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 92 00000100:00100000:0.0:1788572417.388556:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569536640:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572417.388639:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569536640:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 94us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572417.388647:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 92 00000100:00100000:3.0:1788572417.388795:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572417.388928:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572417.388951:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569537152 00000100:00100000:3.0:1788572417.388955:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569537152 00000100:00100000:3.0:1788572417.388991:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569537024 00000100:00100000:3.0:1788572417.388993:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569537024 00000100:00100000:3.0:1788572417.389010:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7800 00000100:00100000:3.0:1788572417.389017:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569537152:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572417.389048:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569537152:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 32us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572417.389054:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7800 00000100:00100000:3.0:1788572417.389069:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7801 00000100:00100000:3.0:1788572417.389074:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569537024:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572417.389093:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569537024:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 19us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572417.389098:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7801 00000100:00080000:3.0:1788572417.389158:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572417.389162:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572417.389231:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569536896 00000100:00100000:1.0:1788572417.389236:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569536896 00000100:00100000:1.0:1788572417.389274:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569536768 00000100:00100000:1.0:1788572417.389278:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569536768 00000100:00100000:1.0:1788572417.389300:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 414 00000100:00100000:1.0:1788572417.389307:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569536896:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572417.389325:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e59028edf80 x1875444569536896/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:117/0 lens 224/224 e 0 to 0 dl 1788572467 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572417.389375:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569536896:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 68us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.389382:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 414 00000100:00100000:1.0:1788572417.389397:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 415 00000100:00100000:1.0:1788572417.389403:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569536768:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572417.389415:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905fed180 x1875444569536768/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:117/0 lens 224/224 e 0 to 0 dl 1788572467 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572417.389436:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569536768:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 34us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.389443:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 415 00000100:00080000:3.0:1788572417.390990:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572417.391000:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788572417.612648:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572417.850405:0:198243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00000100:00000400:0.0:1788572417.923382:0:188074:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572401/real 1788572401] req@ffff8e590a2d1500 x1875444584396032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 1 dl 1788572417 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572417.923412:0:188074:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788572417.923416:0:188074:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788572417.923421:0:188074:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1788572417.923445:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca540 going to sleep for 0 seconds 00000100:00080000:3.0:1788572417.923600:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572417.923604:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572417.923607:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572417.923612:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9128 00000100:00080000:3.0:1788572417.923621:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a1f80e800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572417.923650:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905feea00 x1875444584405248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572417.923732:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584405120:0@lo:400:kworker.0 00000100:00100000:3.0:1788572417.923795:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572417.923830:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584405760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572417.923866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572417.923881:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584406272:0@lo:400:kworker.0 00000100:00100000:3.0:1788572417.923905:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572417.923925:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788572417.923931:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584404992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572417.923952:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572417.923968:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584405632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572417.923985:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572417.924001:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584406144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572417.924019:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572417.924046:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584405248:0@lo:38:kworker.0 00000100:00100000:3.0:1788572417.924074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572417.924105:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584405120 00000100:00100000:3.0:1788572417.924113:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584405120 00000100:00100000:3.0:1788572417.924155:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584405760 00000100:00100000:3.0:1788572417.924158:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584405760 00000100:00100000:3.0:1788572417.924171:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584404992 00000100:00100000:3.0:1788572417.924173:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584404992 00000100:00100000:3.0:1788572417.924182:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584405632 00000100:00100000:3.0:1788572417.924184:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584405632 00000100:00100000:1.0:1788572417.924594:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584405376:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.924641:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572417.924668:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584405888:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.924689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572417.924700:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584406400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.924718:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572417.924730:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572417.924736:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584404864:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.924763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572417.924789:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584405504:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.924810:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572417.924826:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584406016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.924858:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572417.924888:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584405888 00000100:00100000:1.0:1788572417.924892:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584405888 00000100:00100000:1.0:1788572417.924915:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584406400 00000100:00100000:1.0:1788572417.924917:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584406400 00000100:00100000:1.0:1788572417.924934:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1788572417.924941:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584405120:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572417.924966:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40523100 x1875444584405120/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1788572428 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572417.925007:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584405120:12345-0@lo:400:kworker.0 Request processed in 66us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925014:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1788572417.925033:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788572417.925039:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584405760:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572417.925051:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40523800 x1875444584405760/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1788572428 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572417.925076:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584405760:12345-0@lo:400:kworker.0 Request processed in 37us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925081:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788572417.925094:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788572417.925100:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584404992:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572417.925110:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40521f80 x1875444584404992/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1788572428 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572417.925137:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584404992:12345-0@lo:400:kworker.0 Request processed in 38us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925146:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788572417.925158:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788572417.925163:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584405888:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572417.925174:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36947800 x1875444584405888/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1788572428 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572417.925217:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584405888:12345-0@lo:400:kworker.0 Request processed in 54us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925224:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788572417.925236:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1788572417.925242:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584406400:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572417.925253:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cb9180 x1875444584406400/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1788572428 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572417.925277:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584406400:12345-0@lo:400:kworker.0 Request processed in 36us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925283:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1788572417.925300:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584406272 00000100:00100000:1.0:1788572417.925304:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584406272 00000100:00100000:1.0:1788572417.925327:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584406144 00000100:00100000:1.0:1788572417.925329:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584406144 00000100:00100000:1.0:1788572417.925344:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584405376 00000100:00100000:1.0:1788572417.925347:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584405376 00000100:00100000:1.0:1788572417.925362:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584405504 00000100:00100000:1.0:1788572417.925364:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584405504 00000100:00100000:1.0:1788572417.925381:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7802 00000100:00100000:1.0:1788572417.925386:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584406272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.925417:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584406272:12345-0@lo:400:kworker.0 Request processed in 31us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925423:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7802 00000100:00100000:1.0:1788572417.925434:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7803 00000100:00100000:1.0:1788572417.925440:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584406144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.925467:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584406144:12345-0@lo:400:kworker.0 Request processed in 27us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925472:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7803 00000100:00100000:1.0:1788572417.925507:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7804 00000100:00100000:1.0:1788572417.925514:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584405376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.925540:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584405376:12345-0@lo:400:kworker.0 Request processed in 27us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925546:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7804 00000100:00100000:1.0:1788572417.925555:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7805 00000100:00100000:1.0:1788572417.925561:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584405504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.925586:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584405504:12345-0@lo:400:kworker.0 Request processed in 25us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925591:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7805 00000100:00100000:1.0:1788572417.925804:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584404864 00000100:00100000:1.0:1788572417.925809:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584404864 00000100:00100000:1.0:1788572417.925837:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788572417.925844:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584404864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.925875:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584404864:12345-0@lo:400:kworker.0 Request processed in 31us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.925881:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788572417.925940:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584404864:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.925956:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584405504:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.925967:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584405376:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.925979:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584405888:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.925990:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584406400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.926028:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584404992:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.926041:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584406144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.926052:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584405120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.926064:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584405760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.926073:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584406272:0@lo:400:kworker.0 00000100:00100000:3.0:1788572417.926560:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1788572417.926568:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584405632:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572417.926592:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40520e00 x1875444584405632/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1788572428 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572417.926647:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584405632:12345-0@lo:400:kworker.0 Request processed in 79us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572417.926652:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1788572417.926683:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584405248 00000100:00100000:3.0:1788572417.926688:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584405248 00000100:00100000:3.0:1788572417.926710:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584406016 00000100:00100000:3.0:1788572417.926713:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584406016 00000100:00100000:3.0:1788572417.926728:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1788572417.926733:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3640:x1875444584405248:12345-0@lo:38:kworker.0 00010000:02000400:3.0:1788572417.926755:0:188054:0:(ldlm_lib.c:1363:target_handle_connect()) lustre-MDT0000: Received new MDS connection from 0@lo, keep former export from same NID 00000100:00100000:0.0:1788572417.931316:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1788572417.931338:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584406016:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572417.931372:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cb8000 x1875444584406016/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1788572428 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572417.931457:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584406016:12345-0@lo:400:kworker.0 Request processed in 128us (6610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572417.931465:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1788572417.931545:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584406016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572417.932531:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584405632:0@lo:400:kworker.0 00010000:00080000:3.0:1788572417.936696:0:188054:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp ffff8e5a0f02d000 cur 9170 last 1788572370 00000004:00100000:3.0:1788572417.936749:0:188054:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli 0@lo does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572417.936768:0:188054:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d2000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788572417.936776:0:188054:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d2000 : changing import state from RECOVER to FULL 00010000:00000080:3.0:1788572417.936798:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40522d80 x1875444584405248/t0(0) o38->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788572437 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572417.937180:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3640:x1875444584405248:12345-0@lo:38:kworker.0 Request processed in 10444us (13102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572417.937200:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00080000:0.0:1788572417.938531:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 81 00000100:00080000:0.0:1788572417.938548:0:3640:0:(import.c:1341:ptlrpc_connect_interpret()) reconnected to lustre-MDT0000_UUID@0@lo after partition 00000100:00080000:0.0:1788572417.938551:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788572417.938557:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788572417.938569:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1788572417.938576:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007be8d0dc): req@ffff8e590a2d1500 x1875444584396032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 1 dl 1788572417 ref 2 fl Rpc:XQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572417.938605:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584405248:0@lo:38:kworker.0 00000100:00100000:0.0:1788572417.938711:0:188074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572417.938739:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fbca540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572417.938758:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584396032 00000100:00100000:0.0:1788572417.938764:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584396032 00000100:00100000:0.0:1788572417.938806:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1788572417.938814:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:188074:x1875444584396032:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1788572417.938845:0:189111:0:(tgt_handler.c:3154:tgt_check_resent()) @@@ reconstruct resent RPC req@ffff8e5a1fdf7480 x1875444584396032/t347892350989(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:78/0 lens 2520/4320 e 0 to 0 dl 1788572428 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:0.0:1788572417.939421:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5904dfc208 index 0: rc = 0 00000020:00080000:0.0:1788572417.939426:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5904dfc208 index 1: rc = 0 00000020:00080000:0.0:1788572417.939429:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5904dfc208 index 2: rc = 0 00000020:00080000:0.0:1788572417.939435:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5904dfc208 index 3: rc = 0 00000020:00080000:0.0:1788572417.939441:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5904dfc208 index 4: rc = 0 00000020:00080000:0.0:1788572417.939444:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5904dfc208 index 5: rc = 0 00000020:00080000:0.0:1788572417.939446:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5904dfc208 index 6: rc = 0 00000020:00080000:0.0:1788572417.939448:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5904dfc208 index 7: rc = 0 00010000:00000080:0.0:1788572417.939458:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fdf7480 x1875444584396032/t347892350989(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:78/0 lens 2520/4320 e 0 to 0 dl 1788572428 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572417.939537:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:188074:x1875444584396032:12345-0@lo:1000:osp_up0-1.0 Request processed in 723us (826us total) trans 347892350989 rc 0/0 00000100:00100000:0.0:1788572417.939544:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1788572417.939573:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584406528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572417.939610:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572417.939654:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584406528 00000100:00100000:0.0:1788572417.939658:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584406528 00000100:00100000:0.0:1788572417.939683:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1788572417.939690:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3642:x1875444584406528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572417.939712:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:0.0:1788572417.939725:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fdf4700 x1875444584406528/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:78/0 lens 224/368 e 0 to 0 dl 1788572428 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572417.939756:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3642:x1875444584406528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572417.939762:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1788572417.939793:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584406528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572417.940101:0:188074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584396032:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788572417.940114:0:188074:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e590639b300 version 7 rpc_version 7 00000020:00100000:3.0:1788572417.940133:0:188074:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572417.940138:0:188074:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a40521880 x1875444584406784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572417.940153:0:188074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584406784:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572417.940181:0:188074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572417.940271:0:188074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f3d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788572417.940288:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584406784 00000100:00100000:3.0:1788572417.940292:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584406784 00000100:00100000:3.0:1788572417.940319:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1788572417.940325:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:188074:x1875444584406784:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:3.0:1788572417.940459:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40520700 x1875444584406784/t347892350994(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:78/0 lens 488/4320 e 0 to 0 dl 1788572428 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572417.940518:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:188074:x1875444584406784:12345-0@lo:1000:osp_up0-1.0 Request processed in 192us (335us total) trans 347892350994 rc 0/0 00000100:00100000:3.0:1788572417.940525:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1788572417.940557:0:188074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:188074:1875444584406784:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1788572417.944330:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.944361:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.944377:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572417.944398:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e35065b7 reply state 0000000014388dc3 transno 21474837549 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.944407:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.944414:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572417.944417:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572417.944422:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788572417.944427:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x16:0x0]: returning size 4096 00000004:00080000:0.0:1788572417.944437:0:196070:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x4:0x0] 00010000:00010000:0.0:1788572417.944447:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.944454:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.944461:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.944511:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572417.944517:0:196070:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x4:0x0] 00010000:00010000:0.0:1788572417.944522:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109beb50 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.944535:0:196070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109beb50 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1788572417.944578:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1095ed80 x1875444569531776/t21474837549(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:87/0 lens 560/448 e 1 to 0 dl 1788572437 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788572417.944662:0:196070:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788572417.944679:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163277:x1875444569531776:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 16462501us (16462687us total) trans 21474837549 rc 0/0 00000100:00100000:0.0:1788572417.944690:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1169 00010000:00010000:0.0:1788572417.945169:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.945179:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.945242:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.945250:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572417.945255:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.945263:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.945277:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a36aabd00) 00010000:00010000:0.0:1788572417.945280:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572417.945284:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572417.945291:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bec4c lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572417.945690:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572417.945699:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 2/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572417.945708:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf400 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:1.0:1788572417.945714:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572417.945724:0:10395:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572417.945759:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 2/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572417.945767:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572417.945787:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 1/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572417.945795:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcf400/0x265cfe11109beb3b lrc: 0/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109beb42 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572417.945811:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572417.945814:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572417.945815:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572417.945823:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572417.945840:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584406912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572417.945909:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572417.945951:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584406912 00000100:00100000:1.0:1788572417.945958:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584406912 00000100:00100000:1.0:1788572417.946003:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4667 00000100:00100000:1.0:1788572417.946012:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3644:x1875444584406912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572417.946026:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572417.946043:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109beb42 lrc: 0/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109beb3b expref: 10 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572417.946056:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:1.0:1788572417.946059:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572417.946089:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584406912:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572417.946095:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4667 00000100:00100000:1.0:1788572417.946146:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584406912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572417.950137:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572417.950307:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569537408 00000100:00100000:0.0:1788572417.950317:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569537408 00000100:00100000:0.0:1788572417.950373:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 35 00000100:00100000:0.0:1788572417.950383:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:163277:x1875444569537408:12345-192.168.202.57@tcp:35:lfs.0 00010000:00000080:0.0:1788572417.950570:0:188051:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4137d850 x1875444569537408/t347892350995(0) o35->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:78/0 lens 392/456 e 0 to 0 dl 1788572428 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788572417.950653:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163277:x1875444569537408:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 270us (534us total) trans 347892350995 rc 0/0 00000100:00100000:0.0:1788572417.950660:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 35 00010000:00010000:3.0:1788572418.625224:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572418.942132:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584407040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572418.942234:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572418.942521:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584407040 00000100:00100000:0.0:1788572418.942532:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584407040 00000100:00100000:0.0:1788572418.942606:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6386 00000100:00100000:0.0:1788572418.942618:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584407040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572418.942672:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572418.942739:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584407040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572418.942747:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6386 00000100:00080000:0.0:1788572418.942780:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572418.943140:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584407040:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572419.650274:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788572420.515040:0:198341:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788572420.515124:0:198341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.515144:0:198341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.515151:0:198341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.515159:0:198341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.515184:0:198341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788572420.515191:0:198341:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788572420.515226:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572420.515231:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788572420.515239:0:198341:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788572420.515274:0:198341:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788572420.515339:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572420.515347:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.515362:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572420.515366:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.515375:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572420.515382:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572420.515387:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572420.515390:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788572420.515392:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788572420.515424:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572420.515702:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584407168:0@lo:39:umount.0 00000100:00100000:0.0:1788572420.515807:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572420.515962:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584407168 00000100:00100000:1.0:1788572420.515972:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584407168 00000100:00100000:1.0:1788572420.516035:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1788572420.516047:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875444584407168:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572420.516081:0:188050:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be1e1 00000100:00080000:1.0:1788572420.516101:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a31919000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788572420.516202:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00000080:1.0:1788572420.516259:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fdf4e00 x1875444584407168/t0(0) o39->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:81/0 lens 224/224 e 0 to 0 dl 1788572431 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572420.516316:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+1:3640:x1875444584407168:12345-0@lo:39:umount.0 Request processed in 270us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572420.516324:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000020:00000080:1.0:1788572420.516334:0:188050:0:(genops.c:885:class_export_put()) final put ffff8e5901970000/lustre-MDT0000-lwp-MDT0001_UUID 00000100:00080000:1.0:1788572420.516388:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788572420.516401:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584407168:0@lo:39:umount.0 00000020:00000080:1.0:1788572420.516429:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5901970000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572420.516518:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a31919000 for lustre-MDT0000 00000100:00080000:3.0:1788572420.517999:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572420.518008:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788572420.518015:0:198341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788572420.520677:0:198341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520717:0:198341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520726:0:198341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520734:0:198341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520762:0:198341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572420.520770:0:198341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520777:0:198341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520783:0:198341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520789:0:198341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520805:0:198341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572420.520820:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572420.520827:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520836:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671200 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572420.520841:0:10396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520850:0:10396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572420.520859:0:10396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572420.520866:0:10396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788572420.520932:0:10396:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788572420.520986:0:10396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.520994:0:10396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572420.521070:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572420.521078:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572420.521086:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:1.0:1788572420.521089:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572420.521096:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572420.521108:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572420.521113:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788572420.521116:0:10395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788572420.521119:0:10395:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788572420.521139:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572420.521146:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572420.521165:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572420.521174:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1400/0x265cfe11109be147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be14e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572420.521198:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572420.521201:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572420.521203:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572420.521536:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572420.521562:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584407424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572420.521652:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.521735:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572420.521743:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584407296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572420.521770:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.521797:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584407552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572420.521823:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.521865:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584407424 00000100:00100000:0.0:1788572420.521959:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584407424 00000100:00100000:0.0:1788572420.522023:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584407296 00000100:00100000:0.0:1788572420.522026:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584407296 00000100:00100000:0.0:1788572420.522049:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584407552 00000100:00100000:0.0:1788572420.522052:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584407552 00000100:00100000:0.0:1788572420.522075:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4668 00000100:00100000:0.0:1788572420.522085:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+26:3642:x1875444584407424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572420.522102:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572420.522124:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01670e00/0x265cfe11109be15c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be155 expref: 26 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572420.522144:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572420.522187:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+25:3642:x1875444584407424:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572420.522194:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4668 00000100:00100000:0.0:1788572420.522216:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4669 00000100:00100000:0.0:1788572420.522223:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1623d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584407296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572420.522231:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572420.522239:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5600/0x265cfe11109be140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be139 expref: 24 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572420.522250:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572420.522272:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1623d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3642:x1875444584407296:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572420.522278:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4669 00000100:00100000:0.0:1788572420.522341:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4670 00000100:00100000:0.0:1788572420.522348:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3643:x1875444584407552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572420.522355:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572420.522364:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01671c00/0x265cfe11109be14e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be147 expref: 22 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572420.522374:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572420.522400:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3643:x1875444584407552:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572420.522406:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4670 00000100:00100000:0.0:1788572420.522506:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584407296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572420.522517:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584407424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572420.522549:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584407552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572420.523342:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523356:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0200/0x265cfe11109be139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be140 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523373:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572420.523375:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572420.523377:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572420.523415:0:198341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523425:0:198341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523442:0:198341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523450:0:198341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523467:0:198341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572420.523506:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572420.523512:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523519:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5e00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572420.523523:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523532:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572420.523540:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572420.523546:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788572420.523548:0:82817:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788572420.523551:0:82817:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788572420.523589:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523595:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572420.523613:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523620:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905bb5e00/0x265cfe11109be171 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be178 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523628:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572420.523629:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572420.523631:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572420.523639:0:198341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523647:0:198341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523653:0:198341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523659:0:198341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.523668:0:198341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788572420.523672:0:198341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788572420.523674:0:198341:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788572420.523737:0:198341:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788572420.523742:0:198341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:2.0:1788572420.523747:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788572420.523753:0:198341:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:1.0:1788572420.524067:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572420.524075:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572420.524082:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:1.0:1788572420.524086:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572420.524094:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572420.524107:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572420.524113:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788572420.524115:0:10395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788572420.524117:0:10395:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788572420.524135:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572420.524140:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788572420.525205:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584407808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572420.525308:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572420.526527:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.526547:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a01671200/0x265cfe11109be155 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572420.526574:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572420.526576:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572420.526580:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788572420.527563:0:198341:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:2.0:1788572420.527892:0:198341:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788572420.527904:0:198341:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e5a3191e000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572420.527910:0:198341:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e59019da800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572420.527920:0:198341:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e5a3f902800 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 192.168.202.57@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 21474837549 stale:0 00000020:00080000:2.0:1788572420.527925:0:198341:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e5a109d6000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572420.527931:0:198341:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8e59028a3380) has exports, disconnecting them 00000020:00080000:2.0:1788572420.527936:0:198341:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e5a3191e000), last request at 1788572370 00000020:00000080:2.0:1788572420.527945:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be091 00000100:00080000:2.0:1788572420.527958:0:198341:0:(import.c:65:import_set_state_nolock()) ffff8e5a3191f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788572420.527993:0:198341:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a3191e000): rc 0 00000020:00000080:2.0:1788572420.527996:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a3191e000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1788572420.528011:0:198341:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e59019da800), last request at 1788572417 00000020:00000080:2.0:1788572420.528014:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdce7 00000100:00080000:2.0:1788572420.528019:0:198341:0:(import.c:65:import_set_state_nolock()) ffff8e59019dc000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788572420.528036:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788572420.528045:0:198341:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e59019da800): rc 0 00000020:00000080:2.0:1788572420.528047:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e59019da800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00080000:2.0:1788572420.528052:0:198341:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.202.57@tcp (ffff8e5a3f902800), last request at 1788572417 00000020:00000080:2.0:1788572420.528056:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdc62 00000100:00080000:2.0:1788572420.528068:0:198341:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f905000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788572420.528116:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788572420.528138:0:198341:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e5a3f902800): rc 0 00000020:00000080:2.0:1788572420.528141:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a3f902800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00080000:2.0:1788572420.528146:0:198341:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e5a109d6000), last request at 1788572417 00000020:00000080:2.0:1788572420.528149:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b764f 00000100:00080000:2.0:1788572420.528154:0:198341:0:(import.c:65:import_set_state_nolock()) ffff8e5a109d0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788572420.528166:0:198341:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a109d6000): rc 0 00000020:00000080:2.0:1788572420.528168:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a109d6000/lustre-MDT0001-lwp-OST0001_UUID 00000004:00000080:2.0:1788572420.528176:0:198341:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaac781b73ae0 00000100:00080000:2.0:1788572420.528200:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572420.528205:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350984 gen 3 00000100:00100000:2.0:1788572420.528217:0:198341:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e590a2d1500 x1875444584396032/t347892350989(347892350989) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 1788572433 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788572420.528228:0:198341:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350989 committed transno 347892350984 00000020:00080000:2.0:1788572420.528234:0:198341:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e5a3fbcac00 refcount 2 committed 0 result 1 batchid 17179873002 00000020:00080000:2.0:1788572420.528238:0:198341:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a41371c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8e5a3fbcae40 00000020:00080000:2.0:1788572420.528242:0:198341:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027502:0x1:0x0].3 00000020:00080000:2.0:1788572420.528244:0:198341:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a244a8e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5a1094a800 00000020:00080000:2.0:1788572420.528246:0:198341:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x24000272a:0x1:0x0].3 00000100:00100000:2.0:1788572420.528290:0:198341:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e5a40521880 x1875444584406784/t347892350994(347892350994) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788572433 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788572420.528297:0:198341:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350994 committed transno 347892350984 00010000:00010000:2.0:1788572420.528438:0:198341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0x265cfe11109be457 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572420.528451:0:198341:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0x265cfe11109be457 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788572420.528466:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000020:00080000:2.0:1788572420.528470:0:188089:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000004:00080000:2.0:1788572420.528547:0:198341:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788572420.528579:0:198341:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572420.528584:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572420.528593:0:198341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ea00/0x265cfe11109be450 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0x265cfe11109be457 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.528885:0:198341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 4/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0x265cfe11109beb50 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572420.528901:0:198341:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 4/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0x265cfe11109beb50 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.528909:0:198341:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572420.528914:0:198341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a40dcfa00/0x265cfe11109beb49 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0x265cfe11109beb50 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572420.529408:0:198341:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788572420.529444:0:198341:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788572420.529562:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584407936:0@lo:39:umount.0 00000100:00100000:3.0:1788572420.529664:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572420.529740:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788572420.529747:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 3 00000100:00100000:3.0:1788572420.529753:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584407936 00000004:00080000:2.0:1788572420.529763:0:198341:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572420.529765:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584407936 00000100:00100000:3.0:1788572420.529830:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1788572420.529842:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3640:x1875444584407936:12345-0@lo:39:umount.0 00000100:00080000:2.0:1788572420.529846:0:198341:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788572420.529862:0:198341:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788572420.529876:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788572420.529878:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975687 gen 3 00000004:00080000:2.0:1788572420.529893:0:198341:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788572420.530078:0:198341:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788572420.530114:0:198341:0:(import.c:65:import_set_state_nolock()) ffff8e590b9ac800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788572420.530232:0:198341:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8e59028a3380) has no exports 00000020:00080000:2.0:1788572420.530275:0:188089:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e5a3fbcac00 refcount 1 committed 1 result 1 batchid 17179873002 00000020:00080000:2.0:1788572420.530282:0:188089:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a41371c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8e5a3fbcae40 00000020:00080000:2.0:1788572420.530286:0:188089:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027502:0x1:0x0].3 00000020:00080000:2.0:1788572420.530289:0:188089:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a244a8e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5a1094a800 00000020:00080000:2.0:1788572420.530291:0:188089:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x24000272a:0x1:0x0].3 00000020:00000080:3.0:1788572420.530742:0:188054:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be052 00000040:00080000:2.0:1788572420.530752:0:198341:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 8 00000020:00010000:3.0:1788572420.530762:0:188054:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a0f02d000: total 4 00000100:00080000:3.0:1788572420.530770:0:188054:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572420.530802:0:188054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 81, last_transno is 347892350995 00000020:00010000:2.0:1788572420.530865:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a0f02d000: total 4 00010000:00010000:2.0:1788572420.530937:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a0f02d000, canceled 0 locks, left on hash table 2. 00010000:00000080:3.0:1788572420.530983:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40520000 x1875444584407936/t347892350996(0) o39->lustre-MDT0001-mdtlov_UUID@0@lo:81/0 lens 224/224 e 0 to 0 dl 1788572431 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572420.531066:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3640:x1875444584407936:12345-0@lo:39:umount.0 Request processed in 1225us (1401us total) trans 347892350996 rc 0/0 00000100:00100000:3.0:1788572420.531076:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00010000:00010000:1.0:1788572420.531329:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572420.531342:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe0e00/0x265cfe11109be163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788572420.531379:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3191e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788572420.531558:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59019da800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788572420.531594:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f902800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-MDT0001 00000020:00000080:1.0:1788572420.531629:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109d6000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788572420.531666:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a3191f000 for lustre-MDT0001 00000020:00000080:1.0:1788572420.531671:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59019dc000 for lustre-MDT0001 00000020:00000080:1.0:1788572420.531675:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a3f905000 for lustre-MDT0001 00000020:00000080:1.0:1788572420.531678:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a109d0000 for lustre-MDT0001 00010000:00010000:2.0:1788572420.531851:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0xf7117594 (ffff8e5a02ffb400) 00010000:00010000:2.0:1788572420.531857:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572420.531871:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109beb50 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109beb49 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.531904:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:2.0:1788572420.531907:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788572420.531911:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1616fa00/0x265cfe11109be457 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be450 expref: 5 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572420.531927:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a0f02d000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788572420.531954:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572420.531957:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572420.531959:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572420.531988:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584408064:0@lo:9:umount.0 00010000:00010000:1.0:1788572420.532018:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572420.532023:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572420.532026:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572420.532063:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572420.532106:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584408192:0@lo:9:umount.0 00000100:00100000:2.0:1788572420.532128:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572420.532725:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f80e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788572420.532736:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584407936:0@lo:39:umount.0 00000020:00080000:2.0:1788572420.532885:0:198341:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8e59028a3380) has no exports 00000100:00100000:1.0:1788572420.536427:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584408064 00000100:00100000:1.0:1788572420.536582:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584408064 00000100:00100000:1.0:1788572420.536692:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584408192 00000100:00100000:1.0:1788572420.536697:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584408192 00000100:00100000:1.0:1788572420.536731:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22687 00000100:00100000:1.0:1788572420.536744:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3640:x1875444584408064:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788572420.536789:0:179391:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdc9a 00000100:00080000:1.0:1788572420.536802:0:179391:0:(import.c:65:import_set_state_nolock()) ffff8e590cc76000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788572420.537426:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22688 00000100:00100000:3.0:1788572420.537449:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875444584408192:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788572420.537669:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b63a9 00000100:00080000:3.0:1788572420.537756:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8e5a090ca000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572420.537805:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975687 00000100:00100000:3.0:1788572420.538079:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1875444584408192:12345-0@lo:9:umount.0 Request processed in 642us (5946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572420.538088:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22688 00000100:00080000:3.0:1788572420.538368:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b9ac800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788572420.538385:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788572420.538387:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572420.538392:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584408192:0@lo:9:umount.0 00010000:00010000:3.0:1788572420.538443:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788572420.538725:0:179391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705678 00000100:00100000:1.0:1788572420.539621:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+2:3640:x1875444584408064:12345-0@lo:9:umount.0 Request processed in 2873us (7552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572420.539634:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22687 00010000:00010000:1.0:1788572420.539709:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572420.540019:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a36d4d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788572420.540045:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788572420.540047:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572420.540052:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584408064:0@lo:9:umount.0 00000100:00080000:0.0:1788572420.540221:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572420.540229:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572420.540252:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584407680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572420.540628:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.540714:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584407808 00000100:00100000:0.0:1788572420.540723:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584407808 00000100:00100000:0.0:1788572420.540781:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584407680 00000100:00100000:0.0:1788572420.540785:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584407680 00000100:00100000:0.0:1788572420.540813:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4671 00000100:00100000:0.0:1788572420.540823:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3641:x1875444584407808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572420.540841:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572420.540865:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5a00/0x265cfe11109be16a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be163 expref: 22 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572420.541040:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572420.541353:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3641:x1875444584407808:12345-0@lo:103:ldlm_bl.0 Request processed in 530us (16044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572420.541362:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4671 00000100:00100000:0.0:1788572420.541385:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4672 00000100:00100000:0.0:1788572420.541391:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:3644:x1875444584407680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572420.541401:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572420.541413:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb4800/0x265cfe11109be178 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be171 expref: 20 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572420.541422:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572420.541761:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572420.541794:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584407808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572420.542141:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3644:x1875444584407680:12345-0@lo:103:ldlm_bl.0 Request processed in 749us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572420.542150:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4672 00000100:00100000:1.0:1788572420.543067:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584407680:0@lo:103:ldlm_bl.0 00000020:01000000:3.0:1788572420.587527:0:198341:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5904c214e0 - data ffff8e5a0885b6c0/ffff8e5903800000 00000020:01000000:3.0:1788572420.587766:0:198341:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a07d15c60 - data ffff8e5a088ddbd0/ffff8e5a40da8400 00000100:00080000:3.0:1788572420.648969:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572420.648979:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350984 gen 4 00000100:00100000:3.0:1788572420.648996:0:198341:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e5905165880 x1875444584407936/t347892350996(347892350996) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572430 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572420.649022:0:198341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788572420.652216:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788572420.652224:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 4 00000004:00080000:3.0:1788572420.652243:0:198341:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572420.652246:0:198341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788572420.652691:0:188077:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788572420.652697:0:188077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 11 count 1 00000040:00080000:1.0:1788572420.652709:0:188077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 5 count 2 00000100:00080000:3.0:1788572420.654263:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788572420.654270:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975687 gen 4 00000004:00080000:3.0:1788572420.654292:0:198341:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572420.654295:0:198341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788572420.655355:0:188079:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788572420.655361:0:188079:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x16:0x0] index 11 count 1 00000040:00080000:1.0:1788572420.655373:0:188079:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 5 count 2 00000020:00000080:3.0:1788572420.659019:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b630f 00000020:00000080:3.0:1788572420.659031:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a1fb30000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788572420.659077:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1fb30000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788572420.662066:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6324 00000020:00000080:1.0:1788572420.662080:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a1f808000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788572420.662091:0:198341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788572420.662096:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572420.662105:0:198341:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572420.662110:0:198341:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8e59028a0000) has no exports 00000004:01000000:1.0:1788572420.662393:0:198341:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788572420.662404:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b639b 00000020:00000080:1.0:1788572420.662408:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e590b9ae000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788572420.662413:0:198341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788572420.662416:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572420.662421:0:198341:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572420.662424:0:198341:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8e59041599c0) has no exports 00000020:00000080:1.0:1788572420.662431:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b638d 00000020:00000080:1.0:1788572420.662434:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e590b9a9800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788572420.662827:0:198341:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788572420.662832:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572420.662837:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975687 gen 5 00000004:00080000:1.0:1788572420.662843:0:198341:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572420.662846:0:198341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572420.662886:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572420.662893:0:198341:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788572420.662899:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6378 00000020:00000080:1.0:1788572420.662904:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a3f89c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788572420.662908:0:198341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788572420.662911:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572420.662914:0:198341:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572420.662916:0:198341:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8e590415b380) has no exports 00000020:00000080:1.0:1788572420.662921:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b636a 00000020:00000080:1.0:1788572420.662923:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a36d4b000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788572420.663207:0:198341:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788572420.663210:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572420.663212:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 5 00000004:00080000:1.0:1788572420.663215:0:198341:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572420.663216:0:198341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572420.663239:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572420.663257:0:198341:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788572420.663267:0:198341:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788572420.663272:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b635c 00000020:00000080:1.0:1788572420.663277:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a36d4e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788572420.663280:0:198341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:1.0:1788572420.663283:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572420.663286:0:198341:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572420.663288:0:198341:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8e5a0efb8000) has no exports 00000020:00000080:1.0:1788572420.663291:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6355 00000020:00000080:1.0:1788572420.663294:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a1f80d800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788572420.664116:0:198341:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000020:00000080:3.0:1788572420.664117:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1f808000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000100:00080000:2.0:1788572420.664121:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572420.664125:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350984 gen 5 00000020:00000080:3.0:1788572420.664129:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b9ae000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000100:00100000:2.0:1788572420.664130:0:198341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572420.664133:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b9a9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788572420.664147:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590b9ac800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788572420.664154:0:177620:0:(genops.c:885:class_export_put()) final put ffff8e5a3f898000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788572420.664156:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f898000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788572420.664160:0:177620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788572420.664172:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572420.664178:0:198341:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788572420.664204:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572420.664207:0:198341:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788572420.664210:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a372d8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788572420.664211:0:198341:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a372d8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788572420.664215:0:198341:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572420.664246:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f89c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788572420.664250:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36d4b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788572420.664253:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a36d4d800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788572420.664257:0:177620:0:(genops.c:885:class_export_put()) final put ffff8e5a36d4d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788572420.664258:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36d4d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788572420.664262:0:177620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572420.664285:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36d4e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788572420.664290:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b632b 00000020:00000080:3.0:1788572420.664290:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1f80d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788572420.664293:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a1f80e800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788572420.664295:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a1f80a800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788572420.664298:0:198341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788572420.664298:0:177620:0:(genops.c:885:class_export_put()) final put ffff8e5a09ee5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788572420.664300:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a09ee5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788572420.664301:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:01000000:3.0:1788572420.664303:0:177620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788572420.664305:0:198341:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788572420.664308:0:198341:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8e5a109fb380) has no exports 00000020:00000080:3.0:1788572420.664324:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1f80a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788572420.664326:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572420.664329:0:198341:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788572420.664331:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a1f809000/lustre-MDD0001_UUID 00000020:00000080:2.0:1788572420.664333:0:198341:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1f809000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788572420.664336:0:198341:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788572420.664364:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b6332 00000020:00000080:2.0:1788572420.664369:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a1f80b800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788572420.664390:0:198341:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a412c6800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788572420.664393:0:198341:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a412c6800 2 00000020:01000004:2.0:1788572420.664397:0:198341:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5a412c6800 from lustre-MDT0001 00000020:00000080:2.0:1788572420.664417:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572420.664421:0:198341:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788572420.664423:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a1fb34000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788572420.664425:0:198341:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1fb34000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788572420.664430:0:198341:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788572420.664458:0:198341:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1788572420.664461:0:198341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788572420.664464:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572420.664467:0:198341:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788572420.664474:0:198341:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8e5a10fff800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572420.664508:0:198341:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8e5a109fcd40) has exports, disconnecting them 00000020:00080000:2.0:1788572420.664514:0:198341:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8e5a10fff800), last request at 1788572040 00000020:00000080:2.0:1788572420.664517:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b63e1 00000020:00080000:2.0:1788572420.664522:0:198341:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a10fff800): rc 0 00000020:00000080:2.0:1788572420.664525:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a10fff800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788572420.664704:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1f80b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788572420.664710:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a10fff800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788572420.674543:0:198341:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788572420.674553:0:198341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572420.674557:0:198341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788572420.674566:0:198341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572420.674599:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a10ffd800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788572420.674845:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572420.674855:0:198341:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788572420.674860:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a10ffc800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788572420.674864:0:198341:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a10ffc800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788572420.674873:0:198341:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788572420.674961:0:198341:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a412c6800 1 00000020:00000080:3.0:1788572420.674968:0:198341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109b62a6 00000020:00000080:3.0:1788572420.674974:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a412c4800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788572420.674982:0:198341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788572420.674991:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a412c4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788572420.675000:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572420.675005:0:198341:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788572420.675009:0:198341:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8e5905f58000) has no exports 00010000:00010000:2.0:1788572420.707219:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788572420.764843:0:198341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572420.764857:0:198341:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788572420.764863:0:198341:0:(genops.c:885:class_export_put()) final put ffff8e5a412c0800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788572420.764867:0:198341:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a412c0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788572420.764873:0:198341:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788572420.765000:0:198341:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e5a412c4000 00000020:02000400:3.0:1788572420.765077:0:198341:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00100000:3.0:1788572421.500795:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584408320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572421.500868:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572421.501010:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584408320 00000100:00100000:2.0:1788572421.501018:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584408320 00000100:00100000:2.0:1788572421.501080:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1788572421.501089:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875444584408320:12345-0@lo:41:osp-pre-1-0.0 00000020:00080000:2.0:1788572421.501098:0:189111:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788572421.501141:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875444584408320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (273us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572421.501149:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:02020000:2.0:1788572421.501249:0:3642:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788572421.501254:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572421.501259:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572421.501263:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572421.501269:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572421.501273:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9123 00000100:00080000:2.0:1788572421.501279:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e59059d0800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572421.501302:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffac700 x1875444584408448/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572421.501333:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584408448:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788572421.501362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572421.501507:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584408448 00000100:00100000:3.0:1788572421.501512:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584408448 00000100:00100000:3.0:1788572421.501537:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1788572421.501541:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584408448:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788572421.501561:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572421.501595:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584408448:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 52us (231us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572421.501602:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00080000:2.0:1788572421.501867:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572421.501872:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572421.501886:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584408448:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1788572421.758196:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572422.016707:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584408576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572422.017022:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572422.017233:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584408576 00000100:00100000:0.0:1788572422.017245:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584408576 00000100:00100000:0.0:1788572422.017871:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6387 00000100:00100000:0.0:1788572422.017881:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584408576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572422.018039:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572422.018750:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584408576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 867us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572422.018770:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6387 00000100:00080000:0.0:1788572422.018801:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572422.019069:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584408576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572422.025101:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572422.025124:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584408704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572422.025195:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572422.025241:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584408704 00000100:00100000:3.0:1788572422.025250:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584408704 00000100:00100000:3.0:1788572422.025319:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6388 00000100:00100000:3.0:1788572422.025329:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584408704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572422.025359:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572422.025405:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584408704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572422.025413:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6388 00000100:00080000:3.0:1788572422.025433:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572422.025469:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584408704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572422.512001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572422.512039:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572422.512063:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572422.512082:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572422.512105:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572422.512133:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569537536 00000100:00100000:1.0:1788572422.512142:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569537536 00000100:00100000:1.0:1788572422.512188:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 94 00000100:00100000:1.0:1788572422.512198:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a10fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569537536:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572422.512275:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a10fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569537536:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572422.512292:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 94 00000100:00100000:1.0:1788572422.512332:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569537792 00000100:00100000:1.0:1788572422.512336:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569537792 00000100:00100000:1.0:1788572422.512359:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569537664 00000100:00100000:1.0:1788572422.512363:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569537664 00000100:00100000:1.0:1788572422.512395:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 422 00000100:00100000:1.0:1788572422.512401:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2397:x1875444569537664:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572422.512421:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cb9f80 x1875444569537664/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:83/0 lens 224/224 e 0 to 0 dl 1788572433 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572422.512452:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2397:x1875444569537664:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572422.512459:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 422 00000100:00100000:1.0:1788572422.512471:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1184 00000100:00100000:1.0:1788572422.512476:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875444569537792:12345-192.168.202.57@tcp:400:kworker.0 00000020:00080000:1.0:1788572422.512500:0:188048:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.57@tcp 00000100:00100000:1.0:1788572422.512522:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875444569537792:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 44us (482us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572422.512528:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1184 00000100:00100000:3.0:1788572422.514702:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569538048 00000100:00100000:3.0:1788572422.514716:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569538048 00000100:00100000:3.0:1788572422.514783:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569537920 00000100:00100000:3.0:1788572422.514787:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569537920 00000100:00100000:3.0:1788572422.514818:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7806 00000100:00100000:2.0:1788572422.515042:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7807 00000100:00100000:2.0:1788572422.515053:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569537920:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572422.515145:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569537920:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 94us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572422.515152:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7807 00000100:00100000:3.0:1788572422.515562:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569538048:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572422.515595:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569538048:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 769us (3531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572422.515602:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7806 00000100:00080000:3.0:1788572422.515620:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572422.515623:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572422.515626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572422.515672:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572422.516088:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569538176 00000100:00100000:2.0:1788572422.516095:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569538176 00000100:00100000:2.0:1788572422.516123:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1185 00000100:00100000:2.0:1788572422.516130:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569538176:12345-192.168.202.57@tcp:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788572422.516153:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572422.516182:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569538176:12345-192.168.202.57@tcp:38:ptlrpcd_00_00.0 Request processed in 51us (510us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572422.516189:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1185 00010000:00010000:0.0:1788572422.780673:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572423.039727:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572423.039771:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572423.039775:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572423.039785:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9174 00000100:00080000:1.0:1788572423.039793:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572423.039802:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e59059d0800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572423.039830:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905163800 x1875444584409472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572423.039886:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584408832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.039962:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.039997:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584409344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.040031:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.040060:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572423.040068:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584408960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.040096:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.040116:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5906a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584409600:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.040143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.040188:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584409216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.040216:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.040232:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584409856:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.040249:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.040264:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788572423.040268:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584409088:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.040285:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.040300:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584409728:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.040317:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.040339:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584409472:0@lo:38:kworker.0 00000100:00100000:1.0:1788572423.040364:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.040401:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584408832 00000100:00100000:1.0:1788572423.040409:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584408832 00000100:00100000:1.0:1788572423.040457:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788572423.040465:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3641:x1875444584408832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.040539:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3641:x1875444584408832:12345-0@lo:400:kworker.0 Request processed in 75us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572423.040547:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788572423.040577:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584409344 00000100:00100000:1.0:1788572423.040580:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584409344 00000100:00100000:1.0:1788572423.040599:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584408960 00000100:00100000:1.0:1788572423.040601:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584408960 00000100:00100000:1.0:1788572423.040622:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584409216 00000100:00100000:1.0:1788572423.040625:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584409216 00000100:00100000:1.0:1788572423.040636:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584409856 00000100:00100000:1.0:1788572423.040638:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584409856 00000100:00100000:1.0:1788572423.040647:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584409088 00000100:00100000:1.0:1788572423.040649:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584409088 00000100:00100000:1.0:1788572423.040661:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1788572423.040667:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584408960:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572423.040681:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1095f480 x1875444584408960/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:84/0 lens 224/224 e 0 to 0 dl 1788572434 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572423.040711:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584408960:12345-0@lo:400:kworker.0 Request processed in 44us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572423.040717:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1788572423.040743:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1788572423.040749:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584409216:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572423.040759:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a2462ce00 x1875444584409216/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:84/0 lens 224/224 e 0 to 0 dl 1788572434 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572423.040791:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584409216:12345-0@lo:400:kworker.0 Request processed in 42us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572423.040797:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1788572423.040808:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1788572423.040814:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584409856:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572423.040825:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a2462c700 x1875444584409856/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:84/0 lens 224/224 e 0 to 0 dl 1788572434 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572423.040850:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584409856:12345-0@lo:400:kworker.0 Request processed in 37us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572423.040856:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1788572423.040868:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1788572423.040872:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875444584409344:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788572423.040877:0:188048:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572423.040901:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875444584409344:12345-0@lo:400:kworker.0 Request processed in 28us (870us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572423.040907:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1788572423.040918:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1788572423.040921:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875444584409088:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788572423.040925:0:188048:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572423.040946:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875444584409088:12345-0@lo:400:kworker.0 Request processed in 24us (660us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572423.040952:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1788572423.040972:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584409600 00000100:00100000:1.0:1788572423.040976:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584409600 00000100:00100000:1.0:1788572423.041003:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584409728 00000100:00100000:1.0:1788572423.041005:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584409728 00000100:00100000:1.0:1788572423.041023:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7808 00000100:00100000:1.0:1788572423.041029:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584409600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.041059:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584409600:12345-0@lo:400:kworker.0 Request processed in 30us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572423.041064:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7808 00000100:00100000:1.0:1788572423.041077:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7809 00000100:00100000:1.0:1788572423.041083:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584409728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.041109:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584409728:12345-0@lo:400:kworker.0 Request processed in 27us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572423.041115:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7809 00000100:00100000:1.0:1788572423.041147:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584409472 00000100:00100000:1.0:1788572423.041152:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584409472 00000100:00100000:1.0:1788572423.041173:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1788572423.041178:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584409472:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572423.041195:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572423.041227:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584409472:12345-0@lo:38:kworker.0 Request processed in 48us (862us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572423.041233:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00080000:1.0:1788572423.041284:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572423.041290:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572423.041293:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584409472:0@lo:38:kworker.0 00000100:00080000:1.0:1788572423.041322:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572423.041326:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572423.041329:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572423.041333:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572423.041337:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8813 00000100:00080000:1.0:1788572423.041342:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572423.041361:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cd3480 x1875444584409984/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572423.041379:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584409088:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.041394:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584409728:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.041405:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584409216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.041415:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584409856:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.041438:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584409984:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788572423.041466:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.041525:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584408960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.041534:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5906a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584409600:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.041544:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584408832:0@lo:400:kworker.0 00000100:00080000:1.0:1788572423.041552:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572423.041555:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572423.041557:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572423.041560:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572423.041563:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9059 00000100:00080000:1.0:1788572423.041567:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572423.041579:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1095c700 x1875444584410112/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572423.041592:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584409344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572423.041611:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584410112:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788572423.041633:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572423.041655:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584409984 00000100:00100000:1.0:1788572423.041658:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584409984 00000100:00100000:1.0:1788572423.041674:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584410112 00000100:00100000:1.0:1788572423.041677:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584410112 00000100:00100000:1.0:1788572423.041689:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1788572423.041693:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584409984:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788572423.041704:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572423.041747:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584409984:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 51us (282us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572423.041754:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1788572423.041765:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1788572423.041770:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584410112:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788572423.041779:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572423.041802:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584410112:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (168us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572423.041807:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:1.0:1788572423.041834:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572423.041838:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572423.041840:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584410112:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788572423.041848:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572423.041851:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572423.041854:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584409984:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788572423.041950:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572423.804682:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788572424.062592:0:196576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1788572424.062611:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350996 is committed 00000001:00080000:1.0:1788572424.062618:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350995 is committed 00000020:00000080:1.0:1788572424.062623:0:196576:0:(genops.c:885:class_export_put()) final put ffff8e5a0f02d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788572424.063171:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f02d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572424.063249:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a071d2000 for lustre-MDT0000 00010000:00010000:1.0:1788572424.828710:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572425.852699:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788572426.113891:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788572426.114611:0:194757:0:(genops.c:885:class_export_put()) final put ffff8e5a0f312000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788572426.114874:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788572426.114880:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5a090c9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788572426.122088:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f312000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788572426.122286:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590cc76000 for lustre-OST0000 00000020:00000080:2.0:1788572426.126040:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a090c9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788572426.126118:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a090ca000 for lustre-OST0001 00010000:00010000:1.0:1788572426.878730:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572427.133366:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584410240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572427.133496:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572427.133614:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584410240 00000100:00100000:1.0:1788572427.133626:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584410240 00000100:00100000:1.0:1788572427.133703:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6389 00000100:00100000:1.0:1788572427.133715:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584410240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572427.133766:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572427.133834:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584410240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572427.133842:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6389 00000100:00080000:1.0:1788572427.133867:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572427.133913:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584410240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572427.137263:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584410368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572427.137376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572427.137688:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584410368 00000100:00100000:3.0:1788572427.137699:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584410368 00000100:00100000:3.0:1788572427.137800:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6390 00000100:00100000:3.0:1788572427.137815:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584410368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572427.137856:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572427.137925:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584410368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572427.137937:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6390 00000100:00100000:2.0:1788572427.138089:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584410368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788572427.138274:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572427.627626:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572427.627682:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572427.627921:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569538304 00000100:00100000:0.0:1788572427.627937:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569538304 00000100:00100000:0.0:1788572427.628025:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 96 00000100:00100000:0.0:1788572427.628039:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569538304:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572427.628151:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569538304:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 114us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572427.628159:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 96 00000100:00100000:1.0:1788572427.628773:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572427.629020:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569538432 00000100:00100000:2.0:1788572427.629029:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569538432 00000100:00100000:2.0:1788572427.629098:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569538560 00000100:00100000:2.0:1788572427.629103:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569538560 00000100:00100000:2.0:1788572427.629135:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 426 00000100:00100000:2.0:1788572427.629146:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569538432:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:2.0:1788572427.629176:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5906a01c00 x1875444569538432/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:102/0 lens 224/224 e 0 to 0 dl 1788572452 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572427.629237:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569538432:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 93us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572427.629247:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 426 00000100:00100000:2.0:1788572427.629269:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1190 00000100:00100000:2.0:1788572427.629275:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569538560:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572427.629303:0:188050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572427.629336:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875444569538560:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 59us (567us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572427.629345:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1190 00000100:00100000:3.0:1788572427.629397:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572427.629531:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572427.629612:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569538816 00000100:00100000:2.0:1788572427.629620:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569538816 00000100:00100000:3.0:1788572427.629635:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569538688 00000100:00100000:3.0:1788572427.629647:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569538688 00000100:00100000:2.0:1788572427.629676:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7810 00000100:00100000:2.0:1788572427.629689:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569538816:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572427.629718:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7811 00000100:00100000:3.0:1788572427.629735:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569538688:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572427.629749:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569538816:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 60us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572427.629770:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7810 00000100:00100000:3.0:1788572427.629822:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569538688:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572427.629830:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7811 00000100:00080000:1.0:1788572427.630116:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572427.630134:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572427.630137:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788572427.904150:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572428.156777:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572428.156786:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572428.156790:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572428.156802:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9176 00000100:00080000:1.0:1788572428.156811:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572428.156820:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572428.156848:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905160000 x1875444584410752/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572428.156880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584410496:0@lo:400:kworker.0 00000100:00080000:1.0:1788572428.156902:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572428.156908:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572428.156910:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572428.156915:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9176 00000100:00080000:1.0:1788572428.156919:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572428.156924:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572428.156941:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eac380 x1875444584411008/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572428.156950:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572428.156954:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572428.156956:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572428.156961:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9176 00000100:00080000:1.0:1788572428.156964:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572428.156969:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e59059d0800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572428.156984:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eae300 x1875444584411136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572428.156998:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572428.157075:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584410496 00000100:00100000:1.0:1788572428.157087:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584410496 00000100:00100000:3.0:1788572428.157106:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584411392:0@lo:400:kworker.0 00000100:00100000:1.0:1788572428.157162:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788572428.157175:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3643:x1875444584410496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572428.157282:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3643:x1875444584410496:12345-0@lo:400:kworker.0 Request processed in 106us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572428.157293:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788572428.157314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572428.157377:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584410496:0@lo:400:kworker.0 00000100:00100000:1.0:1788572428.157383:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584411392 00000100:00100000:1.0:1788572428.157390:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584411392 00000100:00100000:3.0:1788572428.157400:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572428.157413:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584410624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572428.157435:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7812 00000100:00100000:1.0:1788572428.157446:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584411392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572428.157455:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572428.157532:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584411520:0@lo:400:kworker.0 00000100:00100000:2.0:1788572428.157653:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584410880:0@lo:400:kworker.0 00000100:00100000:0.0:1788572428.157719:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584410752:0@lo:38:kworker.0 00000100:00100000:1.0:1788572428.161945:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584411392:12345-0@lo:400:kworker.0 Request processed in 4486us (4618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572428.161966:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7812 00000100:00100000:1.0:1788572428.162040:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584410624 00000100:00100000:1.0:1788572428.162052:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584410624 00000100:00100000:1.0:1788572428.162132:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1788572428.162143:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584410624:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572428.162177:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40521c00 x1875444584410624/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:103/0 lens 224/224 e 0 to 0 dl 1788572453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572428.162238:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584410624:12345-0@lo:400:kworker.0 Request processed in 97us (4790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572428.162245:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00080000:1.0:1788572428.162265:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572428.163677:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584411264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572428.163782:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572428.164736:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584411264 00000100:00100000:1.0:1788572428.164749:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584411264 00000100:00100000:1.0:1788572428.164830:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7813 00000100:00100000:1.0:1788572428.164841:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584411264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572428.164935:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584411264:12345-0@lo:400:kworker.0 Request processed in 96us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572428.164943:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7813 00000100:00100000:1.0:1788572428.164999:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584411264:0@lo:400:kworker.0 00000100:00100000:3.0:1788572428.169413:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572428.169530:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584411392:0@lo:400:kworker.0 00000100:00100000:3.0:1788572428.169563:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584410624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572428.171355:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584411520 00000100:00100000:1.0:1788572428.171369:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584411520 00000100:00100000:1.0:1788572428.171446:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1788572428.171458:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584411520:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572428.171513:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905160a80 x1875444584411520/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:103/0 lens 224/224 e 0 to 0 dl 1788572453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572428.171585:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584411520:12345-0@lo:400:kworker.0 Request processed in 129us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572428.171592:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1788572428.173012:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584411520:0@lo:400:kworker.0 00000100:00100000:2.0:1788572428.180315:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572428.180685:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584410880 00000100:00100000:1.0:1788572428.180699:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584410880 00000100:00100000:1.0:1788572428.180840:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1788572428.180854:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584410880:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572428.180895:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffac700 x1875444584410880/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:103/0 lens 224/224 e 0 to 0 dl 1788572453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572428.180983:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584410880:12345-0@lo:400:kworker.0 Request processed in 132us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572428.180993:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00080000:2.0:1788572428.181970:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572428.182038:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584410880:0@lo:400:kworker.0 00000100:00100000:0.0:1788572428.185016:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572428.185103:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584411008:0@lo:38:kworker.0 00000100:00100000:0.0:1788572428.185155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572428.185194:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584411136:0@lo:38:kworker.0 00000100:00100000:0.0:1788572428.185235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572428.185469:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584411136 00000100:00100000:3.0:1788572428.185524:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584411136 00000100:00100000:3.0:1788572428.185575:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1788572428.185585:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584411136:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572428.185614:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572428.185674:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584411136:12345-0@lo:38:kworker.0 Request processed in 88us (438us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572428.185682:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1788572428.186020:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584410752 00000100:00100000:1.0:1788572428.186027:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584410752 00000100:00100000:1.0:1788572428.186063:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584411008 00000100:00100000:1.0:1788572428.186067:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584411008 00000100:00100000:1.0:1788572428.186086:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788572428.186092:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584410752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572428.186105:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572428.186151:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584410752:12345-0@lo:38:kworker.0 Request processed in 58us (1149us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572428.186158:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788572428.186172:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1788572428.186177:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584411008:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572428.186188:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572428.186223:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584411008:12345-0@lo:38:kworker.0 Request processed in 43us (1066us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572428.186229:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:0.0:1788572428.186431:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572428.186438:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572428.186442:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584410752:0@lo:38:kworker.0 00000100:00080000:0.0:1788572428.186453:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572428.186456:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572428.186460:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584411008:0@lo:38:kworker.0 00000100:00080000:0.0:1788572428.186468:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572428.186569:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572428.186573:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584411136:0@lo:38:kworker.0 00010000:00010000:1.0:1788572428.925157:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572429.948714:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572430.976721:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572431.996835:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572432.253056:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572432.253079:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584411648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572432.253191:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572432.253297:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584411648 00000100:00100000:3.0:1788572432.253308:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584411648 00000100:00100000:3.0:1788572432.253390:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6391 00000100:00100000:3.0:1788572432.253403:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584411648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572432.253443:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572432.253529:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584411648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572432.253537:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6391 00000100:00100000:3.0:1788572432.253598:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584411648:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572432.253756:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572432.254944:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1faff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584411776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572432.255013:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572432.255102:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584411776 00000100:00100000:1.0:1788572432.255110:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584411776 00000100:00100000:1.0:1788572432.255172:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6392 00000100:00100000:1.0:1788572432.255190:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584411776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572432.255220:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00080000:2.0:1788572432.255289:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572432.255757:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584411776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 573us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572432.255766:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6392 00000100:00100000:3.0:1788572432.256119:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1faff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584411776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572432.754580:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572432.754877:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569539072 00000100:00100000:1.0:1788572432.754888:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569539072 00000100:00100000:1.0:1788572432.754997:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 430 00000100:00100000:1.0:1788572432.755009:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569539072:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572432.755045:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1faff100 x1875444569539072/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:93/0 lens 224/224 e 0 to 0 dl 1788572443 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572432.755123:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569539072:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 117us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572432.755131:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 430 00000100:00080000:2.0:1788572432.757583:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572432.772182:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572432.772240:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572432.772271:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572432.772315:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572432.772361:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569538944 00000100:00100000:1.0:1788572432.772372:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569538944 00000100:00100000:1.0:1788572432.772423:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 98 00000100:00100000:1.0:1788572432.772434:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569538944:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572432.772551:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569538944:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 119us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572432.772560:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 98 00000100:00100000:3.0:1788572432.772909:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569539328 00000100:00100000:3.0:1788572432.772915:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569539328 00000100:00100000:3.0:1788572432.772959:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569539456 00000100:00100000:3.0:1788572432.772962:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569539456 00000100:00100000:3.0:1788572432.773001:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22689 00000100:00100000:3.0:1788572432.773009:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2396:x1875444569539328:12345-192.168.202.57@tcp:9:kworker.0 00000020:00000080:3.0:1788572432.773036:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be3f5 00000100:00080000:3.0:1788572432.773048:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8e5903a25000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572432.773095:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705678 00000100:00100000:3.0:1788572432.773230:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+2:2396:x1875444569539328:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 222us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572432.773238:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22689 00000100:00100000:3.0:1788572432.773252:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22690 00000100:00100000:3.0:1788572432.773259:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2396:x1875444569539456:12345-192.168.202.57@tcp:9:kworker.0 00000020:00000080:3.0:1788572432.773271:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be3fc 00000100:00080000:3.0:1788572432.773277:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8e5903a27000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572432.773302:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975687 00000100:00100000:3.0:1788572432.773390:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+2:2396:x1875444569539456:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 131us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572432.773396:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22690 00010000:00010000:3.0:1788572432.773424:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572432.773431:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572432.773434:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788572432.773439:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572432.773882:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569539200 00000100:00100000:2.0:1788572432.773890:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569539200 00000100:00100000:2.0:1788572432.773932:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1193 00000100:00100000:2.0:1788572432.773938:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569539200:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572432.773963:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572432.773996:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569539200:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 57us (1825us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572432.774003:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1193 00010000:00010000:1.0:1788572433.020797:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572433.277538:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572433.277546:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572433.277550:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572433.277559:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9181 00000100:00080000:1.0:1788572433.277565:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572433.277574:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572433.277759:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584411904:0@lo:400:kworker.0 00000100:00100000:0.0:1788572433.277856:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572433.277913:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572433.277919:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584412032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572433.277948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572433.277998:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584411904 00000100:00100000:0.0:1788572433.278007:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584411904 00000100:00100000:0.0:1788572433.278054:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788572433.278063:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3643:x1875444584411904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572433.278112:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3643:x1875444584411904:12345-0@lo:400:kworker.0 Request processed in 50us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572433.278119:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788572433.278182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584411904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572433.278562:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eac000 x1875444584412160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572433.278741:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572433.278746:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572433.278748:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572433.278753:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9181 00000100:00080000:1.0:1788572433.278757:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572433.278761:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572433.278781:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905feea00 x1875444584412416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572433.278857:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572433.278861:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572433.278863:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572433.278866:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9181 00000100:00080000:1.0:1788572433.278868:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572433.278872:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e59059d0800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572433.278887:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905feed80 x1875444584412544/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572433.278945:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584412288:0@lo:400:kworker.0 00000100:00100000:1.0:1788572433.278984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572433.279013:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572433.279019:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584412672:0@lo:400:kworker.0 00000100:00100000:1.0:1788572433.279045:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572433.279075:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584412672 00000100:00100000:1.0:1788572433.279079:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584412672 00000100:00100000:1.0:1788572433.279114:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7814 00000100:00100000:1.0:1788572433.279122:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584412672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572433.279163:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584412672:12345-0@lo:400:kworker.0 Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572433.279170:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7814 00000100:00100000:1.0:1788572433.279200:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584412672:0@lo:400:kworker.0 00000100:00100000:2.0:1788572433.280398:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584412928:0@lo:400:kworker.0 00000100:00100000:2.0:1788572433.280459:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572433.280515:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572433.280522:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584412800:0@lo:400:kworker.0 00000100:00100000:2.0:1788572433.280549:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572433.280597:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584412032 00000100:00100000:2.0:1788572433.280603:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584412032 00000100:00100000:2.0:1788572433.280645:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584412288 00000100:00100000:2.0:1788572433.280649:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584412288 00000100:00100000:2.0:1788572433.280669:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584412928 00000100:00100000:2.0:1788572433.280672:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584412928 00000100:00100000:2.0:1788572433.280690:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1788572433.280697:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584412032:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572433.280719:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a84c700 x1875444584412032/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:94/0 lens 224/224 e 0 to 0 dl 1788572444 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572433.280753:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584412032:12345-0@lo:400:kworker.0 Request processed in 57us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572433.280760:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1788572433.280775:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1788572433.280781:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584412288:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572433.280805:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905fee680 x1875444584412288/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:94/0 lens 224/224 e 0 to 0 dl 1788572444 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572433.280915:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1788572433.280925:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584412928:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572433.280937:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffac000 x1875444584412928/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:94/0 lens 224/224 e 0 to 0 dl 1788572444 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572433.280976:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584412928:12345-0@lo:400:kworker.0 Request processed in 54us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572433.280982:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1788572433.281021:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584412800 00000100:00100000:3.0:1788572433.281025:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584412800 00000100:00100000:3.0:1788572433.281047:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7815 00000100:00100000:3.0:1788572433.281053:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584412800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572433.281085:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584412800:12345-0@lo:400:kworker.0 Request processed in 32us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572433.281091:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7815 00000100:00080000:3.0:1788572433.281116:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572433.281176:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584412800:0@lo:400:kworker.0 00000100:00100000:3.0:1788572433.281189:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584412928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572433.282823:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584412032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572433.282869:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584412160:0@lo:38:kworker.0 00000100:00100000:0.0:1788572433.282937:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572433.282980:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584412416:0@lo:38:kworker.0 00000100:00100000:0.0:1788572433.283005:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572433.283037:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584412160 00000100:00100000:0.0:1788572433.283043:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584412160 00000100:00100000:0.0:1788572433.283072:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584412416 00000100:00100000:0.0:1788572433.283074:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584412416 00000100:00100000:0.0:1788572433.283088:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1788572433.283095:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584412160:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572433.283120:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572433.283157:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584412160:12345-0@lo:38:kworker.0 Request processed in 61us (219us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572433.283163:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1788572433.283182:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1788572433.283186:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584412416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572433.283195:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572433.283218:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584412416:12345-0@lo:38:kworker.0 Request processed in 31us (213us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572433.283223:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00080000:0.0:1788572433.283246:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572433.283250:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572433.283254:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584412416:0@lo:38:kworker.0 00000100:00100000:0.0:1788572433.283262:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584412544:0@lo:38:kworker.0 00000100:00100000:0.0:1788572433.283288:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572433.283333:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572433.283338:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572433.283341:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584412160:0@lo:38:kworker.0 00000100:00100000:2.0:1788572433.284242:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584412288:12345-0@lo:400:kworker.0 Request processed in 3455us (5251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572433.284254:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1788572433.288106:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584412288:0@lo:400:kworker.0 00000100:00100000:3.0:1788572433.289053:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584412544 00000100:00100000:3.0:1788572433.289064:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584412544 00000100:00100000:3.0:1788572433.289119:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1788572433.289128:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584412544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572433.289152:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572433.289250:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584412544:12345-0@lo:38:kworker.0 Request processed in 121us (5960us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572433.289257:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00080000:0.0:1788572433.291299:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572433.291314:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572433.291319:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584412544:0@lo:38:kworker.0 00010000:00010000:2.0:1788572434.044731:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572435.069831:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572436.105844:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572437.119710:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572437.379149:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572437.379352:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584413056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572437.379432:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572437.381574:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572437.381594:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584413184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572437.381651:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572437.384215:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584413056 00000100:00100000:3.0:1788572437.384229:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584413056 00000100:00100000:3.0:1788572437.384338:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584413184 00000100:00100000:3.0:1788572437.384342:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584413184 00000100:00100000:1.0:1788572437.384398:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6393 00000100:00100000:1.0:1788572437.384410:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584413056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572437.384446:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140352 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572437.384535:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584413056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (5103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572437.384542:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6393 00000100:00100000:0.0:1788572437.384709:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584413056:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572437.384892:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572437.384896:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572437.385040:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6394 00000100:00100000:3.0:1788572437.385048:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584413184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572437.385065:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572437.385218:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584413184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (3566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572437.385227:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6394 00000100:00100000:0.0:1788572437.385279:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584413184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572437.871446:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572437.871578:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569539584 00000100:00100000:3.0:1788572437.871588:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569539584 00000100:00100000:3.0:1788572437.871645:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 100 00000100:00100000:3.0:1788572437.871664:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569539584:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572437.871739:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569539584:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572437.871746:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 100 00000100:00100000:0.0:1788572437.873970:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572437.874023:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572437.874274:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569539712 00000100:00100000:3.0:1788572437.874283:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569539712 00000100:00100000:3.0:1788572437.874350:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569539840 00000100:00100000:3.0:1788572437.874352:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569539840 00000100:00100000:3.0:1788572437.874369:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 434 00000100:00100000:3.0:1788572437.874386:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569539712:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572437.874418:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a84c380 x1875444569539712/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:98/0 lens 224/224 e 0 to 0 dl 1788572448 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572437.874473:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569539712:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 89us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572437.874510:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 434 00000100:00100000:3.0:1788572437.874530:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1196 00000100:00100000:3.0:1788572437.874535:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569539840:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:3.0:1788572437.874556:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572437.874582:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569539840:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 46us (559us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572437.874591:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1196 00000100:00080000:0.0:1788572437.874764:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788572438.142828:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572438.397135:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572438.397143:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572438.397147:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572438.397164:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9186 00000100:00080000:1.0:1788572438.397170:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572438.397176:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572438.397199:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905feea00 x1875444584413568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572438.397238:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572438.397241:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572438.397243:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572438.397247:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9186 00000100:00080000:1.0:1788572438.397249:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788572438.397253:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572438.397264:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905fec700 x1875444584413824/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572438.397273:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572438.397277:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572438.397278:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572438.397282:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9186 00000100:00080000:1.0:1788572438.397284:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572438.397287:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e59059d0800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572438.397297:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36944000 x1875444584413952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572438.397431:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584413568:0@lo:38:kworker.0 00000100:00100000:2.0:1788572438.397550:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572438.397608:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584413824:0@lo:38:kworker.0 00000100:00100000:2.0:1788572438.397632:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572438.397651:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584413952:0@lo:38:kworker.0 00000100:00100000:2.0:1788572438.397688:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572438.397725:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584413568 00000100:00100000:2.0:1788572438.397733:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584413568 00000100:00100000:2.0:1788572438.397767:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584413824 00000100:00100000:2.0:1788572438.397770:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584413824 00000100:00100000:2.0:1788572438.397789:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1788572438.397797:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584413568:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572438.397833:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572438.397880:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584413568:12345-0@lo:38:kworker.0 Request processed in 81us (329us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572438.397887:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1788572438.397902:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1788572438.397906:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584413824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572438.397915:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572438.398122:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584413824:12345-0@lo:38:kworker.0 Request processed in 213us (488us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572438.398129:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00080000:2.0:1788572438.398183:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572438.398188:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572438.398192:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584413568:0@lo:38:kworker.0 00000100:00080000:2.0:1788572438.398200:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572438.398203:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572438.398205:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584413824:0@lo:38:kworker.0 00000100:00100000:3.0:1788572438.398462:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584413440:0@lo:400:kworker.0 00000100:00100000:3.0:1788572438.398607:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572438.398647:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584414336:0@lo:400:kworker.0 00000100:00100000:3.0:1788572438.398740:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572438.398762:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572438.398770:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584413312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572438.398800:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572438.398836:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584414208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572438.398863:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572438.398894:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584414208 00000100:00100000:3.0:1788572438.398899:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584414208 00000100:00100000:1.0:1788572438.399028:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584413440 00000100:00100000:1.0:1788572438.399033:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584413440 00000100:00100000:1.0:1788572438.399061:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584414336 00000100:00100000:1.0:1788572438.399064:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584414336 00000100:00100000:1.0:1788572438.399080:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1788572438.399086:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584413440:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572438.399106:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905160000 x1875444584413440/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:99/0 lens 224/224 e 0 to 0 dl 1788572449 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572438.399169:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7816 00000100:00100000:3.0:1788572438.399177:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584414208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572438.399263:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584413696:0@lo:400:kworker.0 00000100:00100000:0.0:1788572438.399292:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572438.399315:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572438.399321:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584414080:0@lo:400:kworker.0 00000100:00100000:0.0:1788572438.399343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572438.399372:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584413952 00000100:00100000:0.0:1788572438.399376:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584413952 00000100:00100000:0.0:1788572438.399399:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1788572438.399404:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584413952:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572438.399419:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572438.399452:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584413952:12345-0@lo:38:kworker.0 Request processed in 47us (1763us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572438.399459:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1788572438.399499:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584413312 00000100:00100000:0.0:1788572438.399502:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584413312 00000100:00100000:0.0:1788572438.399527:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788572438.399534:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a400f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3644:x1875444584413312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572438.399629:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584413696 00000100:00100000:2.0:1788572438.399634:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584413696 00000100:00100000:2.0:1788572438.399676:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1788572438.399683:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584414336:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572438.399698:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905163800 x1875444584414336/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:99/0 lens 224/224 e 0 to 0 dl 1788572449 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572438.403380:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584413440:12345-0@lo:400:kworker.0 Request processed in 4283us (4761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572438.403396:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1788572438.403437:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1788572438.403454:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584413696:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572438.403503:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a84ca80 x1875444584413696/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:99/0 lens 224/224 e 0 to 0 dl 1788572449 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572438.408909:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584414208:12345-0@lo:400:kworker.0 Request processed in 9723us (10035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572438.408926:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7816 00000100:00100000:3.0:1788572438.409148:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584413312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572438.409704:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584414208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572438.409718:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584413440:0@lo:400:kworker.0 00000100:00100000:3.0:1788572438.409729:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584414336:0@lo:400:kworker.0 00000100:00100000:3.0:1788572438.409773:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584414080 00000100:00100000:3.0:1788572438.409780:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584414080 00000100:00100000:3.0:1788572438.409844:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7817 00000100:00100000:3.0:1788572438.409853:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584414080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572438.410124:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584414080:12345-0@lo:400:kworker.0 Request processed in 271us (10778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572438.410130:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7817 00000100:00100000:0.0:1788572438.415178:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a400f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3644:x1875444584413312:12345-0@lo:400:kworker.0 Request processed in 15637us (16369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572438.415193:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788572438.415298:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584414336:12345-0@lo:400:kworker.0 Request processed in 15615us (16556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572438.415308:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1788572438.422670:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584414080:0@lo:400:kworker.0 00000100:00100000:0.0:1788572438.422703:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584413696:0@lo:400:kworker.0 00000100:00080000:0.0:1788572438.422776:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572438.422782:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572438.422786:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584413952:0@lo:38:kworker.0 00000100:00080000:0.0:1788572438.422887:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572438.425058:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584413696:12345-0@lo:400:kworker.0 Request processed in 19085us (23236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572438.425075:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000001:00100000:2.0:1788572438.911966:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:2.0:1788572438.911977:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5903a22000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:3.0:1788572438.912021:0:177620:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a22000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-OST0001 00000020:00000080:3.0:1788572438.912074:0:177620:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5903a27000 for lustre-OST0001 00000001:00100000:2.0:1788572438.918251:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:2.0:1788572438.918262:0:194757:0:(genops.c:885:class_export_put()) final put ffff8e5903a20000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:3.0:1788572438.918370:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903a20000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-OST0000 00000020:00000080:3.0:1788572438.918430:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5903a25000 for lustre-OST0000 00010000:00010000:2.0:1788572439.165238:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572440.194704:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572441.218267:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572442.236926:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572442.494811:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572442.494827:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584414464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572442.494904:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572442.499286:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584414464 00000100:00100000:1.0:1788572442.499302:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584414464 00000100:00100000:1.0:1788572442.499371:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6395 00000100:00100000:1.0:1788572442.499381:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584414464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572442.499415:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140352 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572442.499516:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584414464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (4612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572442.499524:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6395 00000100:00100000:1.0:1788572442.499583:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584414464:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788572442.499721:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572442.505434:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572442.505461:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584414592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572442.505563:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572442.505696:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584414592 00000100:00100000:2.0:1788572442.505704:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584414592 00000100:00100000:2.0:1788572442.505775:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6396 00000100:00100000:2.0:1788572442.505785:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584414592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572442.505817:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572442.505874:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584414592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572442.505881:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6396 00000100:00080000:0.0:1788572442.505996:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572442.506045:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584414592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572442.989176:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572442.989233:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572442.989324:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569540096 00000100:00100000:3.0:1788572442.989334:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569540096 00000100:00100000:3.0:1788572442.989427:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 438 00000100:00100000:3.0:1788572442.989439:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569540096:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572442.989469:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36944000 x1875444569540096/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:103/0 lens 224/224 e 0 to 0 dl 1788572453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572442.989559:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569540096:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 123us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572442.989567:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 438 00000100:00100000:3.0:1788572442.989593:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569539968 00000100:00100000:3.0:1788572442.989596:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569539968 00000100:00100000:3.0:1788572442.989624:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 102 00000100:00100000:3.0:1788572442.989631:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569539968:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572442.989660:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569539968:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 30us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572442.989666:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 102 00000100:00080000:1.0:1788572442.990002:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572442.993697:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572442.993813:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569540224 00000100:00100000:0.0:1788572442.993825:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569540224 00000100:00100000:0.0:1788572442.993887:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1199 00000100:00100000:0.0:1788572442.993896:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569540224:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:0.0:1788572442.993924:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572442.994002:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569540224:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 105us (315us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572442.994010:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1199 00010000:00010000:0.0:1788572443.263211:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572443.517944:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572443.517952:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788572443.517955:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572443.517962:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9191 00000100:00080000:0.0:1788572443.517967:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572443.517974:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572443.517994:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eac700 x1875444584414976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572443.519186:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572443.519190:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788572443.519192:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572443.519199:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9191 00000100:00080000:0.0:1788572443.519202:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572443.519207:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572443.519221:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eab480 x1875444584415232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572443.519229:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572443.519232:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788572443.519233:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572443.519236:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9191 00000100:00080000:0.0:1788572443.519238:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572443.519241:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e59059d0800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572443.519249:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ea8700 x1875444584415360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572443.519295:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584414720:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.519361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572443.519403:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584415616:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.519424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572443.519448:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788572443.519452:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584414848:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.519472:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572443.519506:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584415744:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.519524:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572443.519549:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584414976:0@lo:38:kworker.0 00000100:00100000:0.0:1788572443.519568:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572443.519581:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584415232:0@lo:38:kworker.0 00000100:00100000:0.0:1788572443.519596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572443.519609:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584415360:0@lo:38:kworker.0 00000100:00100000:0.0:1788572443.519625:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572443.519647:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584415104:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.519667:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572443.519683:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572443.519688:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584415488:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.519708:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572443.521455:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584414720 00000100:00100000:0.0:1788572443.521470:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584414720 00000100:00100000:0.0:1788572443.521548:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788572443.521556:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3643:x1875444584414720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.521620:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3643:x1875444584414720:12345-0@lo:400:kworker.0 Request processed in 65us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572443.521627:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788572443.521662:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584415616 00000100:00100000:0.0:1788572443.521666:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584415616 00000100:00100000:0.0:1788572443.521692:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584415488 00000100:00100000:0.0:1788572443.521696:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584415488 00000100:00100000:0.0:1788572443.521715:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7818 00000100:00100000:0.0:1788572443.521722:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584415616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.521767:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584415616:12345-0@lo:400:kworker.0 Request processed in 45us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572443.521773:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7818 00000100:00100000:0.0:1788572443.521786:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7819 00000100:00100000:0.0:1788572443.521791:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584415488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.521824:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584415488:12345-0@lo:400:kworker.0 Request processed in 33us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572443.521830:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7819 00000100:00100000:0.0:1788572443.521858:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584414848 00000100:00100000:0.0:1788572443.521862:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584414848 00000100:00100000:0.0:1788572443.521896:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584415744 00000100:00100000:0.0:1788572443.521899:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584415744 00000100:00100000:0.0:1788572443.521908:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584414976 00000100:00100000:0.0:1788572443.521911:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584414976 00000100:00100000:0.0:1788572443.521919:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584415232 00000100:00100000:0.0:1788572443.521921:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584415232 00000100:00100000:0.0:1788572443.521928:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584415104 00000100:00100000:0.0:1788572443.521930:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584415104 00000100:00100000:0.0:1788572443.521944:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1788572443.521950:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584414848:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572443.521965:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1f8fc700 x1875444584414848/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:104/0 lens 224/224 e 0 to 0 dl 1788572454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572443.521996:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584414848:12345-0@lo:400:kworker.0 Request processed in 47us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572443.522017:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1788572443.522032:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1788572443.522038:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584415744:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572443.522049:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27263800 x1875444584415744/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:104/0 lens 224/224 e 0 to 0 dl 1788572454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572443.522077:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584415744:12345-0@lo:400:kworker.0 Request processed in 39us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572443.522082:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1788572443.522095:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1788572443.522101:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584415104:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572443.522113:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27262a00 x1875444584415104/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:104/0 lens 224/224 e 0 to 0 dl 1788572454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572443.522139:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584415104:12345-0@lo:400:kworker.0 Request processed in 39us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572443.522144:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1788572443.522157:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1788572443.522160:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584414976:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572443.522180:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572443.522214:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584414976:12345-0@lo:38:kworker.0 Request processed in 51us (2644us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572443.522223:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1788572443.522235:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1788572443.522239:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584415232:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572443.522248:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572443.522272:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584415232:12345-0@lo:38:kworker.0 Request processed in 32us (2675us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572443.522277:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1788572443.522308:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584415360 00000100:00100000:0.0:1788572443.522312:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584415360 00000100:00100000:0.0:1788572443.522330:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1788572443.522334:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584415360:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572443.522343:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572443.522365:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584415360:12345-0@lo:38:kworker.0 Request processed in 30us (2739us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572443.522370:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00080000:0.0:1788572443.522395:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572443.522427:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572443.522432:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572443.522435:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584414976:0@lo:38:kworker.0 00000100:00080000:0.0:1788572443.522444:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572443.522447:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572443.522449:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584415232:0@lo:38:kworker.0 00000100:00080000:0.0:1788572443.522457:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572443.522459:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572443.522462:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584415360:0@lo:38:kworker.0 00000100:00100000:0.0:1788572443.522515:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584415488:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.522525:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584415104:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.522545:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584414848:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.522554:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584415744:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.522562:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584414720:0@lo:400:kworker.0 00000100:00100000:0.0:1788572443.522571:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584415616:0@lo:400:kworker.0 00010000:00010000:1.0:1788572444.287574:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572445.315888:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788572445.474210:0:198960:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788572445.474214:0:198960:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788572445.474215:0:198960:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788572445.474320:0:198960:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e5a40f51000 00000020:01000004:0.0:1788572445.474335:0:198960:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788572445.474350:0:198960:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788572445.474364:0:198960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8e5a413f8000) 00000020:00000080:0.0:1788572445.474382:0:198960:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788572446.325513:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788572446.327709:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00010000:00010000:2.0:1788572446.333441:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788572446.342649:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.345324:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.345976:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.352376:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.353017:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.353562:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.353884:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.354121:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.354357:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.354641:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.355047:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.355601:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.356943:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.357601:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.358794:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.359027:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.359653:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.359892:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.360550:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.360788:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.361071:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.361555:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.362070:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.362248:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.362833:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.363086:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.363678:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.363916:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.364755:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.365088:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.365751:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.365995:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.366652:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.367390:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.367907:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.375353:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.375947:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.376571:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.377724:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.378064:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.378566:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.379548:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.380575:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.380913:0:198960:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00080000:01000000:3.0:1788572446.382686:0:198960:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788572446.382925:0:198960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788572446.382935:0:198960:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788572446.382949:0:198960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109bec5a 00000020:01000004:3.0:1788572446.382957:0:198960:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788572446.382983:0:198960:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.157@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788572446.382986:0:198960:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788572446.382991:0:198960:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788572446.383017:0:198960:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788572446.383022:0:198960:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.157@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788572446.396878:0:198960:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.157@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788572446.396932:0:198960:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.157@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788572446.396938:0:198960:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788572446.396940:0:198960:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788572446.396941:0:198960:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572446.396942:0:198960:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572446.396943:0:198960:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572446.396944:0:198960:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572446.396945:0:198960:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572446.396947:0:198960:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572446.396948:0:198960:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572446.396953:0:198960:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788572446.396955:0:198960:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788572446.396957:0:198960:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788572446.396958:0:198960:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572446.396959:0:198960:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572446.396960:0:198960:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572446.396961:0:198960:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572446.396963:0:198960:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572446.396964:0:198960:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572446.396965:0:198960:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572446.396990:0:198960:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788572446.397011:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584415872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788572446.397077:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.397117:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c537180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.397211:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584415872 00000100:00100000:3.0:1788572446.397219:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584415872 00000100:00100000:3.0:1788572446.397278:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788572446.397287:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:198960:x1875444584415872:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788572446.397317:0:196587:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788572446.397320:0:196587:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788572446.397328:0:196587:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788572446.397437:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:198960:x1875444584415872:12345-0@lo:253:mount.lustre.0 Request processed in 150us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.397444:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788572446.397578:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584415872:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788572446.397587:0:198960:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788572446.397589:0:198960:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788572446.397590:0:198960:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788572446.397591:0:198960:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572446.397593:0:198960:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572446.397594:0:198960:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572446.397595:0:198960:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572446.397596:0:198960:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572446.397597:0:198960:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572446.397599:0:198960:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788572446.397626:0:198960:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a40f51000 from lustre-MDT0001 10000000:01000000:1.0:1788572446.397657:0:198960:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788572446.397660:0:198960:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788572446.397668:0:198960:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e5a0efbb380 local copy 00010000:00010000:1.0:1788572446.397679:0:198960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572446.397755:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572446.397787:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.397819:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904326e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.398023:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584416000 00000100:00100000:0.0:1788572446.398028:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584416000 00000100:00100000:0.0:1788572446.398068:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788572446.398076:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:198960:x1875444584416000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572446.398141:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:198960:x1875444584416000:12345-0@lo:501:mount.lustre.0 Request processed in 66us (352us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.398147:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788572446.398236:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416000:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788572446.398251:0:198960:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788572446.398272:0:198960:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788572446.398278:0:198960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.398287:0:198960:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572446.398311:0:198960:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5a40f51000 10000000:01000000:1.0:1788572446.398316:0:198960:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788572446.398321:0:198960:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e5a40f51000 10000000:01000000:1.0:1788572446.398323:0:198960:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788572446.398326:0:198960:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a40f51000 from 1 10000000:01000000:1.0:1788572446.398328:0:198960:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788572446.398349:0:198960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.398357:0:198960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.398365:0:198960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572446.398377:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572446.398401:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.398438:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904326e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.398542:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584416128 00000100:00100000:0.0:1788572446.398547:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584416128 00000100:00100000:0.0:1788572446.398578:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788572446.398585:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:198960:x1875444584416128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572446.398594:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572446.398607:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a4117f000/0x265cfe11109bec68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bec61 expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.398628:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a4117f000/0x265cfe11109bec68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bec61 expref: 20 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.398638:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a4117f000/0x265cfe11109bec68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bec61 expref: 20 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.398647:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117f000, rc 0) 00000100:00100000:0.0:1788572446.398674:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:198960:x1875444584416128:12345-0@lo:101:mount.lustre.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.398680:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788572446.398852:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572446.398878:0:198960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bec68 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.398887:0:198960:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bec68 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572446.398900:0:198960:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788572446.398916:0:198960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bec68 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.398923:0:198960:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bec68 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572446.398928:0:198960:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788572446.398932:0:198960:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788572446.398935:0:198960:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e5a40f51000 10000000:01000000:1.0:1788572446.398937:0:198960:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788572446.398940:0:198960:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788572446.398942:0:198960:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788572446.398955:0:198960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.398963:0:198960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.398971:0:198960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572446.398987:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572446.399013:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.399042:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904326e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.399533:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584416256 00000100:00100000:3.0:1788572446.399539:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584416256 00000100:00100000:3.0:1788572446.399583:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788572446.399592:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:198960:x1875444584416256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.399601:0:196583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572446.399613:0:196583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bec76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bec6f expref: -99 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.399630:0:196583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bec76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bec6f expref: 21 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.399639:0:196583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bec76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bec6f expref: 21 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.399650:0:196583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce400, rc 0) 00000100:00100000:3.0:1788572446.399697:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584416256:12345-0@lo:101:mount.lustre.0 Request processed in 107us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.399703:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788572446.399890:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572446.399904:0:198960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bec76 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.399913:0:198960:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bec76 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572446.400112:0:198960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 46 count 46 00000040:00080000:1.0:1788572446.401630:0:198960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572446.416909:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:1.0:1788572446.416978:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 136 off8552 00000040:00080000:1.0:1788572446.416995:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 176 off8728 00000040:00080000:1.0:1788572446.417010:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8952 00000040:00080000:1.0:1788572446.417025:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 224 off9176 00000040:00080000:1.0:1788572446.417039:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 120 off9296 00000040:00080000:1.0:1788572446.417053:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 112 off9408 00000040:00080000:1.0:1788572446.417068:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 160 off9568 00000040:00080000:1.0:1788572446.417081:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9792 00000040:00080000:1.0:1788572446.417096:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].10, 224 off10016 00000040:00080000:1.0:1788572446.417111:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].11, 88 off10104 00000040:00080000:1.0:1788572446.417127:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].12, 144 off10248 00000040:00080000:1.0:1788572446.417141:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].13, 152 off10400 00000040:00080000:1.0:1788572446.417154:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].14, 168 off10568 00000040:00080000:1.0:1788572446.417168:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].15, 224 off10792 00000040:00080000:1.0:1788572446.417182:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].16, 224 off11016 00000040:00080000:1.0:1788572446.417196:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].17, 80 off11096 00000040:00080000:1.0:1788572446.417210:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].18, 224 off11320 00000040:00080000:1.0:1788572446.417222:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].19, 224 off11544 00000040:00080000:1.0:1788572446.417235:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].20, 160 off11704 00000040:00080000:1.0:1788572446.417247:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].21, 224 off11928 00000040:00080000:1.0:1788572446.417258:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].22, 224 off12152 00000040:00080000:1.0:1788572446.417270:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].23, 80 off12232 00000040:00080000:1.0:1788572446.417306:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].24, 224 off12456 00000040:00080000:1.0:1788572446.417324:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].25, 224 off12680 00000040:00080000:1.0:1788572446.417339:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].26, 88 off12768 00000040:00080000:1.0:1788572446.417353:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].27, 144 off12912 00000040:00080000:1.0:1788572446.417366:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].28, 152 off13064 00000040:00080000:1.0:1788572446.417378:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].29, 136 off13200 00000040:00080000:1.0:1788572446.417392:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].30, 224 off13424 00000040:00080000:1.0:1788572446.417405:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].31, 224 off13648 00000040:00080000:1.0:1788572446.417420:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].32, 80 off13728 00000040:00080000:1.0:1788572446.417432:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].33, 224 off13952 00000040:00080000:1.0:1788572446.417444:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].34, 224 off14176 00000040:00080000:1.0:1788572446.417458:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].35, 88 off14264 00000040:00080000:1.0:1788572446.417471:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].36, 144 off14408 00000040:00080000:1.0:1788572446.417512:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].37, 152 off14560 00000040:00080000:1.0:1788572446.417529:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].38, 136 off14696 00000040:00080000:1.0:1788572446.417542:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].39, 224 off14920 00000040:00080000:1.0:1788572446.417556:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].40, 224 off15144 00000040:00080000:1.0:1788572446.417572:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].41, 80 off15224 00000040:00080000:1.0:1788572446.417586:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].42, 224 off15448 00000040:00080000:1.0:1788572446.417599:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].43, 224 off15672 00000040:00080000:1.0:1788572446.417614:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].44, 120 off15792 00000040:00080000:1.0:1788572446.417642:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].45, 224 off16016 00000040:00080000:1.0:1788572446.417647:0:198960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 45 count 46 00000100:00100000:1.0:1788572446.417775:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572446.417842:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.417905:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59050fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.418392:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584416384 00000100:00100000:3.0:1788572446.418400:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584416384 00000100:00100000:3.0:1788572446.418461:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788572446.418471:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584416384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.418767:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584416384:12345-0@lo:501:mount.lustre.0 Request processed in 297us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.418775:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788572446.418876:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572446.418915:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572446.418961:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.418990:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c5370c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.419033:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584416512 00000100:00100000:3.0:1788572446.419037:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584416512 00000100:00100000:3.0:1788572446.419066:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788572446.419073:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584416512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572446.419149:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584416512:12345-0@lo:503:mount.lustre.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.419156:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788572446.419226:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416512:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788572446.419686:0:198960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788572446.419745:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572446.419784:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.419805:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c5370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.420079:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584416640 00000100:00100000:0.0:1788572446.420084:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584416640 00000100:00100000:0.0:1788572446.420125:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788572446.420132:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584416640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572446.421166:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584416640:12345-0@lo:502:mount.lustre.0 Request processed in 1031us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.421177:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788572446.421343:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572446.421808:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:1.0:1788572446.421841:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 136 off8552 00000040:00080000:1.0:1788572446.421857:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 176 off8728 00000040:00080000:1.0:1788572446.421886:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8952 00000040:00080000:1.0:1788572446.421901:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 224 off9176 00000040:00080000:1.0:1788572446.421916:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 120 off9296 00000040:00080000:1.0:1788572446.421931:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 112 off9408 00000040:00080000:1.0:1788572446.421944:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 160 off9568 00000040:00080000:1.0:1788572446.421957:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9792 00000040:00080000:1.0:1788572446.421970:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 224 off10016 00000040:00080000:1.0:1788572446.421985:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 88 off10104 00000040:00080000:1.0:1788572446.421999:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 144 off10248 00000040:00080000:1.0:1788572446.422013:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].13, 152 off10400 00000040:00080000:1.0:1788572446.422029:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].14, 168 off10568 00000040:00080000:1.0:1788572446.422045:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].15, 224 off10792 00000040:00080000:1.0:1788572446.422059:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].16, 224 off11016 00000040:00080000:1.0:1788572446.422073:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].17, 80 off11096 00000040:00080000:1.0:1788572446.422087:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].18, 224 off11320 00000040:00080000:1.0:1788572446.422103:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].19, 224 off11544 00000040:00080000:1.0:1788572446.422117:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].20, 160 off11704 00000040:00080000:1.0:1788572446.422130:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].21, 224 off11928 00000040:00080000:1.0:1788572446.422147:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].22, 224 off12152 00000040:00080000:1.0:1788572446.422161:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].23, 80 off12232 00000040:00080000:1.0:1788572446.422178:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].24, 224 off12456 00000040:00080000:1.0:1788572446.422193:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].25, 224 off12680 00000040:00080000:1.0:1788572446.422209:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].26, 88 off12768 00000040:00080000:1.0:1788572446.422224:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].27, 144 off12912 00000040:00080000:1.0:1788572446.422240:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].28, 152 off13064 00000040:00080000:1.0:1788572446.422255:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].29, 136 off13200 00000040:00080000:1.0:1788572446.422270:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].30, 224 off13424 00000040:00080000:1.0:1788572446.422285:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].31, 224 off13648 00000040:00080000:1.0:1788572446.422300:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].32, 80 off13728 00000040:00080000:1.0:1788572446.422315:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].33, 224 off13952 00000040:00080000:1.0:1788572446.422331:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].34, 224 off14176 00000040:00080000:1.0:1788572446.422347:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].35, 88 off14264 00000040:00080000:1.0:1788572446.422363:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].36, 144 off14408 00000040:00080000:1.0:1788572446.422379:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].37, 152 off14560 00000040:00080000:1.0:1788572446.422395:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].38, 136 off14696 00000040:00080000:1.0:1788572446.422410:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].39, 224 off14920 00000040:00080000:1.0:1788572446.423805:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].40, 224 off15144 00000040:00080000:1.0:1788572446.423833:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].41, 80 off15224 00000040:00080000:1.0:1788572446.423849:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].42, 224 off15448 00000040:00080000:1.0:1788572446.423876:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].43, 224 off15672 00000040:00080000:1.0:1788572446.423893:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].44, 120 off15792 00000100:00100000:1.0:1788572446.423940:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572446.424026:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.424075:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59050fe300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.424686:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584416768 00000100:00100000:3.0:1788572446.424694:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584416768 00000100:00100000:3.0:1788572446.424744:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788572446.424754:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3fbad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584416768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572446.424958:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3fbad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584416768:12345-0@lo:502:mount.lustre.0 Request processed in 204us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.424966:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788572446.428791:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584416768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572446.428933:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].45, 224 off16016 00000040:00080000:0.0:1788572446.428951:0:198960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788572446.434190:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.434205:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.434207:0:198964:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788572446.434212:0:198964:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788572446.434216:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572446.434231:0:198964:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8e5a109fcd40) 00000020:00000080:3.0:1788572446.434258:0:198964:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:3.0:1788572446.434263:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788572446.434338:0:198964:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788572446.434344:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109bec84 00000020:00000080:3.0:1788572446.434621:0:198964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788572446.434626:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.434630:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.434631:0:198964:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788572446.434635:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.434638:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.434640:0:198964:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788572446.434643:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572446.434651:0:198964:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8e5a109fb380) 00000020:00000080:3.0:1788572446.434664:0:198964:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:3.0:1788572446.434668:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788572446.434670:0:198964:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788572446.434673:0:198964:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788572446.434679:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788572446.434726:0:198964:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a40f51000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788572446.434740:0:198964:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8e5901bf99c0) 00000020:00000080:3.0:1788572446.434750:0:198964:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:3.0:1788572446.434802:0:198964:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788572446.434806:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bec99 00000020:00000080:3.0:1788572446.434914:0:198964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788572446.434919:0:198964:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788572446.434923:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x265cfe11109beca0 00080000:01000000:3.0:1788572446.434927:0:198964:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788572446.434931:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109beca7 00010000:00010000:1.0:1788572446.540850:0:198964:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:1.0:1788572446.541009:0:198964:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 21474837476 lx: 0 gen 86 00000001:00080000:1.0:1788572446.541053:0:198964:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b idx: 1 lr: 0 srv lr: 21474837476 lx: 0 gen 85 00000001:00000004:1.0:1788572446.541077:0:198964:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 21474837476 00000001:00080000:1.0:1788572446.541184:0:198964:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1788572446.541239:0:198964:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8e59050fe6c0: xid 1875444569531776, transno 21474837549, client gen 85, slot idx 0 00000001:00080000:1.0:1788572446.541250:0:198964:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8e59050fe240: xid 1875444569528704, transno 21474837548, client gen 85, slot idx 1 00000020:00000080:1.0:1788572446.550589:0:198964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788572446.550606:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572446.550614:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572446.550616:0:198964:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788572446.550621:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572446.550628:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572446.550630:0:198964:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788572446.550634:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788572446.550639:0:198964:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:00000080:1.0:1788572446.550668:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788572446.550684:0:198964:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8e59028a3380) 00000020:00000080:1.0:1788572446.550710:0:198964:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788572446.550715:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788572446.550794:0:198964:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788572446.550800:0:198964:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788572446.550810:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109becc3 00010000:00080000:1.0:1788572446.550845:0:198964:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a3f8c7800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.157@tcp at head 00010000:00010000:1.0:1788572446.552465:0:198964:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:3.0:1788572446.560770:0:198964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572446.560785:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788572446.560828:0:198964:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788572446.560848:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109becca 00000100:00080000:3.0:1788572446.561036:0:198964:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572446.561045:0:198964:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572446.561082:0:198964:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24617800 x1875444584416896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572446.561149:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584416896:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788572446.561217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.561304:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584416896 00000100:00100000:1.0:1788572446.561312:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584416896 00000100:00100000:1.0:1788572446.561351:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1788572446.561359:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584416896:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788572446.561384:0:189111:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9199 last 0 00000020:00000080:1.0:1788572446.561418:0:189111:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109becd1 00000004:00100000:1.0:1788572446.561443:0:189111:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572446.561574:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f312000 : changing import state from RECOVER to FULL 00010000:00000080:1.0:1788572446.561592:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27261c00 x1875444584416896/t0(0) o38->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788572466 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572446.561797:0:198964:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788572446.561881:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.561886:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.561888:0:198964:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788572446.561891:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572446.561894:0:198964:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788572446.561896:0:198964:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572446.561898:0:198964:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572446.561899:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572446.561902:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.561904:0:198964:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572446.561910:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.561915:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.561917:0:198964:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788572446.561921:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788572446.561955:0:198964:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788572446.561970:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.561973:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.561974:0:198964:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788572446.561977:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572446.561978:0:198964:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788572446.561979:0:198964:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572446.561981:0:198964:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572446.561983:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572446.561985:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.561987:0:198964:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572446.561989:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788572446.561992:0:198964:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788572446.561995:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.561996:0:198964:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788572446.561999:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572446.562003:0:198964:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:3.0:1788572446.562022:0:198964:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788572446.562025:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572446.562038:0:198964:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8e5901bfb380) 00000020:00000080:3.0:1788572446.562054:0:198964:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788572446.562059:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572446.562118:0:198964:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788572446.562125:0:198964:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788572446.562132:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109becdf 00010000:00080000:3.0:1788572446.562158:0:198964:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a0efdc800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572446.562349:0:198964:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000100:00080000:2.0:1788572446.563612:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572446.563619:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788572446.563622:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572446.563628:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9196 00000100:00080000:2.0:1788572446.563631:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572446.563636:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572446.563655:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905fece00 x1875444584417152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:3.0:1788572446.563818:0:198964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788572446.563841:0:198964:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788572446.564114:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584417152:0@lo:38:kworker.0 00000100:00100000:0.0:1788572446.564169:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.564240:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584417152 00000100:00100000:3.0:1788572446.564247:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584417152 00000100:00100000:3.0:1788572446.564276:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1788572446.564283:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584417152:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788572446.564328:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584417152:12345-0@lo:38:kworker.0 Request processed in 44us (158us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788572446.564334:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1788572446.564414:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584416896:12345-0@lo:38:llog_process_th.0 Request processed in 3053us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.564423:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1788572446.564834:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584417024:0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.564876:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.564921:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584417024 00000100:00100000:3.0:1788572446.564925:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584417024 00000100:00100000:3.0:1788572446.564969:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1788572446.564976:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584417024:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572446.564994:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a24616d80 x1875444584417024/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:107/0 lens 224/224 e 0 to 0 dl 1788572457 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572446.565029:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584417024:12345-0@lo:400:kworker.0 Request processed in 54us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.565036:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00080000:3.0:1788572446.565052:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572446.565083:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584417024:0@lo:400:kworker.0 00000040:00080000:1.0:1788572446.565265:0:198964:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 4, last_idx 5 00000100:00100000:0.0:1788572446.565642:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788572446.565651:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 81 00000100:00080000:0.0:1788572446.565659:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788572446.565664:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788572446.565667:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788572446.565681:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584416896:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788572446.565704:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572446.565708:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572446.565712:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584417152:0@lo:38:kworker.0 00000100:00100000:0.0:1788572446.565886:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1788572446.566184:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572446.566189:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788572446.566191:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572446.566195:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9196 00000100:00080000:2.0:1788572446.566198:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572446.566202:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572446.566219:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905fed500 x1875444584417536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572446.566229:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572446.566232:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788572446.566234:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572446.566236:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9196 00000100:00080000:2.0:1788572446.566239:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788572446.566242:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e59059d0800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572446.566252:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905fec700 x1875444584417664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572446.566348:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584417536:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.566397:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.566433:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584417664:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.566461:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.566550:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584417664 00000100:00100000:1.0:1788572446.566557:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584417664 00000100:00100000:1.0:1788572446.566587:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1788572446.566594:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584417664:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.566642:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584417664:12345-0@lo:38:kworker.0 Request processed in 47us (180us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788572446.566648:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00080000:1.0:1788572446.566677:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572446.566681:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788572446.566684:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584417664:0@lo:38:kworker.0 00000100:00100000:3.0:1788572446.566844:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584417536 00000100:00100000:3.0:1788572446.566849:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584417536 00000100:00100000:3.0:1788572446.566884:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1788572446.566889:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584417536:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788572446.566937:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584417536:12345-0@lo:38:kworker.0 Request processed in 47us (538us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788572446.566943:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00080000:3.0:1788572446.566972:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572446.566976:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572446.566979:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584417536:0@lo:38:kworker.0 00000040:00080000:1.0:1788572446.567303:0:198964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572446.567331:0:198964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].6, 64 off8576 00000040:00080000:1.0:1788572446.567444:0:198964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].1, 64 off8256 00000040:00080000:1.0:1788572446.568422:0:198969:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 6 synced_idx: 0 lgh_last_idx: 6 00000040:00080000:1.0:1788572446.568428:0:198969:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 5 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788572446.568626:0:198969:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 5, last_idx 6 00000040:00080000:1.0:1788572446.568643:0:198969:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x14:0x0] at index 5 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788572446.568762:0:198969:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788572446.568765:0:198969:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1788572446.569210:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584417920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572446.569272:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.569311:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584417280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572446.569333:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.569365:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584417280 00000100:00100000:0.0:1788572446.569372:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584417280 00000100:00100000:0.0:1788572446.569414:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1788572446.569422:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584417280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572446.569456:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:0.0:1788572446.569471:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ea9500 x1875444584417280/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 224/368 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572446.569609:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584417920 00000100:00100000:1.0:1788572446.569613:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584417920 00000100:00100000:1.0:1788572446.569655:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7820 00000100:00100000:1.0:1788572446.569662:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584417920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572446.569707:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584417920:12345-0@lo:400:kworker.0 Request processed in 46us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.569714:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7820 00000100:00080000:1.0:1788572446.569733:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572446.569778:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584417280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 357us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.569788:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1788572446.569829:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584417920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572446.569847:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584417280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572446.571574:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584417408:0@lo:400:kworker.0 00000100:00100000:0.0:1788572446.571645:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.573275:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572446.573303:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584417792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572446.573371:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.573684:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584417408 00000100:00100000:3.0:1788572446.573693:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584417408 00000100:00100000:3.0:1788572446.573754:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1788572446.573763:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584417408:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572446.573791:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ea8e00 x1875444584417408/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:107/0 lens 224/224 e 0 to 0 dl 1788572457 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572446.573842:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584417408:12345-0@lo:400:kworker.0 Request processed in 80us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.573849:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1788572446.574125:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584417408:0@lo:400:kworker.0 00000100:00080000:3.0:1788572446.574153:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572446.574752:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584417792 00000100:00100000:2.0:1788572446.574759:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584417792 00000100:00100000:2.0:1788572446.574844:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7821 00000100:00100000:2.0:1788572446.574855:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584417792:12345-0@lo:400:kworker.0 00000020:00000080:0.0:1788572446.575073:0:198964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788572446.575091:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788572446.575139:0:198964:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788572446.575161:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bece6 00000100:00080000:0.0:1788572446.575170:0:198964:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572446.575175:0:198964:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a0efdc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572446.575202:0:198964:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ea8700 x1875444584418048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572446.575300:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584417792:12345-0@lo:400:kworker.0 Request processed in 448us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.575307:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7821 00000100:00080000:2.0:1788572446.575351:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572446.575392:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572446.575402:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584418176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572446.575439:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572446.575475:0:198964:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788572446.575842:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584418048:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788572446.575891:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.576030:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584417792:0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.576168:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584418176 00000100:00100000:3.0:1788572446.576174:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584418176 00000020:01000000:2.0:1788572446.576302:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572446.576310:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572446.576311:0:198964:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788572446.576316:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788572446.576318:0:198964:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788572446.576320:0:198964:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572446.576321:0:198964:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572446.576323:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788572446.576325:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572446.576327:0:198964:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788572446.576329:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788572446.576334:0:198964:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788572446.576337:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572446.576338:0:198964:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788572446.576341:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788572446.576345:0:198964:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:2.0:1788572446.576367:0:198964:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788572446.576369:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788572446.576384:0:198964:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8e5904158000) 00000020:00000080:2.0:1788572446.576405:0:198964:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788572446.576410:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788572446.576511:0:198964:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788572446.576527:0:198964:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788572446.576541:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109becf4 00010000:00080000:2.0:1788572446.576570:0:198964:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5906750000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.157@tcp at head 00010000:00010000:2.0:1788572446.576780:0:198964:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788572446.576854:0:198964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788572446.576884:0:198964:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788572446.577243:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584418048 00000100:00100000:2.0:1788572446.577249:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584418048 00000100:00100000:2.0:1788572446.577286:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22691 00000100:00100000:2.0:1788572446.577293:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3640:x1875444584418048:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788572446.577323:0:43918:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9199 last 0 00000020:00000080:2.0:1788572446.577343:0:43918:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109becfb 00002000:00100000:2.0:1788572446.577357:0:43918:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e5906757800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788572446.577362:0:43918:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788572446.577364:0:43918:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788572446.577440:0:43918:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788572446.577463:0:43918:0:(import.c:65:import_set_state_nolock()) ffff8e5906753800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572446.577640:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1788572446.577651:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584418176:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572446.577671:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905fece00 x1875444584418176/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:107/0 lens 224/224 e 0 to 0 dl 1788572457 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572446.582201:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584418176:12345-0@lo:400:kworker.0 Request processed in 4540us (6749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.582219:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1788572446.582349:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584418176:0@lo:400:kworker.0 00000040:00080000:3.0:1788572446.582877:0:198964:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 4, last_idx 5 00000040:00080000:3.0:1788572446.586355:0:198964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572446.586389:0:198964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].6, 64 off8576 00000040:00080000:3.0:1788572446.586820:0:198964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].1, 64 off8256 00000100:00100000:2.0:1788572446.592100:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584418048:12345-0@lo:8:llog_process_th.0 Request processed in 14794us (16196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.592117:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22691 00000100:00100000:3.0:1788572446.592252:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572446.592265:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 9 00000100:00080000:3.0:1788572446.592273:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788572446.592279:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788572446.592282:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efdc800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788572446.592346:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788572446.592354:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584418048:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788572446.594902:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572446.594936:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584418304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572446.595039:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.595094:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584418304 00000100:00100000:2.0:1788572446.595101:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584418304 00000100:00100000:2.0:1788572446.595162:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6397 00000100:00100000:2.0:1788572446.595172:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584418304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572446.595208:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572446.595257:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584418304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.595264:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6397 00000100:00100000:2.0:1788572446.595317:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584418304:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572446.595339:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788572446.595785:0:198971:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 6 synced_idx: 0 lgh_last_idx: 6 00000040:00080000:0.0:1788572446.595790:0:198971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x16:0x0] at index 5 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788572446.596016:0:198971:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 5, last_idx 6 00000040:00080000:0.0:1788572446.596043:0:198971:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x16:0x0] at index 5 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788572446.596174:0:198971:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788572446.596178:0:198971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788572446.597314:0:198964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572446.597327:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788572446.597366:0:198964:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788572446.597384:0:198964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bed02 00000100:00080000:3.0:1788572446.597393:0:198964:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572446.597399:0:198964:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e5906750000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572446.597444:0:198964:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24617b80 x1875444584418432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572446.597471:0:198964:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788572446.597758:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.597763:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.597765:0:198964:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788572446.597768:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.597772:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.597773:0:198964:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788572446.597776:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788572446.597778:0:198964:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788572446.597780:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.597782:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.597784:0:198964:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788572446.597786:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.597788:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.597789:0:198964:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788572446.597793:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788572446.597822:0:198964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.597826:0:198964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.597827:0:198964:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788572446.597829:0:198964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 46 count 46 00000020:01000000:3.0:1788572446.597925:0:198960:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788572446.597956:0:198960:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788572446.597973:0:198960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bec76 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.597984:0:198960:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bec76 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572446.597992:0:198960:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a40f51000 from 1 10000000:01000000:3.0:1788572446.597995:0:198960:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572446.598018:0:198960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.598026:0:198960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.598036:0:198960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.598055:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584418560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572446.598113:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.598143:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.598556:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584418560 00000100:00100000:0.0:1788572446.598563:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584418560 00000100:00100000:0.0:1788572446.598611:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788572446.598621:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:198960:x1875444584418560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572446.598635:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572446.598648:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bed09 expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.598675:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bed09 expref: 22 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.598685:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bed09 expref: 22 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.598694:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e400, rc 0) 00000100:00100000:0.0:1788572446.598740:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:198960:x1875444584418560:12345-0@lo:101:mount.lustre.0 Request processed in 120us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.598746:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788572446.598779:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584418432:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788572446.598812:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572446.599126:0:198969:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788572446.599141:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584418432 00000100:00100000:1.0:1788572446.599145:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584418432 00000100:00100000:1.0:1788572446.599179:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22692 00000100:00100000:1.0:1788572446.599185:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3640:x1875444584418432:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788572446.599210:0:43926:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9199 last 0 00000020:00000080:1.0:1788572446.599240:0:43926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bed17 00002000:00100000:1.0:1788572446.599253:0:43926:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8e5a0f312800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788572446.599256:0:43926:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788572446.599258:0:43926:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788572446.599326:0:43926:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788572446.599351:0:43926:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f310800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572446.599394:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584418432:12345-0@lo:8:llog_process_th.0 Request processed in 208us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.599400:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22692 00000100:00100000:1.0:1788572446.599449:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572446.599457:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788572446.599464:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788572446.599468:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788572446.599471:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5906750000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788572446.599558:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584418560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.599576:0:198960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.599586:0:198960:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.600129:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584418688:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788572446.600172:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.600206:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.600227:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584418688 00000100:00100000:3.0:1788572446.600231:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584418688 00000100:00100000:3.0:1788572446.600264:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788572446.600271:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:198960:x1875444584418688:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788572446.600286:0:196581:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788572446.600302:0:196581:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788572446.600306:0:196581:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788572446.600309:0:196581:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788572446.600311:0:196581:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788572446.600313:0:196581:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 339 00000100:00100000:3.0:1788572446.600390:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:198960:x1875444584418688:12345-0@lo:256:mount.lustre.0 Request processed in 119us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.600396:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788572446.600440:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584418688:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788572446.601087:0:198960:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572446.601108:0:198960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.601118:0:198960:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572446.601126:0:198960:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a40f51000 from 1 10000000:01000000:3.0:1788572446.601129:0:198960:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572446.601155:0:198960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.601162:0:198960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.601176:0:198960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.601191:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584418816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572446.601224:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.601249:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.601730:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584418816 00000100:00100000:0.0:1788572446.601738:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584418816 00000100:00100000:0.0:1788572446.601781:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788572446.601791:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:198960:x1875444584418816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572446.601803:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572446.601821:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a4117f400/0x265cfe11109bed25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bed1e expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.601852:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a4117f400/0x265cfe11109bed25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bed1e expref: 23 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.601873:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a4117f400/0x265cfe11109bed25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bed1e expref: 23 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.601882:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117f400, rc 0) 00000100:00100000:0.0:1788572446.601932:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584418816:12345-0@lo:101:mount.lustre.0 Request processed in 144us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.601938:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000004:00080000:0.0:1788572446.602786:0:198969:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 9199597304828ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788572446.602796:0:198969:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788572446.603126:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584418816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.603146:0:198960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed25 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.603157:0:198960:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bed25 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572446.603348:0:198960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 7 count 7 00000100:00100000:2.0:1788572446.604339:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572446.604359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584418944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572446.604424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.606599:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584418944 00000100:00100000:0.0:1788572446.606618:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584418944 00000004:00080000:1.0:1788572446.607283:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788572446.607302:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584418432:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788572446.607431:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6398 00000100:00100000:0.0:1788572446.607442:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905feed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584418944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572446.607473:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140352 pending 0 free 3923492864 avail 3691970560 00000100:00080000:2.0:1788572446.607626:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788572446.607813:0:198960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572446.608224:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905feed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584418944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 782us (3797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.608235:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6398 00000004:00080000:0.0:1788572446.608267:0:198971:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788572446.608329:0:198971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 9199602849209ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788572446.608336:0:198971:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788572446.608657:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584418944:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788572446.609272:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:3.0:1788572446.609314:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 112 off8528 00000040:00080000:3.0:1788572446.609333:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 224 off8752 00000040:00080000:3.0:1788572446.609350:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8976 00000040:00080000:3.0:1788572446.609365:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 112 off9088 00000040:00080000:3.0:1788572446.609386:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 224 off9312 00000040:00080000:3.0:1788572446.609392:0:198960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 6 count 7 00000100:00100000:3.0:1788572446.609534:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.609595:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.609646:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572446.609787:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584419072 00000100:00100000:1.0:1788572446.609795:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584419072 00000100:00100000:1.0:1788572446.609845:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788572446.609853:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584419072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572446.610119:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584419072:12345-0@lo:501:mount.lustre.0 Request processed in 266us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.610127:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000004:00080000:0.0:1788572446.610279:0:198961:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788572446.610785:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.610825:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572446.611028:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.611192:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.611344:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584419200 00000100:00100000:0.0:1788572446.611349:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584419200 00000100:00100000:0.0:1788572446.611422:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788572446.611432:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a12928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584419200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572446.611765:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a12928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584419200:12345-0@lo:503:mount.lustre.0 Request processed in 334us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.611772:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788572446.611844:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788572446.612305:0:198960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788572446.612380:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572446.612427:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.612913:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59050fe000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.613089:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584419328 00000100:00100000:3.0:1788572446.613096:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584419328 00000100:00100000:3.0:1788572446.613143:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788572446.613152:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1292b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584419328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572446.613256:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1292b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584419328:12345-0@lo:502:mount.lustre.0 Request processed in 104us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.613263:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788572446.613317:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36945f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572446.613570:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:3.0:1788572446.613598:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 112 off8528 00000040:00080000:3.0:1788572446.613613:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 224 off8752 00000040:00080000:3.0:1788572446.613626:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8976 00000040:00080000:3.0:1788572446.613638:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 112 off9088 00000100:00100000:3.0:1788572446.613664:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572446.613705:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.613728:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049ef780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.613741:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584419456 00000100:00100000:3.0:1788572446.613745:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584419456 00000100:00100000:3.0:1788572446.613765:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788572446.613771:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584419456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572446.613838:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584419456:12345-0@lo:502:mount.lustre.0 Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.613845:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788572446.613895:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572446.614124:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 224 off9312 00000040:00080000:3.0:1788572446.614132:0:198960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1788572446.614794:0:198973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.614804:0:198973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.614807:0:198973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788572446.614815:0:198973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a40f51000 00000020:00000080:3.0:1788572446.614818:0:198973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788572446.614825:0:198973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.614828:0:198973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.614829:0:198973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788572446.614832:0:198973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.614834:0:198973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.614835:0:198973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788572446.614839:0:198973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a40f51000 00000020:00000080:3.0:1788572446.614841:0:198973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788572446.615162:0:198973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.615167:0:198973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.615168:0:198973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788572446.615171:0:198973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 7 count 7 00000020:01000000:3.0:1788572446.615217:0:198960:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788572446.615241:0:198960:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572446.615256:0:198960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed25 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.615268:0:198960:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed25 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572446.615319:0:198960:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788572446.615322:0:198960:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5a40f51000 10000000:01000000:3.0:1788572446.615325:0:198960:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5a40f51000 10000000:01000000:3.0:1788572446.615328:0:198960:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788572446.615334:0:198960:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a40f51000 from 1 10000000:01000000:3.0:1788572446.615337:0:198960:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572446.615364:0:198960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.615373:0:198960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.615384:0:198960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.615403:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572446.615451:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.615509:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584419584 00000100:00100000:3.0:1788572446.615514:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584419584 00000100:00100000:3.0:1788572446.618716:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788572446.618732:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:198960:x1875444584419584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.618758:0:196581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572446.618786:0:196581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcec00/0x265cfe11109bed33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bed2c expref: -99 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.618819:0:196581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcec00/0x265cfe11109bed33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bed2c expref: 24 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.618833:0:196581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dcec00/0x265cfe11109bed33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bed2c expref: 24 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.618844:0:196581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcec00, rc 0) 00000100:00100000:3.0:1788572446.619099:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584419584:12345-0@lo:101:mount.lustre.0 Request processed in 370us (3647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.619106:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788572446.619167:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049ef9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.619193:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.619214:0:198960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed33 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.619226:0:198960:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bed33 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572446.619453:0:198960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 52 count 51 00000004:00080000:2.0:1788572446.621252:0:198961:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000040:00080000:3.0:1788572446.621844:0:198960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572446.622074:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:3.0:1788572446.622104:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 120 off8536 00000040:00080000:3.0:1788572446.622118:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 168 off8704 00000040:00080000:3.0:1788572446.622131:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8928 00000040:00080000:3.0:1788572446.622143:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9152 00000040:00080000:3.0:1788572446.622157:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 120 off9272 00000040:00080000:3.0:1788572446.622170:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 168 off9440 00000040:00080000:3.0:1788572446.622183:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9664 00000040:00080000:3.0:1788572446.622196:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 224 off9888 00000040:00080000:3.0:1788572446.622209:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 120 off10008 00000040:00080000:3.0:1788572446.622223:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10232 00000040:00080000:3.0:1788572446.622238:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 224 off10456 00000040:00080000:3.0:1788572446.622253:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 88 off10544 00000040:00080000:3.0:1788572446.622269:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].14, 128 off10672 00000040:00080000:3.0:1788572446.622284:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].15, 144 off10816 00000040:00080000:3.0:1788572446.622300:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].16, 160 off10976 00000040:00080000:3.0:1788572446.622314:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].17, 224 off11200 00000040:00080000:3.0:1788572446.622328:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].18, 224 off11424 00000040:00080000:3.0:1788572446.622343:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].19, 80 off11504 00000040:00080000:3.0:1788572446.622360:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].20, 224 off11728 00000040:00080000:3.0:1788572446.622374:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].21, 224 off11952 00000040:00080000:3.0:1788572446.622389:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].22, 88 off12040 00000040:00080000:3.0:1788572446.622402:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].23, 128 off12168 00000040:00080000:3.0:1788572446.622416:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].24, 144 off12312 00000040:00080000:3.0:1788572446.622430:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].25, 160 off12472 00000040:00080000:3.0:1788572446.622443:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].26, 224 off12696 00000040:00080000:3.0:1788572446.622456:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].27, 224 off12920 00000040:00080000:3.0:1788572446.622469:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].28, 80 off13000 00000040:00080000:3.0:1788572446.622529:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].29, 224 off13224 00000040:00080000:3.0:1788572446.622548:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].30, 224 off13448 00000040:00080000:3.0:1788572446.622564:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].31, 88 off13536 00000040:00080000:3.0:1788572446.622577:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].32, 128 off13664 00000040:00080000:3.0:1788572446.622591:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].33, 144 off13808 00000040:00080000:3.0:1788572446.622605:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].34, 128 off13936 00000040:00080000:3.0:1788572446.622620:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].35, 224 off14160 00000040:00080000:3.0:1788572446.622634:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].36, 224 off14384 00000040:00080000:3.0:1788572446.622647:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].37, 80 off14464 00000040:00080000:3.0:1788572446.622661:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].38, 224 off14688 00000040:00080000:3.0:1788572446.622675:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].39, 224 off14912 00000040:00080000:3.0:1788572446.622688:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].40, 88 off15000 00000040:00080000:3.0:1788572446.622703:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].41, 128 off15128 00000040:00080000:3.0:1788572446.622716:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].42, 144 off15272 00000040:00080000:3.0:1788572446.622728:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].43, 128 off15400 00000040:00080000:3.0:1788572446.622740:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].44, 224 off15624 00000040:00080000:3.0:1788572446.622753:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].45, 224 off15848 00000040:00080000:3.0:1788572446.622767:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].46, 80 off15928 00000040:00080000:3.0:1788572446.622780:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].47, 224 off16152 00000040:00080000:3.0:1788572446.622795:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].48, 232 off16384 00000040:00080000:3.0:1788572446.622925:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].49, 224 off16608 00000040:00080000:3.0:1788572446.622946:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].50, 120 off16728 00000040:00080000:3.0:1788572446.622965:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].51, 224 off16952 00000040:00080000:3.0:1788572446.622970:0:198960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 51 count 51 00000100:00100000:3.0:1788572446.623074:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.623147:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.623194:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572446.625217:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584419712 00000100:00100000:1.0:1788572446.625232:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584419712 00000100:00100000:1.0:1788572446.625289:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788572446.625300:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584419712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572446.625470:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584419712:12345-0@lo:501:mount.lustre.0 Request processed in 172us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.625493:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788572446.627143:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.627208:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572446.627275:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.627528:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584419840 00000100:00100000:2.0:1788572446.628271:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584419840 00000100:00100000:2.0:1788572446.628327:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788572446.628337:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584419840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572446.628459:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584419840:12345-0@lo:503:mount.lustre.0 Request processed in 123us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.628467:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788572446.630987:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.631033:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419840:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788572446.631713:0:198960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788572446.631799:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572446.631889:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.632006:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049ef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.636711:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584419968 00000100:00100000:0.0:1788572446.636726:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584419968 00000100:00100000:0.0:1788572446.636791:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788572446.636801:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584419968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572446.636988:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584419968:12345-0@lo:502:mount.lustre.0 Request processed in 188us (5098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.636997:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788572446.637128:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584419968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572446.637363:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:3.0:1788572446.637395:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 120 off8536 00000040:00080000:3.0:1788572446.637409:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 168 off8704 00000040:00080000:3.0:1788572446.637420:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8928 00000040:00080000:3.0:1788572446.637433:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9152 00000040:00080000:3.0:1788572446.637446:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 120 off9272 00000040:00080000:3.0:1788572446.637458:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 168 off9440 00000040:00080000:3.0:1788572446.637474:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9664 00000040:00080000:3.0:1788572446.637536:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 224 off9888 00000040:00080000:3.0:1788572446.637551:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 120 off10008 00000040:00080000:3.0:1788572446.637565:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10232 00000040:00080000:3.0:1788572446.637579:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 224 off10456 00000040:00080000:3.0:1788572446.637593:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 88 off10544 00000040:00080000:3.0:1788572446.637608:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].14, 128 off10672 00000040:00080000:3.0:1788572446.637622:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].15, 144 off10816 00000040:00080000:3.0:1788572446.637635:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].16, 160 off10976 00000040:00080000:3.0:1788572446.637647:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].17, 224 off11200 00000040:00080000:3.0:1788572446.637660:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].18, 224 off11424 00000040:00080000:3.0:1788572446.637674:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].19, 80 off11504 00000040:00080000:3.0:1788572446.637686:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].20, 224 off11728 00000040:00080000:3.0:1788572446.637699:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].21, 224 off11952 00000040:00080000:3.0:1788572446.637711:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].22, 88 off12040 00000040:00080000:3.0:1788572446.637724:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].23, 128 off12168 00000040:00080000:3.0:1788572446.637737:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].24, 144 off12312 00000040:00080000:3.0:1788572446.637749:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].25, 160 off12472 00000040:00080000:3.0:1788572446.637763:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].26, 224 off12696 00000040:00080000:3.0:1788572446.637775:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].27, 224 off12920 00000040:00080000:3.0:1788572446.637788:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].28, 80 off13000 00000040:00080000:3.0:1788572446.637801:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].29, 224 off13224 00000040:00080000:3.0:1788572446.637815:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].30, 224 off13448 00000040:00080000:3.0:1788572446.637829:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].31, 88 off13536 00000040:00080000:3.0:1788572446.637843:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].32, 128 off13664 00000040:00080000:3.0:1788572446.637857:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].33, 144 off13808 00000040:00080000:3.0:1788572446.637884:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].34, 128 off13936 00000040:00080000:3.0:1788572446.637900:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].35, 224 off14160 00000040:00080000:3.0:1788572446.637915:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].36, 224 off14384 00000040:00080000:3.0:1788572446.637928:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].37, 80 off14464 00000040:00080000:3.0:1788572446.637940:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].38, 224 off14688 00000040:00080000:3.0:1788572446.637953:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].39, 224 off14912 00000040:00080000:3.0:1788572446.637966:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].40, 88 off15000 00000040:00080000:3.0:1788572446.637981:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].41, 128 off15128 00000040:00080000:3.0:1788572446.637998:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].42, 144 off15272 00000040:00080000:3.0:1788572446.638013:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].43, 128 off15400 00000040:00080000:3.0:1788572446.638026:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].44, 224 off15624 00000040:00080000:3.0:1788572446.638037:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].45, 224 off15848 00000040:00080000:3.0:1788572446.638048:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].46, 80 off15928 00000040:00080000:3.0:1788572446.638058:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].47, 224 off16152 00000040:00080000:3.0:1788572446.638069:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].48, 232 off16384 00000100:00100000:3.0:1788572446.638111:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584420096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572446.638172:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.638212:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049ef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.638380:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584420096 00000100:00100000:0.0:1788572446.638387:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584420096 00000100:00100000:0.0:1788572446.638421:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788572446.638428:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584420096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572446.639777:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584420096:12345-0@lo:502:mount.lustre.0 Request processed in 1342us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.639790:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788572446.640068:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584420096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788572446.640270:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].49, 224 off16608 00000040:00080000:2.0:1788572446.640298:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].50, 120 off16728 00000100:00100000:2.0:1788572446.640332:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584420224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572446.640382:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.640426:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c5370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.640720:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584420224 00000100:00100000:0.0:1788572446.640726:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584420224 00000100:00100000:0.0:1788572446.640767:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788572446.640776:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584420224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572446.640892:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584420224:12345-0@lo:502:mount.lustre.0 Request processed in 117us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.640899:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788572446.641010:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584420224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788572446.641056:0:198960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].51, 224 off16952 00000040:00080000:2.0:1788572446.641065:0:198960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788572446.643077:0:198976:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788572446.643093:0:198976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8e590415b380) 00000020:00000080:2.0:1788572446.643119:0:198976:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788572446.643195:0:198976:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a40f51000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788572446.643199:0:198976:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a40f51000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788572446.643201:0:198976:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a40f51000 3 00010000:00080000:2.0:1788572446.643229:0:198976:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e59019da800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.157@tcp at head 00010000:00010000:2.0:1788572446.645059:0:198976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:2.0:1788572446.645280:0:198976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788572446.645321:0:198976:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788572446.645336:0:198976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x265cfe11109bed41 00000100:00080000:2.0:1788572446.645350:0:198976:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788572446.645357:0:198976:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572446.645396:0:198976:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905fed500 x1875444584420352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572446.645444:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584420352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788572446.645557:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572446.645610:0:198976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788572446.652042:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584420352 00000100:00100000:3.0:1788572446.652055:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584420352 00000100:00100000:3.0:1788572446.652108:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:3.0:1788572446.652117:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584420352:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788572446.652150:0:188049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 9199 last 0 00000020:00000080:3.0:1788572446.652191:0:188049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x265cfe11109bed48 00000004:00100000:3.0:1788572446.652209:0:188049:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572446.652244:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e5a08d27000 : changing import state from RECOVER to FULL 00010000:00000080:3.0:1788572446.652267:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905feea00 x1875444584420352/t0(0) o38->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788572466 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572446.652348:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875444584420352:12345-0@lo:38:llog_process_th.0 Request processed in 231us (6791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.652355:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:3.0:1788572446.652408:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572446.652418:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 81 00000100:00080000:3.0:1788572446.652426:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788572446.652431:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788572446.652433:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788572446.652439:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584420352:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788572446.654774:0:198976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 52 count 51 00000020:01000000:3.0:1788572446.655307:0:198960:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788572446.655345:0:198960:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788572446.655650:0:198960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed33 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.655668:0:198960:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed33 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788572446.655723:0:198960:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788572446.655725:0:198960:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788572446.655726:0:198960:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572446.655727:0:198960:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572446.655729:0:198960:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572446.655730:0:198960:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572446.655731:0:198960:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788572446.655733:0:198960:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572446.655734:0:198960:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572446.655738:0:198960:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788572446.655740:0:198960:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788572446.655741:0:198960:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788572446.655742:0:198960:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572446.655743:0:198960:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572446.655744:0:198960:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572446.655745:0:198960:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572446.655746:0:198960:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788572446.655747:0:198960:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572446.655748:0:198960:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572446.655773:0:198960:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788572446.655792:0:198960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24615f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584420480:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788572446.657017:0:198960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.657137:0:198960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049ef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572446.668267:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584420480 00000100:00100000:1.0:1788572446.668280:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584420480 00000100:00100000:0.0:1788572446.668393:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788572446.668404:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584420480:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788572446.668441:0:196582:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788572446.668456:0:196582:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788572446.669329:0:196576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788572446.669376:0:196582:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788572446.669392:0:196582:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788572446.669612:0:196584:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572446.669618:0:196584:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572446.669638:0:196584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.669655:0:196584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109be101 expref: 24 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.669666:0:196584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ac expref: 9 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.669674:0:196584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bed09 expref: 24 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.669681:0:196584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.669715:0:196584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bed09 expref: 24 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.669728:0:196584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109bed09 expref: 24 pid: 196587 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572446.669742:0:196584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584420608:0@lo:104: 00000100:00100000:2.0:1788572446.669785:0:196584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572446.669834:0:196584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ac expref: 9 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.669843:0:196584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ac expref: 9 pid: 196582 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572446.669852:0:196584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584420736:192.168.202.57@tcp:104: 00000100:00100000:1.0:1788572446.670150:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:198960:x1875444584420480:12345-0@lo:253:mount.lustre.0 Request processed in 1746us (14288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.670161:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788572446.670274:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584420608 00000100:00100000:3.0:1788572446.670281:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584420608 00000100:00100000:3.0:1788572446.670319:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5401 00000100:00100000:3.0:1788572446.670327:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:196584:x1875444584420608:12345-0@lo:104: 00010000:00010000:3.0:1788572446.670340:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.670385:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572446.670391:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:196584:x1875444584420608:12345-0@lo:104: Request processed in 65us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.670398:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5401 00010000:00010000:3.0:1788572446.670419:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572446.670425:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.670432:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce200 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572446.670436:0:10396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.670444:0:10396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572446.670451:0:10396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572446.670457:0:10396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572446.670506:0:10396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.670513:0:10396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788572446.670653:0:198960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24615f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:198960:1875444584420480:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572446.670664:0:198960:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788572446.670667:0:198960:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572446.670669:0:198960:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788572446.670670:0:198960:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572446.670671:0:198960:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572446.670673:0:198960:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572446.670674:0:198960:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572446.670675:0:198960:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572446.670677:0:198960:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572446.670678:0:198960:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788572446.670691:0:198960:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788572446.671097:0:196584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109be101 expref: 23 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.671109:0:196584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109be101 expref: 23 pid: 196581 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572446.671119:0:196584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584420992:0@lo:104: 00000100:00100000:2.0:1788572446.671150:0:196584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.671169:0:196584:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590c5370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572446.671181:0:196584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584420608:0@lo:104: 00000100:00100000:2.0:1788572446.671197:0:13337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584420992 00000100:00100000:2.0:1788572446.671200:0:13337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584420992 00000100:00100000:2.0:1788572446.671226:0:13337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5402 00000100:00100000:2.0:1788572446.671234:0:13337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:196584:x1875444584420992:12345-0@lo:104: 00010000:00010000:2.0:1788572446.671244:0:13337:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.671281:0:13337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572446.671287:0:13337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:196584:x1875444584420992:12345-0@lo:104: Request processed in 54us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.671293:0:13337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5402 00000100:00100000:2.0:1788572446.671315:0:196584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584420992:0@lo:104: 00010000:00010000:2.0:1788572446.671324:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572446.671329:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.671337:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfe00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572446.671341:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.671349:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.671360:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.671366:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.671382:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.671388:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572446.671405:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.671413:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfe00/0x265cfe11109be101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109be108 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.671424:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572446.671426:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572446.671428:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572446.671437:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584421120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572446.671464:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572446.671848:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.671856:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bed10 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.671885:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572446.671886:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572446.671888:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572446.671989:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572446.672000:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584420864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572446.672030:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.672065:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584421120 00000100:00100000:1.0:1788572446.672070:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584421120 00010000:00010000:1.0:1788572446.672092:0:152004:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109be101 expref: 24 pid: 196581 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572446.672113:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584420864 00000100:00100000:1.0:1788572446.672116:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584420864 00010000:00010000:1.0:1788572446.672126:0:152004:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bed09 expref: 25 pid: 196587 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572446.672142:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12907 00000100:00100000:1.0:1788572446.672149:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+25:3641:x1875444584421120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572446.672161:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572446.672166:0:152004:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109be101 expref: 25 pid: 196581 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.672175:0:152004:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109be101 expref: 25 pid: 196581 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.672188:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5200/0x265cfe11109be108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109be101 expref: 25 pid: 196581 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.672200:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572446.672227:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584421120:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.672232:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12907 00000100:00100000:1.0:1788572446.672246:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12908 00000100:00100000:1.0:1788572446.672252:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3641:x1875444584420864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572446.672259:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572446.672263:0:152004:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bed09 expref: 23 pid: 196587 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.672272:0:152004:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109bed09 expref: 23 pid: 196587 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.672282:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a4117e400/0x265cfe11109bed10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bed09 expref: 23 pid: 196587 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.672289:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572446.672307:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3641:x1875444584420864:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.672312:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12908 00000100:00100000:1.0:1788572446.672334:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584420864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572446.672342:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584421120:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788572446.676794:0:198960:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 17179873001 00000040:01000000:3.0:1788572446.677161:0:198960:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788572446.677694:0:198982:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000020:00080000:1.0:1788572446.677870:0:198981:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 17179873001 00000020:00080000:1.0:1788572446.677875:0:198981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000040:00080000:3.0:1788572446.679761:0:198982:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000400:0x1:0x0] first idx 3, last_idx 4 00000040:00080000:3.0:1788572446.679858:0:198982:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788572446.679873:0:198982:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x24000272a:0x1:0x0] at index 4 of catalog [0x240000400:0x1:0x0] 00000004:00080000:3.0:1788572446.680027:0:198982:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x24000272a:0x1:0x0].3 00000020:00080000:3.0:1788572446.680032:0:198982:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179873002 transno = 0 mdt_index 1 00000040:00080000:3.0:1788572446.680045:0:198982:0:(llog.c:862:llog_process_thread()) stop processing plain [0x24000272a:0x1:0x0] index 4 count 2 00000040:00080000:3.0:1788572446.680060:0:198982:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 5 count 2 00000004:00080000:3.0:1788572446.680111:0:198982:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1788572446.680283:0:198960:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788572446.680817:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421248:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.680896:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.681030:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1600 going to sleep for 11 seconds 00000040:01000000:3.0:1788572446.681184:0:198960:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788572446.681219:0:198960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788572446.681693:0:198960:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788572446.681701:0:198960:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788572446.681735:0:198960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572446.683116:0:198960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788572446.683851:0:198960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788572446.683903:0:198960:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788572446.684075:0:198960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788572446.684613:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584421248 00000100:00100000:1.0:1788572446.684623:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584421248 00080000:10000000:3.0:1788572446.685021:0:198960:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x33:0x0] (8/32) registered 00010000:00080000:3.0:1788572446.687016:0:198960:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 21474837549 00000100:00100000:0.0:1788572446.687371:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1788572446.687383:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421248:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.687629:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36eac380 x1875444584421248/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 304/4320 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.687712:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421248:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 332us (6815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.687720:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1788572446.687828:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421248:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788572446.687878:0:198983:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788572446.687934:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788572446.687982:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.688014:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59050fe300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.688123:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584421376 00000100:00100000:0.0:1788572446.688129:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584421376 00000100:00100000:0.0:1788572446.688164:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1788572446.688171:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421376:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.688254:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31c7c380 x1875444584421376/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 336/4320 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.688278:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 108us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.688283:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1788572446.688306:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.688359:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:198983:1875444584421504:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.688385:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.688409:0:188060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584421504 00000100:00100000:0.0:1788572446.688412:0:188060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584421504 00000100:00100000:0.0:1788572446.688599:0:188060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788572446.688608:0:188060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198983:x1875444584421504:12345-0@lo:900:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.688624:0:188060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36eac700 x1875444584421504/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:107/0 lens 264/248 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.688652:0:188060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198983:x1875444584421504:12345-0@lo:900:lod0001_rec0000.0 Request processed in 46us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.688658:0:188060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788572446.688678:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.688693:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:198983:1875444584421504:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.688731:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.688754:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.688774:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584421632 00000100:00100000:0.0:1788572446.688778:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584421632 00000100:00100000:0.0:1788572446.688799:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1788572446.688805:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421632:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.688833:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ea8700 x1875444584421632/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 304/4320 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.688871:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 56us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.688878:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1788572446.688896:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1180 going to sleep for 11 seconds 00010000:00080000:3.0:1788572446.689598:0:198984:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 198984 00010000:02000000:3.0:1788572446.689609:0:198984:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1788572446.689659:0:198960:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788572446.689693:0:198960:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.157@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788572446.689714:0:198960:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788572446.689736:0:198960:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:0.0:1788572446.690004:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.690098:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421760:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.690177:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.690213:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584421760 00000100:00100000:0.0:1788572446.690218:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584421760 00000100:00100000:0.0:1788572446.690255:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1788572446.690263:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421760:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788572446.693253:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1840 going to sleep for 11 seconds 00010000:00000080:0.0:1788572446.695112:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a9e680 x1875444584421760/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 336/33016 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.695177:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421760:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4914us (4999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.695188:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1788572446.695653:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421760:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788572446.695702:0:198983:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 8 00000100:00100000:1.0:1788572446.695819:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421888:0@lo:1000:lod0001_rec0000.0 00000020:00000004:3.0:1788572446.696789:0:198960:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:1.0:1788572446.697020:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000004:3.0:1788572446.697386:0:198960:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788572446.697889:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584421888 00000100:00100000:0.0:1788572446.697900:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584421888 00000100:00100000:0.0:1788572446.697968:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1788572446.697979:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421888:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.698157:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a804000 x1875444584421888/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 336/33016 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.698209:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584421888:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 232us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.698217:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1788572446.698249:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59050fe300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.698274:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584421888:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788572446.698322:0:198983:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 8 synced_idx: 0 lgh_last_idx: 8 00000040:00080000:0.0:1788572446.698328:0:198983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200027502:0x1:0x0] at index 7 of catalog [0x200000401:0x1:0x0] 00000100:00100000:0.0:1788572446.698397:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422016:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.700928:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.700980:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584422016 00000100:00100000:0.0:1788572446.700988:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584422016 00000100:00100000:0.0:1788572446.701040:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1788572446.701050:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422016:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.701116:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a9c700 x1875444584422016/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 304/4320 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.701160:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422016:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 112us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.701167:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1788572446.701196:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.701220:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422016:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.701321:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422144:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.701382:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.701401:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584422144 00000100:00100000:0.0:1788572446.701405:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584422144 00000100:00100000:0.0:1788572446.701427:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1788572446.701434:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422144:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.701613:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a9e300 x1875444584422144/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 336/33016 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.701647:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422144:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 214us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.701653:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1788572446.701673:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.701686:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422144:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.701754:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.701806:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.701825:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584422272 00000100:00100000:0.0:1788572446.701828:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584422272 00000100:00100000:0.0:1788572446.701849:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1788572446.701855:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422272:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.701957:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a9c380 x1875444584422272/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 336/33016 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.701988:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422272:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.701994:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1788572446.702012:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.702025:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.702083:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422400:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.702121:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.702140:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584422400 00000100:00100000:0.0:1788572446.702143:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584422400 00000100:00100000:0.0:1788572446.702163:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1788572446.702170:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422400:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.702250:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a9d180 x1875444584422400/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 336/33016 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.702280:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422400:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 112us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.702286:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1788572446.702304:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.702315:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422400:0@lo:1000:lod0001_rec0000.0 00000004:00080000:0.0:1788572446.702340:0:198983:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200027502:0x1:0x0].3 00000020:00080000:0.0:1788572446.702345:0:198983:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179873002 transno = 21474837549 mdt_index 0 00000040:00080000:0.0:1788572446.702352:0:198983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x200027502:0x1:0x0] index 4 count 2 00000100:00100000:0.0:1788572446.702392:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422528:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.702437:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.702455:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584422528 00000100:00100000:0.0:1788572446.702459:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584422528 00000100:00100000:0.0:1788572446.702502:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1788572446.702509:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422528:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.702575:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36eac000 x1875444584422528/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 336/33016 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.702603:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422528:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 95us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.702610:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1788572446.702627:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.702640:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422528:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788572446.702663:0:198983:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1788572446.702668:0:198983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200027502:0x2:0x0] at index 8 of catalog [0x200000401:0x1:0x0] 00000100:00100000:0.0:1788572446.702716:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422656:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.702742:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.702761:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584422656 00000100:00100000:0.0:1788572446.702764:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584422656 00000100:00100000:0.0:1788572446.702784:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1788572446.702789:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422656:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.702815:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a2d1500 x1875444584422656/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 304/4320 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.702842:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422656:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.702848:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1788572446.702879:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.702891:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422656:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788572446.702921:0:198983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572446.703037:0:198983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422784:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572446.703060:0:198983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.703078:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584422784 00000100:00100000:0.0:1788572446.703081:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584422784 00000100:00100000:0.0:1788572446.703099:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1788572446.703105:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422784:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1788572446.703137:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a2d1880 x1875444584422784/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 304/4320 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.703167:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198983:x1875444584422784:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 62us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.703173:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1788572446.703190:0:198983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.703202:0:198983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198983:1875444584422784:0@lo:1000:lod0001_rec0000.0 00000004:00080000:0.0:1788572446.703235:0:198983:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a081d1b40 with version 1 00000004:00080000:0.0:1788572446.703248:0:198967:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e59050fe900 version 1 rpc_version 1 00000020:00100000:0.0:1788572446.703261:0:198967:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572446.703266:0:198967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e590a2d0380 x1875444584423040/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572446.703277:0:198967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584423040:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572446.703300:0:198967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.703314:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.703327:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584423040 00000100:00100000:0.0:1788572446.703330:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584423040 00000100:00100000:0.0:1788572446.703348:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1788572446.703354:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198967:x1875444584423040:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:0.0:1788572446.703529:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905a9ce00 x1875444584423040/t347892350997(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 416/4320 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.703564:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:198967:x1875444584423040:12345-0@lo:1000:osp_up0-1.0 Request processed in 210us (263us total) trans 347892350997 rc 0/0 00000100:00100000:0.0:1788572446.703572:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1788572446.703605:0:198967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584423040:0@lo:1000:osp_up0-1.0 00000040:00080000:0.0:1788572446.703626:0:198983:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 8 00000004:00080000:0.0:1788572446.703638:0:198983:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a081d1600 with version 2 00000040:00080000:0.0:1788572446.703644:0:198983:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200027502:0x2:0x0] at index 8 of catalog [0x200000401:0x1:0x0] 00000040:00080000:0.0:1788572446.703659:0:198983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 9 count 2 00000004:00080000:0.0:1788572446.703713:0:198983:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788572446.703716:0:198983:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00080000:0.0:1788572446.703745:0:198967:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e59050fe900 version 2 rpc_version 2 00000020:00100000:0.0:1788572446.703758:0:198967:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572446.703764:0:198967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a4143b480 x1875444584423296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572446.703776:0:198967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584423296:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572446.703804:0:198967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.703818:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a081d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.703830:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584423296 00000100:00100000:0.0:1788572446.703833:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584423296 00000100:00100000:0.0:1788572446.703854:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1788572446.716686:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a71450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:198967:x1875444584423296:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:0.0:1788572446.716855:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36a71450 x1875444584423296/t347892350998(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 744/4320 e 0 to 0 dl 1788572457 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572446.716963:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a71450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:198967:x1875444584423296:12345-0@lo:1000:osp_up0-1.0 Request processed in 13102us (13157us total) trans 347892350998 rc 0/0 00000100:00100000:0.0:1788572446.716973:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1788572446.717339:0:198967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584423296:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572446.717870:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572446.720593:0:196584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196584:1875444584420736:192.168.202.57@tcp:104: 00010000:00010000:0.0:1788572446.720631:0:196584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572446.720676:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569540352 00000100:00100000:0.0:1788572446.720683:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569540352 00010000:00010000:0.0:1788572446.720718:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ac expref: 10 pid: 196582 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572446.720760:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12909 00000100:00100000:0.0:1788572446.720770:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24614380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569540352:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572446.720785:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572446.720791:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ac expref: 10 pid: 196582 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720802:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ac expref: 10 pid: 196582 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720821:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1616ea00/0x265cfe11109be1c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3ac expref: 10 pid: 196582 timeout: 9299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720837:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720846:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788572446.720872:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.051254844s 00010000:00010000:0.0:1788572446.720878:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720885:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720893:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720905:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720911:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572446.720916:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720924:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720941:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.720951:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572446.721006:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24614380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79285ed-4685-45a8-8731-5e2522a143f3+9:2397:x1875444569540352:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 237us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.721013:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12909 00010000:00010000:0.0:1788572446.721058:0:196584:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.721064:0:196584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.721070:0:196584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5904a7b400/0x265cfe11109bed4f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572446.729450:0:198984:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788572446.729459:0:198984:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788572447.364433:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572447.614750:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584423424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572447.614818:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.614881:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584423424 00000100:00100000:2.0:1788572447.614889:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584423424 00000100:00100000:2.0:1788572447.614933:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6399 00000100:00100000:2.0:1788572447.614941:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584423424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572447.614965:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140352 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572447.615005:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584423424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.615013:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6399 00000100:00100000:2.0:1788572447.615058:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584423424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572447.615256:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572447.615265:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584423552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572447.615294:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572447.615344:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584423552 00000100:00100000:0.0:1788572447.615349:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584423552 00000100:00100000:0.0:1788572447.615385:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6400 00000100:00100000:0.0:1788572447.615392:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584423552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572447.615404:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572447.617680:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584423552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2280us (2377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572447.617694:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6400 00000100:00100000:1.0:1788572447.623366:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584423552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572447.797645:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572447.797734:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569540480 00000100:00100000:3.0:1788572447.797746:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569540480 00000100:00100000:3.0:1788572447.797959:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 126 00000100:00100000:3.0:1788572447.797970:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0efe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569540480:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572447.797988:0:196587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572447.798009:0:196587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dce800/0x265cfe11109bed56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb4fc expref: -99 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.798039:0:196587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dce800/0x265cfe11109bed56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4fc expref: 10 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.798053:0:196587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dce800/0x265cfe11109bed56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4fc expref: 10 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.798183:0:196587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce800, rc 0) 00000100:00100000:3.0:1788572447.798246:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0efe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569540480:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 277us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.798253:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 126 00000100:00100000:1.0:1788572447.800917:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572447.802886:0:196583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569540608 00000100:00100000:2.0:1788572447.802902:0:196583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569540608 00000100:00100000:2.0:1788572447.802970:0:196583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 127 00000100:00100000:2.0:1788572447.802982:0:196583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0efeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569540608:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788572447.803014:0:196583:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788572447.803032:0:196583:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788572447.803035:0:196583:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 340 00000100:00100000:2.0:1788572447.804978:0:196583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0efeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569540608:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 Request processed in 1988us (4060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.804992:0:196583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 127 00000100:00100000:3.0:1788572447.808600:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572447.808806:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569540736 00000100:00100000:2.0:1788572447.808815:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569540736 00000100:00100000:2.0:1788572447.808864:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1205 00000100:00100000:2.0:1788572447.808882:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569540736:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1788572447.808911:0:188048:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '02515dca-bbf0-45e0-bd6e-e76f0c89bd0b' at ffff8e5a1d702000, cookie 0x265cfe11109becb5 00010000:00080000:2.0:1788572447.808917:0:188048:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp recovering/t21474837549 exp ffff8e5a1d702000 cur 9200 last 1788572446 00010000:02000400:2.0:1788572447.808926:0:188048:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788572447.808932:0:188048:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 85 seconds 00000004:00100000:2.0:1788572447.808951:0:188048:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788572447.809082:0:188048:0:(import.c:65:import_set_state_nolock()) ffff8e5904e01000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572447.809153:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569540736:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 Request processed in 270us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.809164:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1205 00000100:00100000:1.0:1788572447.815023:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572447.817114:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569540864 00000100:00100000:2.0:1788572447.817129:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569540864 00000100:00100000:2.0:1788572447.817206:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 445 00000100:00100000:2.0:1788572447.817217:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569540864:12345-192.168.202.57@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788572447.817243:0:188833:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e590a807100 x1875444569540864/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:122/0 lens 224/0 e 0 to 0 dl 1788572472 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572447.817264:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569540864:12345-192.168.202.57@tcp:400:ldlm_lock_repla.0 Request processed in 51us (2253us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572447.817271:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 445 00010000:00080000:1.0:1788572447.817769:0:198984:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788572448.120438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572448.120504:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572448.120668:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569541120 00000100:00100000:3.0:1788572448.120680:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569541120 00000100:00100000:3.0:1788572448.120740:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 446 00000100:00100000:3.0:1788572448.120750:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569541120:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572448.120779:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41438a80 x1875444569541120/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:109/0 lens 224/224 e 0 to 0 dl 1788572459 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572448.120839:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569541120:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 91us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572448.120847:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 446 00000100:00080000:3.0:1788572448.120881:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572448.121193:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569540992 00000100:00100000:1.0:1788572448.121198:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569540992 00000100:00100000:1.0:1788572448.121231:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 128 00000100:00100000:1.0:1788572448.121238:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569540992:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572448.121266:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569540992:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 28us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572448.121272:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 128 00010000:00010000:1.0:1788572448.383168:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788572448.637649:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572448.637658:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a40f51000 from 340 10000000:01000000:3.0:1788572448.637664:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572448.637715:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572448.637728:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572448.637739:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572448.637765:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584423680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572448.637837:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572448.637893:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a410c5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572448.638146:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584423680 00000100:00100000:1.0:1788572448.638154:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584423680 00000100:00100000:1.0:1788572448.638209:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788572448.638218:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584423680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572448.638232:0:196582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572448.638245:0:196582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254000/0x265cfe11109bed64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bed5d expref: -99 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572448.638273:0:196582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254000/0x265cfe11109bed64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bed5d expref: 23 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572448.638284:0:196582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254000/0x265cfe11109bed64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bed5d expref: 23 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572448.638293:0:196582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254000, rc 0) 00000100:00100000:1.0:1788572448.638347:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584423680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572448.638353:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788572448.638616:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584423680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572448.638631:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed64 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572448.638641:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bed64 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572448.638694:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584423808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788572448.638726:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572448.638747:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a410c5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572448.638799:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584423808 00000100:00100000:1.0:1788572448.638804:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584423808 00000100:00100000:1.0:1788572448.638834:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788572448.638843:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584423808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788572448.638859:0:196581:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788572448.638889:0:196581:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788572448.638892:0:196581:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 340 00000100:00100000:1.0:1788572448.639212:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584423808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 370us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572448.639220:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788572448.639293:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584423808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788572448.639345:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572448.639353:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed64 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572448.639363:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed64 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572448.639372:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572448.639375:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a0f05c800 from 340 10000000:01000000:3.0:1788572448.639378:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572448.639398:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572448.639405:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572448.639414:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572448.639428:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584423936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572448.639454:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572448.639517:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a410c5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572448.639706:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584423936 00000100:00100000:1.0:1788572448.639711:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584423936 00000100:00100000:1.0:1788572448.639744:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788572448.639752:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584423936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572448.639761:0:196582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572448.639772:0:196582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11255800/0x265cfe11109bed72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bed6b expref: -99 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572448.639795:0:196582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11255800/0x265cfe11109bed72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bed6b expref: 24 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572448.639804:0:196582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11255800/0x265cfe11109bed72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bed6b expref: 24 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572448.639813:0:196582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255800, rc 0) 00000100:00100000:1.0:1788572448.639846:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584423936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572448.639852:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788572448.640667:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584423936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572448.640685:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572448.640696:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572448.640749:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584424064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788572448.640791:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572448.640822:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a410c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572448.641227:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584424064 00000100:00100000:0.0:1788572448.641234:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584424064 00000100:00100000:0.0:1788572448.641274:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788572448.641284:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584424064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788572448.641300:0:196587:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788572448.641319:0:196587:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788572448.641322:0:196587:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 340 00000100:00100000:0.0:1788572448.641409:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584424064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572448.641416:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788572448.641689:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584424064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788572448.641742:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572448.641750:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572448.641759:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572449.413348:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572450.431087:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572451.052060:0:199226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788572451.456387:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572451.710635:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572451.710641:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572451.710645:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572451.710656:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572451.710676:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24617480 x1875444584424448/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572451.710711:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572451.710715:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572451.710716:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572451.710720:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572451.710730:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24615f80 x1875444584424704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572451.710738:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572451.710741:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572451.710743:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572451.710746:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e59059d0800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572451.710755:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a24616a00 x1875444584424832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572451.710812:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584424448:0@lo:38:kworker.0 00000100:00100000:3.0:1788572451.710872:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.710912:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584424704:0@lo:38:kworker.0 00000100:00100000:3.0:1788572451.710931:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.710944:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584424832:0@lo:38:kworker.0 00000100:00100000:3.0:1788572451.710989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.711017:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584424576:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.711037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.711052:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584425344:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.711072:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.711086:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572451.711090:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584424960:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.711108:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.711122:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584425472:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.711137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.711161:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584424448 00000100:00100000:3.0:1788572451.711168:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584424448 00000100:00100000:3.0:1788572451.711196:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584424704 00000100:00100000:3.0:1788572451.711198:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584424704 00000100:00100000:3.0:1788572451.711208:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584424576 00000100:00100000:3.0:1788572451.711209:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584424576 00000100:00100000:3.0:1788572451.711239:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1788572451.711247:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584424576:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572451.711267:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ff84380 x1875444584424576/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:112/0 lens 224/224 e 0 to 0 dl 1788572462 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572451.711300:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584424576:12345-0@lo:400:kworker.0 Request processed in 53us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.711306:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1788572451.711322:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1788572451.711326:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584424448:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788572451.711346:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9204 last 0 00000020:00000080:3.0:1788572451.711380:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x265cfe11109bed79 00000004:00100000:3.0:1788572451.711393:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572451.711539:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e590b9aa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572451.711573:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875444584424448:12345-0@lo:38:kworker.0 Request processed in 245us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.711579:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1788572451.711591:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1788572451.711595:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584424704:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788572451.711606:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9204 last 0 00000020:00000080:3.0:1788572451.711625:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x265cfe11109bed80 00000004:00100000:3.0:1788572451.711631:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572451.711644:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e590b9ad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572451.711665:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875444584424704:12345-0@lo:38:kworker.0 Request processed in 69us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.711671:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1788572451.711691:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584424832 00000100:00100000:3.0:1788572451.711694:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584424832 00000100:00100000:3.0:1788572451.711710:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584425344 00000100:00100000:3.0:1788572451.711712:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584425344 00000100:00100000:3.0:1788572451.711725:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1788572451.711729:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584424832:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788572451.711740:0:189111:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8e5a1d702800, cookie 0x265cfe11109becae 00010000:00080000:3.0:1788572451.711744:0:189111:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8e5a1d702800 cur 9204 last 1788572446 00000004:00100000:3.0:1788572451.711752:0:189111:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572451.711763:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e590b9ac000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572451.711789:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584424832:12345-0@lo:38:kworker.0 Request processed in 59us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.711794:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1788572451.711804:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1788572451.711809:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584425344:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572451.711823:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cdc000 x1875444584425344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:112/0 lens 224/224 e 0 to 0 dl 1788572462 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572451.711843:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584425344:12345-0@lo:400:kworker.0 Request processed in 34us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.711848:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1788572451.711866:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584424960 00000100:00100000:3.0:1788572451.711869:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584424960 00000100:00100000:3.0:1788572451.711909:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584425472 00000100:00100000:3.0:1788572451.711913:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584425472 00000100:00100000:3.0:1788572451.711941:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7822 00000100:00100000:3.0:1788572451.711947:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584424960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.711981:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584424960:12345-0@lo:400:kworker.0 Request processed in 33us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.711983:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584424320:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.711992:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7822 00000100:00100000:3.0:1788572451.712006:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7823 00000100:00100000:3.0:1788572451.712014:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584425472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.712030:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.712290:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584424192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.712901:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584425472:12345-0@lo:400:kworker.0 Request processed in 877us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.712910:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7823 00000100:00100000:3.0:1788572451.712947:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584424320 00000100:00100000:3.0:1788572451.712952:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584424320 00000100:00100000:3.0:1788572451.712995:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1788572451.713004:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584424320:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572451.713020:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa9f80 x1875444584424320/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:112/0 lens 224/224 e 0 to 0 dl 1788572462 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572451.713064:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584424320:12345-0@lo:400:kworker.0 Request processed in 63us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.713070:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00080000:3.0:1788572451.713091:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572451.713096:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572451.713147:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584424960:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.713163:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584425472:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.713175:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584424576:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.713188:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584425344:0@lo:400:kworker.0 00010000:00080000:3.0:1788572451.713229:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a24617480 x1875444584424448/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.713243:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 6 00000100:00080000:3.0:1788572451.714068:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff8e5a24617480 x1875444584424448/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572461 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.714079:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788572451.714084:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788572451.714089:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788572451.714096:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584424448:0@lo:38:kworker.0 00010000:00080000:3.0:1788572451.714120:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a24615f80 x1875444584424704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.714131:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 6 00010000:00080000:0.0:1788572451.714209:0:198984:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788572451.714216:0:198984:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 21474837550 00000020:00080000:0.0:1788572451.714220:0:198984:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 21474837549 00010000:00080000:0.0:1788572451.714225:0:198984:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 21474837550 00010000:00080000:0.0:1788572451.714228:0:198984:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (21474837550) 00000020:00080000:0.0:1788572451.714230:0:198984:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 21474837549 00000020:00080000:0.0:1788572451.714247:0:198984:0:(update_records.c:53:update_records_dump()) master transno = 21474837549 batchid = 17179873002 flags = 0 ops = 10 params = 16 00000020:00080000:0.0:1788572451.714251:0:198984:0:(update_records.c:72:update_records_dump()) update 0th [0x240002729:0x16:0x0] create params_count = 2 00000020:00080000:0.0:1788572451.714255:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2922 0th off = 0 size = 208 00000020:00080000:0.0:1788572451.714258:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e29fa 1th off = 1 size = 16 00000020:00080000:0.0:1788572451.714260:0:198984:0:(update_records.c:72:update_records_dump()) update 1th [0x240002729:0x16:0x0] ref_add params_count = 0 00000020:00080000:0.0:1788572451.714263:0:198984:0:(update_records.c:72:update_records_dump()) update 2th [0x240002729:0x16:0x0] insert params_count = 3 00000020:00080000:0.0:1788572451.714266:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2a12 0th off = 2 size = 2 00000020:00080000:0.0:1788572451.714268:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2a22 1th off = 3 size = 16 00000020:00080000:0.0:1788572451.714270:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2a3a 2th off = 4 size = 4 00000020:00080000:0.0:1788572451.714272:0:198984:0:(update_records.c:72:update_records_dump()) update 3th [0x240002729:0x16:0x0] insert params_count = 3 00000020:00080000:0.0:1788572451.714275:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2a4a 0th off = 5 size = 3 00000020:00080000:0.0:1788572451.714277:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e29fa 1th off = 1 size = 16 00000020:00080000:0.0:1788572451.714279:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2a3a 2th off = 4 size = 4 00000020:00080000:0.0:1788572451.714281:0:198984:0:(update_records.c:72:update_records_dump()) update 4th [0x240002729:0x16:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1788572451.714283:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2a5a 0th off = 6 size = 12 00000020:00080000:0.0:1788572451.714285:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2a72 1th off = 7 size = 48 00000020:00080000:0.0:1788572451.714287:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2aaa 2th off = 8 size = 4 00000020:00080000:0.0:1788572451.714289:0:198984:0:(update_records.c:72:update_records_dump()) update 5th [0x240002729:0x16:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1788572451.714291:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2aba 0th off = 9 size = 9 00000020:00080000:0.0:1788572451.714293:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2ad2 1th off = 10 size = 5 00000020:00080000:0.0:1788572451.714295:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2aaa 2th off = 8 size = 4 00000020:00080000:0.0:1788572451.714297:0:198984:0:(update_records.c:72:update_records_dump()) update 6th [0x200027501:0x4:0x0] insert params_count = 3 00000020:00080000:0.0:1788572451.714299:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2ae2 0th off = 11 size = 11 00000020:00080000:0.0:1788572451.714301:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2a22 1th off = 3 size = 16 00000020:00080000:0.0:1788572451.714303:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2afa 2th off = 12 size = 4 00000020:00080000:0.0:1788572451.714305:0:198984:0:(update_records.c:72:update_records_dump()) update 7th [0x200027501:0x4:0x0] ref_add params_count = 0 00000020:00080000:0.0:1788572451.714306:0:198984:0:(update_records.c:72:update_records_dump()) update 8th [0x240002729:0x16:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1788572451.714308:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2b0a 0th off = 13 size = 13 00000020:00080000:0.0:1788572451.714310:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2b22 1th off = 14 size = 52 00000020:00080000:0.0:1788572451.714312:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2aaa 2th off = 8 size = 4 00000020:00080000:0.0:1788572451.714314:0:198984:0:(update_records.c:72:update_records_dump()) update 9th [0x200027501:0x4:0x0] attr_set params_count = 1 00000020:00080000:0.0:1788572451.714316:0:198984:0:(update_records.c:87:update_records_dump()) param = ffff8e5a372e2b62 0th off = 15 size = 208 00000100:00080000:3.0:1788572451.714921:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff8e5a24615f80 x1875444584424704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572461 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.714930:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788572451.714934:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788572451.714938:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788572451.714941:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584424704:0@lo:38:kworker.0 00000100:00080000:3.0:1788572451.714962:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 6 00000100:00080000:3.0:1788572451.714969:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788572451.714972:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00080000:3.0:1788572451.714975:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e59059d0800 from lustre-MDT0001_UUID committed 0 last 0 00000100:00080000:3.0:1788572451.714979:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788572451.715077:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584425856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572451.715134:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.715182:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584425856 00000100:00100000:3.0:1788572451.715188:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584425856 00000100:00100000:3.0:1788572451.715224:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1788572451.715233:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584425856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572451.715262:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:3.0:1788572451.715277:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cdea00 x1875444584425856/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:112/0 lens 224/368 e 0 to 0 dl 1788572462 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572451.715314:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584425856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.715320:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1788572451.715360:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584425856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572451.717959:0:198984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:198984:1875444584425984:0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1788572451.718021:0:198984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572451.718049:0:198984:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d633cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572451.718078:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584425984 00000100:00100000:0.0:1788572451.718083:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584425984 00000100:00100000:0.0:1788572451.718129:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1788572451.718136:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:198984:x1875444584425984:12345-0@lo:1000:tgt_recover_1.0 00010000:00000080:0.0:1788572451.718181:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4143ad80 x1875444584425984/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:112/0 lens 304/4320 e 0 to 0 dl 1788572462 ref 1 fl Interpret:/200/0 rc 0/0 job:'tgt_recover_1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572451.718225:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:198984:x1875444584425984:12345-0@lo:1000:tgt_recover_1.0 Request processed in 88us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572451.718232:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1788572451.718276:0:198984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:198984:1875444584425984:0@lo:1000:tgt_recover_1.0 00010000:00080000:0.0:1788572451.718339:0:198984:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 80 seconds 00000020:00080000:0.0:1788572451.718342:0:198984:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474837549 00000020:00080000:0.0:1788572451.718350:0:198984:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1788572451.718353:0:198984:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 21474837550 00000020:00080000:0.0:1788572451.718357:0:198984:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1788572451.718359:0:198984:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 21474837550 00000020:00080000:0.0:1788572451.718368:0:198981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000100:00100000:2.0:1788572451.724995:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584424320:0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.725013:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584425216:0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.725112:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572451.725143:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584425728:0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.725167:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.726643:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584425216 00000100:00100000:3.0:1788572451.726654:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584425216 00000100:00100000:3.0:1788572451.726692:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584425728 00000100:00100000:3.0:1788572451.726694:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584425728 00000100:00100000:3.0:1788572451.726715:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1788572451.726723:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584425216:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572451.726747:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa9c00 x1875444584425216/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:112/0 lens 224/224 e 0 to 0 dl 1788572462 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572451.726806:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584425216:12345-0@lo:400:kworker.0 Request processed in 84us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.726813:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1788572451.726829:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1788572451.726834:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584425728:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572451.726846:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa9180 x1875444584425728/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:112/0 lens 224/224 e 0 to 0 dl 1788572462 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572451.726868:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584425728:12345-0@lo:400:kworker.0 Request processed in 34us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.726874:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1788572451.731137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.731191:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584424192 00000100:00100000:1.0:1788572451.731200:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584424192 00000100:00100000:1.0:1788572451.731252:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788572451.731263:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584424192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.731327:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584424192:12345-0@lo:400:kworker.0 Request processed in 66us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572451.731335:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788572451.731397:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584424192:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.731411:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584425088:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.731447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.731508:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584425600:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.731537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.732221:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584424832:0@lo:38:kworker.0 00010000:00080000:2.0:1788572451.732231:0:199252:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00010000:00010000:2.0:1788572451.732238:0:199252:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-osp-MDT0000 (0) 00010000:00010000:2.0:1788572451.732243:0:199252:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-osp-MDT0000 00000100:00100000:3.0:1788572451.732365:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584425216:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.732384:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584425088 00000100:00100000:3.0:1788572451.732389:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584425088 00000100:00100000:3.0:1788572451.732431:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584425600 00000100:00100000:3.0:1788572451.732435:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584425600 00000100:00100000:3.0:1788572451.732458:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7824 00000100:00100000:3.0:1788572451.732466:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584425088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.732537:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584425088:12345-0@lo:400:kworker.0 Request processed in 72us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.732545:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7824 00000100:00100000:3.0:1788572451.732578:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7825 00000100:00100000:3.0:1788572451.732585:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584425600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.732617:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584425600:12345-0@lo:400:kworker.0 Request processed in 33us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.732623:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7825 00000100:00080000:3.0:1788572451.732646:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572451.732669:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584425728:0@lo:400:kworker.0 00000100:00080000:2.0:1788572451.732693:0:199252:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788572451.732707:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584425088:0@lo:400:kworker.0 00000100:00100000:3.0:1788572451.732729:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584425600:0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.732795:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584426112:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788572451.732830:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.733832:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584426112 00000100:00100000:3.0:1788572451.733841:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584426112 00000100:00100000:3.0:1788572451.733885:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1788572451.733907:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584426112:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788572451.733926:0:188053:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e5a1ffa9880 x1875444584426112/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:112/0 lens 224/0 e 0 to 0 dl 1788572462 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572451.733942:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584426112:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 38us (1112us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572451.733949:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000001:00100000:3.0:1788572451.734313:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788572451.735096:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1788572451.743222:0:198984:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1788572451.743233:0:198984:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 21474837550 00010000:00080000:0.0:1788572451.743236:0:198984:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1788572451.743239:0:198984:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1788572451.743245:0:198984:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788572451.743248:0:198984:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788572451.743382:0:198984:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803776 00000001:00100000:1.0:1788572451.754470:0:198961:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788572451.754495:0:198961:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:2.0:1788572451.755540:0:198984:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788572451.755658:0:198984:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:2.0:1788572451.755677:0:198984:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.202.57@tcp: req@ffff8e590a807100 x1875444569540864/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:122/0 lens 224/0 e 0 to 0 dl 1788572472 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788572451.755791:0:198984:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8e5a1ffa9880 x1875444584426112/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:112/0 lens 224/0 e 0 to 0 dl 1788572462 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788572451.756730:0:198984:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788572451.760737:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788572451.760754:0:3640:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8e5a1ffab480 x1875444584426112/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572467 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.760767:0:3640:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8e5a1ffab480 x1875444584426112/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572467 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.760775:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788572451.760799:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788572451.760805:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008a9c660a): req@ffff8e5a1ffaed80 x1875444584408320/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572437 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572451.760824:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584426112:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788572451.760869:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572451.760880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584426240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572451.760950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.761028:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.761030:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584426240 00000100:00100000:1.0:1788572451.761039:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584426240 00000100:00100000:3.0:1788572451.761056:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584408320 00000100:00100000:3.0:1788572451.761061:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584408320 00000100:00100000:1.0:1788572451.761091:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1788572451.761102:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875444584426240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572451.761136:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446023168 avail 1299783680 00000100:00100000:1.0:1788572451.761187:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875444584426240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.765796:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1788572451.765823:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875444584408320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572451.765861:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446023168 avail 1299783680 00000100:00100000:3.0:1788572451.765958:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875444584408320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (4930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.765967:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1788572451.766041:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584426240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572451.766090:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584408320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572451.774881:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000004:00000080:3.0:1788572451.810792:0:198984:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaac785737e10 00100000:10000000:3.0:1788572451.810810:0:198984:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:3.0:1788572451.811256:0:198972:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x24b:0x0] 00000100:00100000:3.0:1788572451.811309:0:198972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198972:1875444584426368:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788572451.811388:0:198972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.811420:0:198972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a410c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572451.811444:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584426368 00000100:00100000:3.0:1788572451.811452:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584426368 00000100:00100000:3.0:1788572451.811528:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22693 00000100:00100000:3.0:1788572451.811539:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:198972:x1875444584426368:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788572451.811569:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 609 -> diff = -22 00002000:02000040:3.0:1788572451.811574:0:8433:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:588 to 0x2c0000400:609) 00000004:00080000:0.0:1788572451.812652:0:198970:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x24b:0x0] 00000100:00100000:0.0:1788572451.812689:0:198970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198970:1875444584426496:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788572451.812742:0:198970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572451.812770:0:198970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d633cc0 going to sleep for 11 seconds 00002000:00010000:3.0:1788572451.825446:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x261:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.825463:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825518:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x261:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.825523:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.825531:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825550:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825573:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825581:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825602:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572451.825723:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x260:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.825729:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825737:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x260:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.825740:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.825745:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825754:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825770:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825778:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825795:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788572451.825841:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.825847:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825855:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25f:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.825858:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.825863:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825871:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825879:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825887:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825920:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788572451.825956:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.825961:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825968:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25e:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.825971:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.825975:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825984:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825991:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.825998:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826019:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788572451.826055:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.826060:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826068:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25d:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.826071:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.826075:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826083:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826091:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826098:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826111:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788572451.826123:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572451.826132:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826134:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572451.826144:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.826146:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826150:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826162:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.826170:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826170:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826196:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826203:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826210:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826229:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bed87 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826232:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bed8e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826263:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572451.826267:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572451.826269:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826272:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826283:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.826289:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572451.826290:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826296:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826308:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826315:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826318:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826333:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005682f2b9/0x265cfe11109bed9c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826335:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826352:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf4d2ec/0x265cfe11109bed95 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826356:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.826361:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826367:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.826368:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572451.826371:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.826374:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.826375:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.826391:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572451.826395:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584426496 00010000:00010000:1.0:1788572451.826403:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572451.826407:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584426496 00010000:00010000:1.0:1788572451.826414:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109beda3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.826429:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.826431:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.826434:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572451.826508:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22694 00000100:00100000:3.0:1788572451.826519:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:198970:x1875444584426496:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788572451.826556:0:177560:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 609 -> diff = -22 00002000:02000040:3.0:1788572451.826561:0:177560:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:588 to 0x280000400:609) 00010000:00010000:1.0:1788572451.828726:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.828735:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.828871:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.828880:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.828909:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25c:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.828914:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.828921:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.828937:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.828951:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.828958:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.828978:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572451.829019:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.829024:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829031:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25b:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.829034:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.829038:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829046:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829054:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829061:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829080:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572451.829088:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572451.829094:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829102:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.829106:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829116:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829131:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829138:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074980c3c/0x265cfe11109bedaa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829159:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.829162:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829169:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.829172:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829185:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829194:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829201:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ed6987/0x265cfe11109bedb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829212:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829214:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829215:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.829253:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.829258:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829266:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25a:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.829269:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.829273:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829281:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829290:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829298:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829309:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.829316:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.829319:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829326:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.829329:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829336:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829345:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829352:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cafecc46/0x265cfe11109bedb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829363:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829365:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829366:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.829402:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.829408:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829415:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x259:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.829417:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.829421:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829429:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829435:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829442:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829453:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.829458:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.829462:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829469:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.829471:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829497:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829508:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829515:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059bfb543/0x265cfe11109bedbf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829527:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829528:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829530:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.829567:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x258:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.829572:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829579:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x258:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.829582:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.829586:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829594:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829602:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829610:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829627:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.829633:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.829636:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829643:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.829645:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829653:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829662:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829669:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000966ced81/0x265cfe11109bedc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829682:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829684:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829685:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.829724:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x257:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.829729:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829737:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x257:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.829740:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.829745:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829753:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829761:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829768:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829779:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.829784:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.829787:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829794:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.829797:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829804:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829813:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829825:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da61982/0x265cfe11109bedcd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829837:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829838:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.829840:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.829878:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x256:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.829883:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829903:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x256:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.829907:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.829910:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829919:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829926:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829933:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829945:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.829951:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.829955:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829961:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.829963:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829970:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829980:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829987:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023ac4ad/0x265cfe11109bedd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.829999:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830000:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830002:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.830044:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x255:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.830050:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830058:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x255:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.830061:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.830064:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830079:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830087:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830095:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830106:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.830113:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.830117:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830124:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.830127:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830135:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830145:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830152:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda0ca95/0x265cfe11109beddb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830165:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830167:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830169:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.830209:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x254:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.830215:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830222:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x254:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.830225:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.830228:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830237:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830245:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830252:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830263:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.830269:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.830273:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830284:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.830287:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830295:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830305:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830311:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44ea910/0x265cfe11109bede2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830323:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830325:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830326:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.830384:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.830390:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830397:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x253:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.830400:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.830404:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830413:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830423:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830430:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830442:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.830449:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.830452:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830458:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.830461:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830468:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830497:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830506:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e000a329/0x265cfe11109bede9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830519:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830521:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830523:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.830563:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.830568:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830576:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x252:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.830579:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.830582:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830591:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830598:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830604:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830616:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.830622:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.830626:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830632:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.830636:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830648:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830657:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830664:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bedf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830675:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830677:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830678:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.830716:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.830721:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830730:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x251:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.830733:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.830737:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830747:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830755:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830762:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830774:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.830780:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.830784:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830790:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.830794:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830802:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830812:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830820:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bedf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830832:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830834:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830836:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.830869:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.830876:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830885:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x250:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.830899:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.830904:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830913:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830921:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830929:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830941:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.830947:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.830950:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830956:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.830959:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830966:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830977:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830984:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bedfe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.830996:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.830998:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.831000:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.831041:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.831046:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831054:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24f:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.831056:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.831061:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831070:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831077:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831084:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831101:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.831108:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.831111:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831118:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.831122:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831129:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831138:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831145:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bee05 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831157:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.831159:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.831160:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.831199:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.831203:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831211:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24e:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.831214:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.831218:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831227:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831235:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831242:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831254:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.831260:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.831263:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831270:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.831274:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831281:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831292:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831303:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bee0c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831316:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.831318:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.831319:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.831355:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.831361:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831369:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24d:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.831372:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.831375:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831384:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831392:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831398:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831409:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.831415:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.831419:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831426:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.831429:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831437:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831446:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831453:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bee13 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831465:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.831466:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.831468:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.831526:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.831532:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831539:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24c:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.831542:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.831546:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831560:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831568:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831575:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831588:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.831594:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.831598:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831604:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.831607:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831615:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831625:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831632:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bee1a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.831644:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.831646:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.831648:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788572451.831681:0:8433:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:587 00000100:00100000:1.0:1788572451.831777:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:198972:x1875444584426368:12345-0@lo:5:osp-pre-1-1.0 Request processed in 20236us (20385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572451.831786:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22693 00000100:00100000:3.0:1788572451.832562:0:198972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198972:1875444584426368:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788572451.832580:0:198972:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x261:0x0] from OST, last_created [0x2c0000400:0x261:0x0]last_used is [0x2c0000400:0x24b:0x0] 00000100:00100000:3.0:1788572451.832653:0:198972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24617b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198972:1875444584426752:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788572451.832700:0:198972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.832727:0:198972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a410c5240 going to sleep for 11 seconds 00010000:00010000:3.0:1788572451.832758:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572451.832769:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584426624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572451.832797:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572451.832839:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584426624 00000100:00100000:3.0:1788572451.832846:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584426624 00000100:00100000:3.0:1788572451.833169:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6401 00000100:00100000:3.0:1788572451.833185:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584426624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572451.833214:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140352 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572451.833257:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584426624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.833264:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6401 00000100:00100000:3.0:1788572451.833325:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584426624:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572451.833345:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572451.837408:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x261:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.837425:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.837450:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x261:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.837456:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.837462:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.837500:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.837512:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.837520:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.837572:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572451.837721:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572451.837730:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.837740:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572451.837745:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.837756:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.837774:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.837782:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003201058/0x265cfe11109bee21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.837878:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572451.837882:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572451.837883:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572451.838027:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x260:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572451.838034:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.838043:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x260:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:2.0:1788572451.838047:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572451.838051:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.838062:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.838071:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.838078:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.838102:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572451.838695:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584426752 00000100:00100000:2.0:1788572451.838706:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584426752 00000100:00100000:2.0:1788572451.838765:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22695 00000100:00100000:2.0:1788572451.838774:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:198972:x1875444584426752:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788572451.838902:0:17061:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 610 00010000:00010000:3.0:1788572451.840803:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572451.840815:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.840828:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572451.840834:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.840846:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.840871:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.840879:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bee28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.840916:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572451.840918:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572451.840920:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572451.842365:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:198972:x1875444584426752:12345-0@lo:5:osp-pre-1-1.0 Request processed in 3586us (9658us total) trans 4294975688 rc 0/0 00000100:00100000:2.0:1788572451.842377:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22695 00000100:00100000:1.0:1788572451.842712:0:198972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24617b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198972:1875444584426752:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788572451.842729:0:198972:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x261:0x0]-[0x2c0000400:0x281:0x0] 00000100:00100000:1.0:1788572451.842775:0:198972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:198972:1875444584426880:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788572451.842820:0:198972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.842857:0:198972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0780 going to sleep for 11 seconds 00002000:00010000:2.0:1788572451.843518:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572451.843527:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.843544:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25f:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:2.0:1788572451.843549:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572451.843555:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.844676:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.844689:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.844697:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.844725:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.844846:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.844853:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.844862:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.844867:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.844878:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.844903:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.844917:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bee2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.844997:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.845000:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.845001:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572451.845945:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572451.845955:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.845976:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25e:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:2.0:1788572451.845981:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572451.845987:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.846000:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.846011:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.846019:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.846047:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.846551:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.846558:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.846567:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.846572:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.846581:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.846596:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.846603:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bee36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.846621:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.846623:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.846625:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572451.846974:0:188060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584426880 00000100:00100000:0.0:1788572451.846987:0:188060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584426880 00000100:00100000:0.0:1788572451.847052:0:188060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788572451.847062:0:188060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198972:x1875444584426880:12345-0@lo:900:osp-pre-1-1.0 00010000:00000080:0.0:1788572451.847095:0:188060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa6300 x1875444584426880/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:112/0 lens 264/248 e 0 to 0 dl 1788572462 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572451.847175:0:188060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198972:x1875444584426880:12345-0@lo:900:osp-pre-1-1.0 Request processed in 114us (4353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572451.847183:0:188060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788572451.847238:0:198972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:198972:1875444584426880:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788572451.848266:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572451.848275:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.848290:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25d:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:2.0:1788572451.848296:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572451.848302:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.848316:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.848327:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.848335:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.848364:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.848754:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.848762:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.848772:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.848777:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.848786:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.848801:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.848808:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bee3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.848825:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.848827:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.848829:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572451.848955:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572451.848962:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.848971:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25c:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:2.0:1788572451.848975:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572451.848979:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.848989:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.848998:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.849006:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.849035:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.849147:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.849154:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849161:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.849165:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849179:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849190:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849197:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bee44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849212:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.849214:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.849216:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572451.849329:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572451.849336:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.849345:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25b:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:2.0:1788572451.849349:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572451.849353:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.849363:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.849372:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.849380:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.849403:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.849717:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.849724:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849732:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7aa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.849736:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849744:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849756:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849769:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bee4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.849783:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.849784:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.849786:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572451.850774:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572451.850784:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.850797:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25a:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:2.0:1788572451.850815:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572451.850821:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.850832:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.850840:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.850847:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.850869:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.850920:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.850928:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.851003:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7be00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.851008:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.851017:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.851030:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.851038:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bee52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.851054:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.851056:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.851058:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572451.851658:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572451.851666:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.851676:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x259:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:2.0:1788572451.851679:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572451.851683:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.851692:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.851701:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.851709:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.851730:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.855901:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.855917:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.856067:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.856075:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.856087:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.856111:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.856120:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bee59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.856140:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.856143:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.856145:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572451.859932:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x258:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.859948:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.859967:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x258:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.859972:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.859979:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.859994:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.860005:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.860013:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.860036:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572451.860149:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572451.860159:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.860170:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572451.860177:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.860187:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.860206:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.860215:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109bee60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.860236:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572451.860239:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572451.860240:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572451.863160:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x257:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.863175:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.863192:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x257:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.863197:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.863203:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.863626:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.863639:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.863647:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.863673:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.863698:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.863707:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.863719:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.863724:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.863740:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.863757:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.863766:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109bee67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.863783:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.863785:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.863787:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572451.864716:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x256:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.864725:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.864738:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x256:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.864743:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.864748:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.864759:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.864768:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.864775:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.864797:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.864921:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.864927:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.865008:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.865012:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.865021:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.865034:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.865048:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109bee6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.865067:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.865069:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.865071:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572451.865877:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x255:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.865897:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.865910:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x255:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.865914:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.865919:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.865931:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.865939:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.865947:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.865973:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572451.866198:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572451.866206:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572451.866214:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572451.866219:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572451.866227:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572451.866241:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572451.866254:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572451.866271:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572451.866273:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572451.866275:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572451.866731:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x254:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.866740:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.866750:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x254:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.866754:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.866758:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.866768:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.866777:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.866785:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.866801:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.867643:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.867653:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.867664:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.867669:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.867679:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.867694:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.867702:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.867720:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.867722:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.867724:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.890327:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.890342:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.890361:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x253:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.890365:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.890385:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.890400:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.890412:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.890420:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.890450:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572451.890866:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572451.890874:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.890883:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572451.890900:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.890910:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.890927:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.890935:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e69f87b3/0x265cfe11109bee83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.890954:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572451.890956:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572451.890958:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572451.891243:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.891249:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.891259:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x252:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.891262:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.891267:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.891282:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.891290:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.891298:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.891351:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572451.892906:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572451.892918:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.892934:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x251:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:1.0:1788572451.892939:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.892944:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.892957:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.892967:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.892980:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.898191:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572451.898206:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.898220:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572451.898225:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.898242:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.898263:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572451.898271:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bee8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.898357:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572451.898363:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.898379:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572451.898383:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.898391:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.898402:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.898410:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572451.898412:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572451.898414:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572451.905446:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.905533:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572451.905548:0:177560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001220ef24/0x265cfe11109bee91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572451.912001:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.912017:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.912034:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x250:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.912038:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.912044:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.912058:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.912074:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.912081:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.912108:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.912353:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.912361:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.912370:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.912375:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.912386:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.912402:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.912410:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109bee98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.912427:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.912430:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.912432:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572451.913351:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.913363:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913377:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24f:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.913381:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.913386:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913396:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913404:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913411:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913434:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572451.913850:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.913857:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913868:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24e:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.913872:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.913876:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913886:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913924:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913933:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.913958:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572451.914355:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572451.914363:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914379:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.914385:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914394:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914411:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572451.914413:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.914424:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914426:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b96d4d2/0x265cfe11109bee9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.914440:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24d:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.914444:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572451.914461:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572451.914626:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572451.914717:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.914729:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.914739:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.914747:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914751:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914763:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572451.914770:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572451.914772:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914786:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914797:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914805:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109beea6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914818:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.914821:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914828:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.914831:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914838:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914847:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914854:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b052b295/0x265cfe11109beead lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.914871:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.914872:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.914875:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572451.915393:0:177560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572451.915401:0:177560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.915412:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24c:0x0].0x0 since=9204s v=(0 0) 00010000:00010000:3.0:1788572451.915416:0:177560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572451.915421:0:177560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.915431:0:177560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.915439:0:177560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.917711:0:177560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.917751:0:177560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788572451.917863:0:177560:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:587 00010000:00010000:1.0:1788572451.917951:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572451.917961:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.917970:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572451.917975:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.917986:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.918007:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.918015:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf4d2ec/0x265cfe11109beeb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.918039:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.918041:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572451.918042:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572451.922492:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:198970:x1875444584426496:12345-0@lo:5:osp-pre-0-1.0 Request processed in 95951us (109726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.923258:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22694 00000100:00100000:0.0:1788572451.924311:0:198970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198970:1875444584426496:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788572451.924335:0:198970:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x261:0x0] from OST, last_created [0x280000400:0x261:0x0]last_used is [0x280000400:0x24b:0x0] 00000100:00100000:0.0:1788572451.924438:0:198970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198970:1875444584427136:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788572451.924520:0:198970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572451.924546:0:198970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d633cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572451.924572:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572451.924582:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584427008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572451.924608:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572451.925094:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572451.925108:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584427136 00000100:00100000:3.0:1788572451.925114:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584427136 00000100:00100000:3.0:1788572451.925167:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22696 00000100:00100000:3.0:1788572451.925176:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:198970:x1875444584427136:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788572451.925215:0:177560:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 610 00000100:00100000:0.0:1788572451.925595:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584427008 00000100:00100000:0.0:1788572451.925600:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584427008 00000100:00100000:0.0:1788572451.925630:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6402 00000100:00100000:0.0:1788572451.925636:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584427008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572451.925649:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 896 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572451.925701:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584427008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572451.925707:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6402 00000100:00100000:0.0:1788572451.925754:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584427008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572451.933017:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+6:198970:x1875444584427136:12345-0@lo:5:osp-pre-0-1.0 Request processed in 7834us (8488us total) trans 38654705679 rc 0/0 00000100:00100000:3.0:1788572451.933031:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22696 00000100:00100000:0.0:1788572451.941776:0:198970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198970:1875444584427136:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788572451.941797:0:198970:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x261:0x0]-[0x280000400:0x281:0x0] 00000100:00100000:0.0:1788572451.941864:0:198970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:198970:1875444584427264:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788572451.941939:0:198970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572451.941979:0:198970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1d633cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572451.942030:0:188060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584427264 00000100:00100000:1.0:1788572451.942037:0:188060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584427264 00000100:00100000:1.0:1788572451.942091:0:188060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788572451.942100:0:188060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198970:x1875444584427264:12345-0@lo:900:osp-pre-0-1.0 00010000:00000080:1.0:1788572451.942125:0:188060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1095df80 x1875444584427264/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:112/0 lens 264/248 e 0 to 0 dl 1788572462 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572451.942177:0:188060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198970:x1875444584427264:12345-0@lo:900:osp-pre-0-1.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572451.942185:0:188060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572451.942250:0:198970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:198970:1875444584427264:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788572452.139353:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572452.139404:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572452.139431:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572452.139467:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569541504 00000100:00100000:3.0:1788572452.139510:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569541504 00000100:00100000:3.0:1788572452.139564:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569541376 00000100:00100000:3.0:1788572452.139568:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569541376 00000100:00100000:3.0:1788572452.139601:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 451 00000100:00100000:3.0:1788572452.139611:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569541504:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572452.139689:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569541504:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572452.139698:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 451 00000100:00100000:3.0:1788572452.139721:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 452 00000100:00100000:3.0:1788572452.139728:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569541376:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572452.139744:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a24617480 x1875444569541376/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:127/0 lens 224/224 e 0 to 0 dl 1788572477 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572452.139768:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569541376:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 41us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572452.139775:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 452 00000100:00080000:3.0:1788572452.139799:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572452.140253:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569541248 00000100:00100000:1.0:1788572452.140259:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569541248 00000100:00100000:1.0:1788572452.140303:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 134 00000100:00100000:1.0:1788572452.140311:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569541248:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572452.140348:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569541248:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 38us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572452.140354:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 134 00000001:00080000:0.0:1788572452.222849:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350998 is committed 00000020:00000004:2.0:1788572452.227968:0:199280:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572452.228311:0:199280:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788572452.483783:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572452.733003:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584427392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572452.733078:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572452.733121:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572452.733127:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584427520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572452.733150:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572452.733192:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584427392 00000100:00100000:3.0:1788572452.733200:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584427392 00000100:00100000:3.0:1788572452.733243:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584427520 00000100:00100000:3.0:1788572452.733246:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584427520 00000100:00100000:3.0:1788572452.733261:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6403 00000100:00100000:3.0:1788572452.733269:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584427392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572452.733293:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572452.733337:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584427392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572452.733346:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6403 00000100:00100000:3.0:1788572452.733364:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6404 00000100:00100000:3.0:1788572452.733369:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584427520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572452.733380:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572452.733405:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584427520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572452.733411:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6404 00000100:00100000:3.0:1788572452.733469:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584427520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572452.733508:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584427392:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1788572453.141882:0:199330:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572453.142175:0:199330:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788572453.502599:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572454.525022:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572455.147594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572455.147902:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569541632 00000100:00100000:1.0:1788572455.147925:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569541632 00000100:00100000:1.0:1788572455.148015:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1208 00000100:00100000:1.0:1788572455.148026:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:163782:x1875444569541632:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572455.148047:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572455.148072:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109beebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb503 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.148138:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109beec2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.148151:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109beec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.148176:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109beec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572455.148223:0:198183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572455.148228:0:198183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1788572455.148246:0:198183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109beec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.148269:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf800/0x265cfe11109beebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb503 expref: 9 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.148290:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109beec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb503 expref: 8 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572455.148298:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572455.148301:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572455.148304:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffce200, rc 0) 00010000:00000080:1.0:1788572455.148311:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a24615500 x1875444569541632/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:130/0 lens 576/688 e 0 to 0 dl 1788572480 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572455.148384:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163782:x1875444569541632:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 361us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572455.148391:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1208 00000100:00080000:3.0:1788572455.149215:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572455.151187:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572455.155078:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569541760 00000100:00100000:0.0:1788572455.155094:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569541760 00000100:00100000:0.0:1788572455.155173:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1209 00000100:00100000:0.0:1788572455.155184:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163782:x1875444569541760:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:0.0:1788572455.155223:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:0.0:1788572455.155243:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a24614000 x1875444569541760/t0(0) o41->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:116/0 lens 224/368 e 0 to 0 dl 1788572466 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572455.155321:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:163782:x1875444569541760:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 139us (4144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572455.155329:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1209 00000100:00100000:2.0:1788572455.158687:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572455.158788:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569541888 00000100:00100000:3.0:1788572455.158797:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569541888 00000100:00100000:3.0:1788572455.158879:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1210 00000100:00100000:3.0:1788572455.158889:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163782:x1875444569541888:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572455.158938:0:188833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446023168 avail 1299783680 00000100:00100000:3.0:1788572455.159044:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163782:x1875444569541888:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 156us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572455.159052:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1210 00000100:00080000:0.0:1788572455.159842:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572455.167709:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572455.167969:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569542016 00000100:00100000:0.0:1788572455.167982:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569542016 00000100:00100000:0.0:1788572455.168042:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22697 00000100:00100000:0.0:1788572455.168051:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2396:x1875444569542016:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:0.0:1788572455.168094:0:43924:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9208 last 0 00000020:00000080:0.0:1788572455.168130:0:43924:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109beec9 00002000:00100000:0.0:1788572455.168147:0:43924:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e5a109bf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572455.168170:0:43924:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572455.168264:0:43924:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788572455.168300:0:43924:0:(import.c:65:import_set_state_nolock()) ffff8e5a109be000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572455.168374:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569542016:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 322us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572455.168382:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22697 00000100:00100000:1.0:1788572455.170252:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572455.170345:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569542144 00000100:00100000:3.0:1788572455.170355:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569542144 00000100:00100000:3.0:1788572455.170435:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6405 00000100:00100000:3.0:1788572455.170446:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163782:x1875444569542144:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572455.170516:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572455.170589:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163782:x1875444569542144:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 145us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572455.170597:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6405 00000100:00080000:0.0:1788572455.170844:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572455.173794:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572455.173887:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569542272 00000100:00100000:1.0:1788572455.173897:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569542272 00000100:00100000:1.0:1788572455.173956:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22698 00000100:00100000:1.0:1788572455.173963:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2396:x1875444569542272:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:1.0:1788572455.174000:0:41719:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9208 last 0 00000020:00000080:1.0:1788572455.174029:0:41719:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109beed0 00002000:00100000:1.0:1788572455.174041:0:41719:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e5a0f315800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572455.174058:0:41719:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788572455.174138:0:41719:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788572455.174169:0:41719:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f316800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572455.174241:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569542272:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 276us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572455.174249:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22698 00000100:00100000:2.0:1788572455.177535:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572455.177632:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569542400 00000100:00100000:3.0:1788572455.177643:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569542400 00000100:00100000:3.0:1788572455.177729:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6406 00000100:00100000:3.0:1788572455.177741:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163782:x1875444569542400:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572455.177767:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572455.177840:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:163782:x1875444569542400:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 102us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572455.177848:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6406 00000100:00080000:0.0:1788572455.177929:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572455.550084:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572456.577452:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572456.831522:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584427648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572456.831607:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.831700:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584427648 00000100:00100000:0.0:1788572456.831707:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584427648 00000100:00100000:0.0:1788572456.831755:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1788572456.831764:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584427648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572456.831799:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:0.0:1788572456.831815:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590542ca80 x1875444584427648/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:117/0 lens 224/368 e 0 to 0 dl 1788572467 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572456.831854:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584427648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.831861:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1788572456.832047:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584427904:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832081:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.832105:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584428416:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832128:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.832148:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584428928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832168:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.832188:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788572456.832194:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584428032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832213:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.832230:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584428544:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.832268:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584429056:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832286:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.832314:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584427904 00000100:00100000:0.0:1788572456.832317:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584427904 00000100:00100000:0.0:1788572456.832352:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584428032 00000100:00100000:0.0:1788572456.832355:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584428032 00000100:00100000:0.0:1788572456.832376:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1788572456.832383:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584427904:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572456.832397:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590c443480 x1875444584427904/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:131/0 lens 224/224 e 0 to 0 dl 1788572481 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572456.832432:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584427904:12345-0@lo:400:kworker.0 Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.832437:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1788572456.832451:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1788572456.832457:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584428032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832510:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584428032:12345-0@lo:400:kworker.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.832516:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1788572456.832536:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584428416 00000100:00100000:0.0:1788572456.832539:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584428416 00000100:00100000:0.0:1788572456.832560:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1788572456.832566:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584428416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832597:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584428416:12345-0@lo:400:kworker.0 Request processed in 31us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.832603:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1788572456.832622:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584428928 00000100:00100000:0.0:1788572456.832625:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584428928 00000100:00100000:0.0:1788572456.832649:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584428544 00000100:00100000:0.0:1788572456.832652:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584428544 00000100:00100000:0.0:1788572456.832667:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584429056 00000100:00100000:0.0:1788572456.832669:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584429056 00000100:00100000:0.0:1788572456.832686:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7826 00000100:00100000:0.0:1788572456.832692:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584428928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832739:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584428928:12345-0@lo:400:kworker.0 Request processed in 47us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.832745:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7826 00000100:00100000:0.0:1788572456.832757:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7827 00000100:00100000:0.0:1788572456.832762:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584428544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832786:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584428544:12345-0@lo:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.832792:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7827 00000100:00100000:0.0:1788572456.832802:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7828 00000100:00100000:0.0:1788572456.832808:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584429056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832833:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584429056:12345-0@lo:400:kworker.0 Request processed in 26us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.832838:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7828 00000100:00080000:0.0:1788572456.832866:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572456.832870:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572456.832872:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572456.832874:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572456.832900:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584428160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832941:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.832962:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584428672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.832982:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.832997:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584429184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833016:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.833053:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584427648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572456.833072:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572456.833078:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584427776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.833126:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584428288:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833147:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.833163:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584428800:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.833207:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584428160 00000100:00100000:0.0:1788572456.833210:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584428160 00000100:00100000:0.0:1788572456.833239:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584429184 00000100:00100000:0.0:1788572456.833242:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584429184 00000100:00100000:0.0:1788572456.833255:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584428288 00000100:00100000:0.0:1788572456.833258:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584428288 00000100:00100000:0.0:1788572456.833268:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584428800 00000100:00100000:0.0:1788572456.833271:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584428800 00000100:00100000:0.0:1788572456.833281:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1788572456.833286:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584428160:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572456.833300:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590c440a80 x1875444584428160/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:131/0 lens 224/224 e 0 to 0 dl 1788572481 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572456.833336:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584428160:12345-0@lo:400:kworker.0 Request processed in 50us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.833343:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1788572456.833355:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1788572456.833361:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584429184:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572456.833371:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590c443800 x1875444584429184/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:131/0 lens 224/224 e 0 to 0 dl 1788572481 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572456.833394:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584429184:12345-0@lo:400:kworker.0 Request processed in 34us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.833399:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1788572456.833411:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1788572456.833418:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584428288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833443:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584428288:12345-0@lo:400:kworker.0 Request processed in 26us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.833449:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1788572456.833461:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1788572456.833466:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584428800:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572456.833476:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27229c00 x1875444584428800/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:131/0 lens 224/224 e 0 to 0 dl 1788572481 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572456.833529:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584428800:12345-0@lo:400:kworker.0 Request processed in 64us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.833535:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1788572456.833555:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584428672 00000100:00100000:0.0:1788572456.833558:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584428672 00000100:00100000:0.0:1788572456.833587:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7829 00000100:00100000:0.0:1788572456.833593:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584428672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833620:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584428672:12345-0@lo:400:kworker.0 Request processed in 28us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.833625:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7829 00000100:00100000:0.0:1788572456.833644:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584427776 00000100:00100000:0.0:1788572456.833647:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584427776 00000100:00100000:0.0:1788572456.833668:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788572456.833674:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584427776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833700:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584427776:12345-0@lo:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.833705:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788572456.833737:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572456.833740:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572456.833742:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788572456.833769:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1fea4700 x1875444584428032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572456.833779:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584428032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833790:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584428544:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833801:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584429056:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833813:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584427904:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833824:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584428416:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833834:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584428928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833867:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584427776:0@lo:400:kworker.0 00010000:00080000:0.0:1788572456.833877:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1f8fc380 x1875444584428288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572456.833886:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584428288:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833896:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584428800:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833905:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584428160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833913:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584428672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.833937:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584429184:0@lo:400:kworker.0 00000100:00100000:3.0:1788572456.841595:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572456.841622:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584429312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572456.841699:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572456.841750:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584429312 00000100:00100000:3.0:1788572456.841757:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584429312 00000100:00100000:3.0:1788572456.841809:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1788572456.841819:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584429312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572456.841852:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446023168 avail 1299783680 00000100:00100000:3.0:1788572456.841896:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584429312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572456.841903:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1788572456.841964:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584429312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572457.333113:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572457.333157:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572457.333192:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572457.333218:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572457.333244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572457.333273:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569543040 00000100:00100000:0.0:1788572457.333283:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569543040 00000100:00100000:0.0:1788572457.333333:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569542912 00000100:00100000:0.0:1788572457.333336:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569542912 00000100:00100000:0.0:1788572457.333373:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7830 00000100:00100000:0.0:1788572457.333388:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569543040:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572457.333471:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569543040:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572457.333586:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569542528 00000100:00100000:1.0:1788572457.333590:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569542528 00000100:00100000:1.0:1788572457.333623:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 136 00000100:00100000:1.0:1788572457.333631:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569542528:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572457.333661:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569542528:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572457.333668:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 136 00000100:00100000:3.0:1788572457.333844:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569542784 00000100:00100000:3.0:1788572457.333850:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569542784 00000100:00100000:3.0:1788572457.333881:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569542656 00000100:00100000:3.0:1788572457.333884:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569542656 00000100:00100000:3.0:1788572457.333910:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 459 00000100:00100000:3.0:1788572457.333932:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569542784:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572457.333977:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569542784:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 59us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572457.333984:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 459 00000100:00100000:3.0:1788572457.334001:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 460 00000100:00100000:3.0:1788572457.334007:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2400:x1875444569542656:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572457.334021:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27229500 x1875444569542656/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:118/0 lens 224/224 e 0 to 0 dl 1788572468 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572457.334043:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2400:x1875444569542656:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 37us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572457.334049:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 460 00000100:00100000:0.0:1788572457.334251:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7830 00000100:00100000:0.0:1788572457.334270:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7831 00000100:00100000:0.0:1788572457.334278:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569542912:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572457.334309:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569542912:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.334315:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7831 00000100:00080000:0.0:1788572457.334339:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572457.334342:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572457.334345:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572457.334346:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572457.340939:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2722b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584429440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572457.342027:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572457.342151:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572457.342161:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584429568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572457.342189:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572457.342410:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584429440 00000100:00100000:3.0:1788572457.342420:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584429440 00000100:00100000:3.0:1788572457.351421:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584429568 00000100:00100000:3.0:1788572457.351437:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584429568 00000100:00100000:2.0:1788572457.351563:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6407 00000100:00100000:2.0:1788572457.351593:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584429440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572457.351633:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572457.351739:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584429440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (9714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.351750:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6407 00000100:00100000:2.0:1788572457.351806:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2722b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584429440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572457.351840:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6408 00000100:00100000:2.0:1788572457.351847:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584429568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572457.351863:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572457.351897:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875444584429568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (9707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.351903:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6408 00000100:00100000:2.0:1788572457.351951:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584429568:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572457.606594:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572457.853262:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584429696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572457.853341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572457.855147:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584429696 00000100:00100000:0.0:1788572457.855161:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584429696 00000100:00100000:0.0:1788572457.855224:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6409 00000100:00100000:0.0:1788572457.855235:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584429696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572457.855260:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572457.855338:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584429696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.855346:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6409 00000100:00100000:0.0:1788572457.855398:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584429696:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788572457.864721:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:0.0:1788572457.864738:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705679 is committed 00000100:00100000:0.0:1788572457.869009:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584429824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572457.869093:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572457.869219:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584429824 00000100:00100000:1.0:1788572457.869228:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584429824 00000100:00100000:1.0:1788572457.869281:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6410 00000100:00100000:1.0:1788572457.869290:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584429824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572457.869316:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572457.869361:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584429824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572457.869367:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6410 00000001:00100000:1.0:1788572457.871092:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:1.0:1788572457.871108:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975688 is committed 00000100:00100000:0.0:1788572457.871646:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584429824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788572458.623785:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572459.644827:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572460.668925:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788572461.318379:0:199523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1788572461.695405:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572461.949101:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584429952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572461.949183:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572461.949444:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584429952 00000100:00100000:0.0:1788572461.949452:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584429952 00000100:00100000:0.0:1788572461.949513:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1788572461.949524:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584429952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572461.949559:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446023168 avail 1299783680 00000100:00100000:1.0:1788572461.951725:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584430080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572461.951799:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572461.951874:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584430080 00000100:00100000:1.0:1788572461.951880:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584430080 00000100:00100000:1.0:1788572461.951912:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1788572461.951919:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584430080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572461.951981:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:1.0:1788572461.951997:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa5880 x1875444584430080/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:122/0 lens 224/368 e 0 to 0 dl 1788572472 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572461.952035:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584430080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572461.952041:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1788572461.952088:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584430080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572461.952161:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572461.952169:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584430208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.952199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572461.952231:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584430208 00000100:00100000:1.0:1788572461.952236:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584430208 00000100:00100000:1.0:1788572461.952265:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788572461.952271:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584430208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.952316:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584430208:12345-0@lo:400:kworker.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572461.952323:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788572461.952355:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584430208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.952383:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584430336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.952410:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572461.952438:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584430336 00000100:00100000:1.0:1788572461.952442:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584430336 00000100:00100000:1.0:1788572461.952506:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1788572461.952514:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584430336:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572461.952526:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa7b80 x1875444584430336/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:122/0 lens 224/224 e 0 to 0 dl 1788572472 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572461.952557:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875444584430336:12345-0@lo:400:kworker.0 Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572461.952564:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00080000:1.0:1788572461.952580:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572461.952602:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875444584430336:0@lo:400:kworker.0 00000100:00100000:2.0:1788572461.958520:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584430464:0@lo:400:kworker.0 00000100:00100000:2.0:1788572461.958607:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572461.958783:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584429952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9259us (9598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572461.958796:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1788572461.958965:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584430464 00000100:00100000:0.0:1788572461.958973:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584430464 00000100:00100000:0.0:1788572461.959035:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1788572461.959045:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584430464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572461.959097:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584430464:12345-0@lo:400:kworker.0 Request processed in 55us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572461.959104:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00080000:0.0:1788572461.959145:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572461.962352:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584429952:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788572461.962400:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1ffa5f80 x1875444584430464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572461.962411:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584430464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.972226:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572461.972252:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584430720:0@lo:400:kworker.0 00000100:00100000:3.0:1788572461.972453:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584430592:0@lo:400:kworker.0 00000100:00100000:2.0:1788572461.972712:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584431232:0@lo:400:kworker.0 00000100:00100000:3.0:1788572461.976565:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572461.976632:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584431104:0@lo:400:kworker.0 00000100:00100000:3.0:1788572461.976673:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572461.976698:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572461.976704:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584430976:0@lo:400:kworker.0 00000100:00100000:3.0:1788572461.976726:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572461.976743:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584431488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572461.976778:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572461.976823:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584430592 00000100:00100000:3.0:1788572461.976832:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584430592 00000100:00100000:3.0:1788572461.976893:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584431104 00000100:00100000:3.0:1788572461.976896:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584431104 00000100:00100000:3.0:1788572461.976912:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584431488 00000100:00100000:3.0:1788572461.976915:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584431488 00000100:00100000:3.0:1788572461.976931:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1788572461.976939:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584430592:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572461.976977:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ef8a80 x1875444584430592/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:122/0 lens 224/224 e 0 to 0 dl 1788572472 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572461.977022:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584430592:12345-0@lo:400:kworker.0 Request processed in 83us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572461.977029:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1788572461.977048:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1788572461.977055:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584431104:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572461.977065:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ef9500 x1875444584431104/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:122/0 lens 224/224 e 0 to 0 dl 1788572472 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572461.977092:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584431104:12345-0@lo:400:kworker.0 Request processed in 37us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572461.977098:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1788572461.977109:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1788572461.977115:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584431488:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572461.977125:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36efb100 x1875444584431488/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:122/0 lens 224/224 e 0 to 0 dl 1788572472 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572461.977288:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584430976 00000100:00100000:0.0:1788572461.977292:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584430976 00000100:00100000:0.0:1788572461.977337:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7832 00000100:00100000:0.0:1788572461.977345:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584430976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572461.977387:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584430976:12345-0@lo:400:kworker.0 Request processed in 44us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572461.977393:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7832 00000100:00080000:0.0:1788572461.977416:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572461.977421:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572461.977472:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584430976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572461.977510:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584431104:0@lo:400:kworker.0 00000100:00100000:0.0:1788572461.977521:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584430592:0@lo:400:kworker.0 00000100:00100000:3.0:1788572461.977861:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584431488:12345-0@lo:400:kworker.0 Request processed in 744us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572461.977868:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1788572461.977955:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584431488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.978037:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572461.978081:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584430848:0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.978111:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572461.978147:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584431360:0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.978174:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572461.978199:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584430848 00000100:00100000:1.0:1788572461.978203:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584430848 00000100:00100000:1.0:1788572461.978237:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584431360 00000100:00100000:1.0:1788572461.978241:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584431360 00000100:00100000:1.0:1788572461.978263:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7833 00000100:00100000:1.0:1788572461.978271:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584430848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572461.978448:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584430720 00000100:00100000:0.0:1788572461.978453:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584430720 00000100:00100000:0.0:1788572461.978502:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1788572461.978509:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584430720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572461.978546:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584430720:12345-0@lo:400:kworker.0 Request processed in 37us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572461.978551:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00080000:0.0:1788572461.978586:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572461.978589:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572461.978591:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788572461.978611:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a1ffa6a00 x1875444584430720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572461.978622:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584430720:0@lo:400:kworker.0 00000100:00100000:0.0:1788572461.978650:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7834 00000100:00100000:0.0:1788572461.978657:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584431360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572461.978692:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584431360:12345-0@lo:400:kworker.0 Request processed in 36us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572461.978697:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7834 00000100:00100000:0.0:1788572461.978719:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975688 gen 2 00000100:00100000:0.0:1788572461.978730:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584431360:0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.978915:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584430848:12345-0@lo:400:kworker.0 Request processed in 644us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572461.978921:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7833 00000100:00100000:2.0:1788572461.979023:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572461.979099:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584431232 00000100:00100000:1.0:1788572461.979104:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584431232 00000100:00100000:1.0:1788572461.979152:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7835 00000100:00100000:1.0:1788572461.979158:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584431232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572461.979195:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584431232:12345-0@lo:400:kworker.0 Request processed in 37us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572461.979201:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7835 00000100:00080000:2.0:1788572461.979374:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572461.979397:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705679 gen 2 00000100:00100000:2.0:1788572461.979409:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584431232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572461.979476:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584430848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572462.451940:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572462.451996:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572462.452038:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572462.452065:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572462.452102:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572462.452133:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569543168 00000100:00100000:2.0:1788572462.452155:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569543168 00000100:00100000:2.0:1788572462.452209:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 138 00000100:00100000:2.0:1788572462.452219:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569543168:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572462.452296:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569543168:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572462.452304:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 138 00000100:00100000:2.0:1788572462.452448:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569543296 00000100:00100000:2.0:1788572462.452452:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569543296 00000100:00100000:2.0:1788572462.452517:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569543424 00000100:00100000:2.0:1788572462.452520:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569543424 00000100:00100000:2.0:1788572462.452542:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 467 00000100:00100000:2.0:1788572462.452548:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2400:x1875444569543296:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:2.0:1788572462.452566:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41439180 x1875444569543296/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:123/0 lens 224/224 e 0 to 0 dl 1788572473 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572462.452593:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2400:x1875444569543296:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 46us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572462.452600:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 467 00000100:00100000:2.0:1788572462.452609:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 468 00000100:00100000:2.0:1788572462.452616:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569543424:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572462.452633:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569543424:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 18us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572462.452639:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 468 00000100:00080000:2.0:1788572462.452651:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572462.452654:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572462.452930:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569543552 00000100:00100000:3.0:1788572462.452935:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569543552 00000100:00100000:3.0:1788572462.452984:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569543680 00000100:00100000:3.0:1788572462.452986:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569543680 00000100:00100000:3.0:1788572462.453004:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7836 00000100:00100000:3.0:1788572462.453010:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2722b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569543552:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572462.453042:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2722b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569543552:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.453048:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7836 00000100:00100000:3.0:1788572462.453059:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7837 00000100:00100000:3.0:1788572462.453065:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569543680:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572462.453082:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569543680:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 18us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.453088:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7837 00000100:00080000:2.0:1788572462.454640:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572462.454650:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572462.461207:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584431616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572462.461292:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572462.461362:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584431616 00000100:00100000:2.0:1788572462.461370:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584431616 00000100:00100000:2.0:1788572462.461424:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6411 00000100:00100000:2.0:1788572462.461434:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584431616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572462.461464:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572462.461544:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584431616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572462.461551:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6411 00000100:00100000:2.0:1788572462.461603:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584431616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572462.461737:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572462.461749:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584431744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572462.461796:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572462.461824:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584431744 00000100:00100000:0.0:1788572462.461828:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584431744 00000100:00100000:0.0:1788572462.461852:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6412 00000100:00100000:0.0:1788572462.461858:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584431744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572462.461877:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572462.461910:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584431744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572462.461916:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6412 00000100:00100000:0.0:1788572462.461959:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584431744:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572462.717078:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572462.975887:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572462.975915:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584431872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572462.976004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572462.976061:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584431872 00000100:00100000:2.0:1788572462.976069:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584431872 00000100:00100000:2.0:1788572462.976135:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6413 00000100:00100000:2.0:1788572462.976145:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584431872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572462.976181:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572462.976238:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584431872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572462.976246:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6413 00000100:00100000:3.0:1788572462.976638:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584431872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572462.980203:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572462.980228:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584432000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572462.980296:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572462.980356:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584432000 00000100:00100000:1.0:1788572462.980365:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584432000 00000100:00100000:1.0:1788572462.980414:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6414 00000100:00100000:1.0:1788572462.980423:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584432000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572462.980461:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572462.980608:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584432000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572462.980617:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6414 00000100:00100000:1.0:1788572462.980870:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584432000:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788572463.273189:0:199571:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1788572463.741703:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572464.767388:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572465.409323:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.409438:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569543808 00000100:00100000:0.0:1788572465.409450:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569543808 00000100:00100000:0.0:1788572465.409609:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1211 00000100:00100000:0.0:1788572465.409624:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164249:x1875444569543808:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:0.0:1788572465.409680:0:188049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445613568 avail 1299374080 00010000:00000080:0.0:1788572465.409702:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a24547b80 x1875444569543808/t0(0) o41->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:126/0 lens 224/368 e 0 to 0 dl 1788572476 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572465.409768:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164249:x1875444569543808:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 149us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572465.409776:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1211 00000100:00080000:2.0:1788572465.410219:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572465.414408:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.414978:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569543936 00000100:00100000:0.0:1788572465.414990:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569543936 00000100:00100000:0.0:1788572465.415074:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1212 00000100:00100000:0.0:1788572465.415088:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:164249:x1875444569543936:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:0.0:1788572465.415132:0:198183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446023168 avail 1299783680 00000100:00100000:0.0:1788572465.415233:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:164249:x1875444569543936:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 149us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572465.415241:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1212 00000100:00080000:2.0:1788572465.415509:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572465.418706:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.418803:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569544064 00000100:00100000:2.0:1788572465.418813:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569544064 00000100:00100000:2.0:1788572465.418888:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6415 00000100:00100000:2.0:1788572465.418898:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164249:x1875444569544064:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:2.0:1788572465.418930:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572465.419002:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164249:x1875444569544064:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 106us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572465.419009:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6415 00000100:00080000:0.0:1788572465.419782:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572465.421064:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572465.421251:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569544192 00000100:00100000:3.0:1788572465.421260:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569544192 00000100:00100000:3.0:1788572465.421336:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6416 00000100:00100000:3.0:1788572465.421347:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3a49f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164249:x1875444569544192:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572465.421379:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572465.421443:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3a49f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164249:x1875444569544192:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 97us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572465.421450:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6416 00000100:00080000:0.0:1788572465.421788:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572465.479569:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.480286:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569544448 00000100:00100000:2.0:1788572465.480297:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569544448 00000100:00100000:2.0:1788572465.480371:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1213 00000100:00100000:2.0:1788572465.480383:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164265:x1875444569544448:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572465.480405:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572465.480426:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b400/0x265cfe11109beed7 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb50a expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.480553:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 3/1,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.480573:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.480587:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.480603:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.480610:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.480617:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572465.480736:0:188048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24546a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584432128:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788572465.480796:0:188048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572465.480845:0:188048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f3d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572465.481017:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584432128 00000100:00100000:3.0:1788572465.481022:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584432128 00000100:00100000:3.0:1788572465.481072:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1788572465.481080:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:188048:x1875444584432128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788572465.481170:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:188048:x1875444584432128:12345-0@lo:1000:mdt00_000.0 Request processed in 90us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572465.481178:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1788572465.481325:0:188048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24546a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:188048:1875444584432128:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788572465.481382:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beeec lrc: 3/1,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481394:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beeec lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481403:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beeec lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481417:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 4/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481424:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 4/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481431:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481438:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481444:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572465.481450:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481458:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 5/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481469:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:0.0:1788572465.481472:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572465.481507:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 3/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481514:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a400/0x265cfe11109beede lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481539:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481547:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481553:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481558:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572465.481561:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481567:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481573:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0xf7117594 (ffff8e5a18beba00) 00010000:00010000:0.0:1788572465.481576:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572465.481580:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481585:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109beee5 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481624:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b400/0x265cfe11109beed7 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb50a expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481639:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beeec lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb50a expref: 9 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.481646:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3f700) 00010000:00010000:0.0:1788572465.481649:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572465.481652:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e800, rc 0) 00010000:00000080:0.0:1788572465.481659:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36ef8000 x1875444569544448/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:126/0 lens 656/608 e 0 to 0 dl 1788572476 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788572465.481719:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164265:x1875444569544448:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1339us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572465.481726:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1213 00000100:00100000:1.0:1788572465.487583:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.487710:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569544704 00000100:00100000:0.0:1788572465.487722:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569544704 00000100:00100000:0.0:1788572465.487787:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1214 00000100:00100000:0.0:1788572465.487799:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:164265:x1875444569544704:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572465.487827:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572465.487861:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109beef3 lrc: 2/0,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb511 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572465.489630:0:188049:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1703us 00000004:00200000:1.0:1788572465.541874:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x16:0x0]: returning size 4096 00010000:00010000:1.0:1788572465.542148:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109beef3 lrc: 1/0,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb511 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.542166:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3f200) 00010000:00010000:1.0:1788572465.542169:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572465.542175:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109beef3 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb511 expref: 8 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.542196:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117ee00, rc 0) 00000100:00100000:1.0:1788572465.542267:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164265:x1875444569544704:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 54470us (54698us total) trans 25769803777 rc 301/301 00000100:00100000:1.0:1788572465.542276:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1214 00000100:00100000:3.0:1788572465.550581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572465.550990:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569544960 00000100:00100000:1.0:1788572465.551001:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569544960 00000100:00100000:1.0:1788572465.551062:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 36 00000100:00100000:1.0:1788572465.551073:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164265:x1875444569544960:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:1.0:1788572465.551350:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164265:x1875444569544960:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 268us (768us total) trans 25769803778 rc 0/0 00000100:00100000:1.0:1788572465.551359:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 36 00000100:00100000:1.0:1788572465.583245:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.583345:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569545216 00000100:00100000:0.0:1788572465.583355:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569545216 00000100:00100000:0.0:1788572465.583419:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1215 00000100:00100000:0.0:1788572465.583431:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164272:x1875444569545216:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572465.583454:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572465.583517:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bef01 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb518 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572465.583679:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID:198183:1875444584432256:0@lo:900:mdt00_005.0 00000100:00100000:0.0:1788572465.583728:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572465.583755:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a053bb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572465.583917:0:188059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584432256 00000100:00100000:1.0:1788572465.583922:0:188059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584432256 00000100:00100000:1.0:1788572465.583960:0:188059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788572465.583979:0:188059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:198183:x1875444584432256:12345-0@lo:900:mdt00_005.0 00010000:00000080:1.0:1788572465.584003:0:188059:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1f8fe300 x1875444584432256/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:126/0 lens 264/248 e 0 to 0 dl 1788572476 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572465.584148:0:188059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:198183:x1875444584432256:12345-0@lo:900:mdt00_005.0 Request processed in 171us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572465.584157:0:188059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788572465.585095:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID:198183:1875444584432256:0@lo:900:mdt00_005.0 00000100:00100000:2.0:1788572465.585301:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24544a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584432384:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1788572465.585353:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572465.585426:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f3d3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572465.585475:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584432384 00000100:00100000:0.0:1788572465.585735:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584432384 00000100:00100000:2.0:1788572465.587128:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1788572465.587142:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198183:x1875444584432384:12345-0@lo:1000:mdt00_005.0 00010000:00000080:2.0:1788572465.587212:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a24546680 x1875444584432384/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:126/0 lens 304/4320 e 0 to 0 dl 1788572476 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572465.587295:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198183:x1875444584432384:12345-0@lo:1000:mdt00_005.0 Request processed in 156us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572465.587303:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1788572465.587376:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24544a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584432384:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1788572465.587454:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.587464:0:198183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.587473:0:198183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572465.587534:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584432512:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1788572465.587565:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572465.590716:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584432512 00000100:00100000:3.0:1788572465.590731:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584432512 00000100:00100000:3.0:1788572465.590786:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1788572465.590796:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:198183:x1875444584432512:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1788572465.590815:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572465.590838:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bef0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bef08 expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.590993:0:189111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bef0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bef08 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.591008:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bef0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bef08 expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.591021:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:3.0:1788572465.591023:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788572465.591027:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf400, rc 0) 00010000:00000080:3.0:1788572465.591033:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1f8ff480 x1875444584432512/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:126/0 lens 328/344 e 0 to 0 dl 1788572476 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572465.591090:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:198183:x1875444584432512:12345-0@lo:101:mdt00_005.0 Request processed in 296us (3525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572465.591095:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1788572465.591307:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a053bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572465.591336:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584432512:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1788572465.591354:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bef0f expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.591367:0:198183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bef0f expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572465.591389:0:198183:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788572465.591396:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bef0f expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.591403:0:198183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bef0f expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.591712:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.591721:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.591733:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.591747:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.591754:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.591760:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572465.592058:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584432640:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572465.592102:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572465.592129:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a053bb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572465.593126:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584432640 00000100:00100000:3.0:1788572465.593139:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584432640 00000100:00100000:3.0:1788572465.593264:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1788572465.593274:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:198183:x1875444584432640:12345-0@lo:1000:mdt00_005.0 00010000:00000080:3.0:1788572465.593320:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1f8fce00 x1875444584432640/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:126/0 lens 328/4320 e 0 to 0 dl 1788572476 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572465.593381:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:198183:x1875444584432640:12345-0@lo:1000:mdt00_005.0 Request processed in 109us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572465.593388:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1788572465.593731:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1f8fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584432640:0@lo:1000:mdt00_005.0 00000004:00080000:0.0:1788572465.594470:0:198183:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x24c:0x0], count =22 00000004:00080000:0.0:1788572465.595830:0:198183:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x24c:0x0]+22 in llog 00000004:00080000:0.0:1788572465.595876:0:198183:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x262:0x0], index 0: 0 00010000:00010000:0.0:1788572465.596129:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bef24 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596146:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bef24 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596168:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bef24 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596201:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596208:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596215:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596221:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572465.596226:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596238:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596249:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3f500) 00010000:00010000:0.0:1788572465.596252:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572465.596257:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596264:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bef16 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572465.596278:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005eb009e4 reply state 000000002296b3fd transno 25769803779 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596288:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596295:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x679fc7b1 (ffff8e5a18b3fb00) 00010000:00010000:0.0:1788572465.596297:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572465.596300:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572465.596333:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109bef01 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb518 expref: 11 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596353:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bef24 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb518 expref: 10 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.596360:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x17:0x0].0x0 (ffff8e5a18b3f800) 00010000:00010000:0.0:1788572465.596363:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572465.596365:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e000, rc 0) 00000100:00100000:0.0:1788572465.596432:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164272:x1875444569545216:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 13003us (13196us total) trans 25769803779 rc 0/0 00000100:00100000:0.0:1788572465.596442:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1215 00000100:00100000:3.0:1788572465.609591:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.609772:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569545472 00000100:00100000:0.0:1788572465.609783:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569545472 00000100:00100000:0.0:1788572465.609832:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 37 00000100:00100000:0.0:1788572465.609843:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164272:x1875444569545472:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572465.610131:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:164272:x1875444569545472:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 289us (549us total) trans 25769803780 rc 0/0 00000100:00100000:0.0:1788572465.610140:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 37 00000100:00100000:3.0:1788572465.612667:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.612796:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569545728 00000100:00100000:0.0:1788572465.612805:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569545728 00000100:00100000:0.0:1788572465.612850:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1216 00000100:00100000:0.0:1788572465.612859:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:164272:x1875444569545728:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572465.612886:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572465.612912:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bef32 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb51f expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613034:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613049:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613061:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613073:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x94c295fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613081:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613087:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572465.613373:0:188048:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x24c:0x0], count =22 00000004:00080000:0.0:1788572465.613379:0:188048:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x24c:0x0]+22 in llog 00000004:00080000:0.0:1788572465.613388:0:188048:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x262:0x0], index 1: 0 00010000:00010000:0.0:1788572465.613677:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bef47 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613687:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bef47 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613695:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bef47 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613725:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613732:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613739:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613746:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613751:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ec00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572465.613756:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613764:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613774:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3f000) 00010000:00010000:0.0:1788572465.613777:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572465.613782:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613788:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bef39 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572465.613802:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3c812d8 reply state 00000000a4627ab2 transno 25769803781 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613812:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613818:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x94c295fa (ffff8e5a18b3fc00) 00010000:00010000:0.0:1788572465.613820:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572465.613823:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572465.613848:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bef32 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb51f expref: 15 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613867:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bef47 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb51f expref: 14 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.613875:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x18:0x0].0x0 (ffff8e5a18b3f900) 00010000:00010000:0.0:1788572465.613877:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572465.613880:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117fa00, rc 0) 00000100:00100000:0.0:1788572465.613948:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:164272:x1875444569545728:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1089us (1288us total) trans 25769803781 rc 0/0 00000100:00100000:0.0:1788572465.613956:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1216 00000100:00100000:1.0:1788572465.619612:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.619758:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569545984 00000100:00100000:0.0:1788572465.619769:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569545984 00000100:00100000:0.0:1788572465.619826:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 38 00000100:00100000:0.0:1788572465.619835:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:164272:x1875444569545984:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572465.620380:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+16:164272:x1875444569545984:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 544us (776us total) trans 25769803782 rc 0/0 00000100:00100000:0.0:1788572465.620389:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 38 00000100:00100000:3.0:1788572465.635066:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572465.635177:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569546240 00000100:00100000:1.0:1788572465.635187:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569546240 00000100:00100000:1.0:1788572465.635247:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1217 00000100:00100000:1.0:1788572465.635257:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+16:164272:x1875444569546240:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:1.0:1788572465.635281:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572465.635305:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bef55 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb526 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.635722:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.635739:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.635752:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.635764:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.635771:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.635780:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572465.636107:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x263:0x0], index 0: 0 00010000:00010000:1.0:1788572465.636325:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bef6a lrc: 3/1,0 mode: --/PR res: [0x240002729:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636335:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bef6a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636343:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bef6a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636373:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636380:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636387:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636393:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572465.636397:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636404:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636415:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:1.0:1788572465.636418:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572465.636424:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636430:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bef5c lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572465.636443:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058d9db67 reply state 000000009f0348e4 transno 25769803783 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636453:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636459:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xc1e56442 (ffff8e590b3b4f00) 00010000:00010000:1.0:1788572465.636461:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572465.636463:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572465.636885:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bef55 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb526 expref: 19 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636908:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bef6a lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb526 expref: 18 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.636917:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x19:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572465.636919:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572465.636922:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf600, rc 0) 00000100:00100000:1.0:1788572465.637001:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+19:164272:x1875444569546240:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1744us (1943us total) trans 25769803783 rc 0/0 00000100:00100000:1.0:1788572465.637009:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1217 00000100:00100000:2.0:1788572465.649420:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.649655:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569546496 00000100:00100000:0.0:1788572465.649665:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569546496 00000100:00100000:0.0:1788572465.649726:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 39 00000100:00100000:0.0:1788572465.649736:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+19:164272:x1875444569546496:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572465.650061:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+20:164272:x1875444569546496:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 326us (651us total) trans 25769803784 rc 0/0 00000100:00100000:0.0:1788572465.650070:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 39 00000100:00100000:2.0:1788572465.658272:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572465.658564:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569546752 00000100:00100000:3.0:1788572465.658575:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569546752 00000100:00100000:3.0:1788572465.658655:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1218 00000100:00100000:3.0:1788572465.658667:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+20:164272:x1875444569546752:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572465.658693:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572465.658721:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bef78 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb52d expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.658830:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.658845:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.659139:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.659166:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xef08328a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.659175:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.659183:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572465.663088:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x263:0x0], index 1: 0 00010000:00010000:2.0:1788572465.664263:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bef8d lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664283:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bef8d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664296:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bef8d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664336:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664343:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664350:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664357:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664363:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572465.664368:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664376:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664392:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590d91e900) 00010000:00010000:2.0:1788572465.664395:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572465.664400:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664407:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bef7f lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572465.664423:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009de258b6 reply state 00000000478d8379 transno 25769803785 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664433:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.664440:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xef08328a (ffff8e590d91e200) 00010000:00010000:2.0:1788572465.664443:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572465.664445:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572465.665806:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bef78 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb52d expref: 23 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.665850:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bef8d lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb52d expref: 22 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.665872:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1a:0x0].0x0 (ffff8e5a18bebd00) 00010000:00010000:2.0:1788572465.665875:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572465.665878:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7aa00, rc 0) 00000100:00100000:2.0:1788572465.665978:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+23:164272:x1875444569546752:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 7301us (7707us total) trans 25769803785 rc 0/0 00000100:00100000:2.0:1788572465.665987:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1218 00000100:00100000:0.0:1788572465.686096:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.686267:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569547008 00000100:00100000:2.0:1788572465.686277:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569547008 00000100:00100000:2.0:1788572465.686344:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 40 00000100:00100000:2.0:1788572465.686355:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+23:164272:x1875444569547008:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572465.686699:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+24:164272:x1875444569547008:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 345us (619us total) trans 25769803786 rc 0/0 00000100:00100000:2.0:1788572465.686707:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 40 00000100:00100000:1.0:1788572465.694706:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.695082:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569547264 00000100:00100000:0.0:1788572465.695094:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569547264 00000100:00100000:0.0:1788572465.695166:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1219 00000100:00100000:0.0:1788572465.695175:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+24:164272:x1875444569547264:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572465.695200:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572465.695223:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bef9b lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb534 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.695329:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.695344:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.695356:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.695369:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.695376:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.695383:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572465.695899:0:188048:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x264:0x0], index 0: 0 00010000:00010000:1.0:1788572465.697760:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109befb0 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697790:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109befb0 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697801:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109befb0 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697842:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697850:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697856:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697863:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697868:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ec00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572465.697873:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697879:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697891:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3f000) 00010000:00010000:1.0:1788572465.697894:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572465.697899:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697907:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109befa2 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572465.697926:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0c61df6 reply state 000000007b6e8795 transno 25769803787 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697938:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.697944:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x1c2b00d3 (ffff8e5a18b3f500) 00010000:00010000:1.0:1788572465.697946:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572465.697949:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572465.698000:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bef9b lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb534 expref: 27 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.698022:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109befb0 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb534 expref: 26 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.698030:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1b:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:1.0:1788572465.698032:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572465.698035:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcfe00, rc 0) 00000100:00100000:1.0:1788572465.698121:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+27:164272:x1875444569547264:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 2946us (3424us total) trans 25769803787 rc 0/0 00000100:00100000:1.0:1788572465.698131:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1219 00000100:00100000:3.0:1788572465.707820:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.708135:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569547520 00000100:00100000:2.0:1788572465.708146:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569547520 00000100:00100000:2.0:1788572465.708200:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 41 00000100:00100000:2.0:1788572465.708209:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+27:164272:x1875444569547520:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572465.708561:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+28:164272:x1875444569547520:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 352us (750us total) trans 25769803788 rc 0/0 00000100:00100000:2.0:1788572465.708570:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 41 00000100:00100000:0.0:1788572465.713367:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572465.713465:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569547776 00000100:00100000:1.0:1788572465.713504:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569547776 00000100:00100000:1.0:1788572465.713586:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1220 00000100:00100000:1.0:1788572465.713598:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+28:164272:x1875444569547776:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:1.0:1788572465.713625:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572465.713662:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109befbe lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb53b expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.713773:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.713790:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.713802:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.713816:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.713822:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.713829:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572465.714475:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x264:0x0], index 1: 0 00010000:00010000:1.0:1788572465.715080:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109befd3 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715285:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109befd3 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715299:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109befd3 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715347:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715359:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715366:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715372:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572465.715377:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715384:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715397:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:1.0:1788572465.715401:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572465.715406:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715413:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109befc5 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572465.715432:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e079247d reply state 00000000d3e7dd21 transno 25769803789 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715444:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.715451:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x494dcf1b (ffff8e590b3b4300) 00010000:00010000:1.0:1788572465.715453:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572465.715456:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572465.716125:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109befbe lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb53b expref: 31 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.716150:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109befd3 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb53b expref: 30 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.716158:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1c:0x0].0x0 (ffff8e590b3b4d00) 00010000:00010000:1.0:1788572465.716160:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572465.716162:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf800, rc 0) 00000100:00100000:1.0:1788572465.716241:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+31:164272:x1875444569547776:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 2645us (2884us total) trans 25769803789 rc 0/0 00000100:00100000:1.0:1788572465.716249:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1220 00000100:00100000:0.0:1788572465.724139:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.724226:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569548032 00000100:00100000:2.0:1788572465.724240:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569548032 00000100:00100000:2.0:1788572465.724361:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 42 00000100:00100000:2.0:1788572465.724373:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+31:164272:x1875444569548032:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572465.724735:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+32:164272:x1875444569548032:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 364us (606us total) trans 25769803790 rc 0/0 00000100:00100000:2.0:1788572465.724743:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 42 00000100:00100000:2.0:1788572465.729624:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.730057:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569548288 00000100:00100000:0.0:1788572465.730067:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569548288 00000100:00100000:0.0:1788572465.730143:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1221 00000100:00100000:0.0:1788572465.730156:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+32:164272:x1875444569548288:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572465.730186:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572465.730211:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109befe1 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb542 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.730337:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.730353:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.730369:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.730383:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x76709d63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.730390:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.730395:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572465.732128:0:198183:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x265:0x0], index 0: 0 00010000:00010000:0.0:1788572465.732304:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109beff6 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732318:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109beff6 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732328:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109beff6 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732363:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732374:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732380:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732384:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572465.732388:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732395:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732406:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3fa00) 00010000:00010000:0.0:1788572465.732409:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572465.732414:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732420:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109befe8 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572465.732433:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f7c3968 reply state 00000000ac7c4147 transno 25769803791 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732444:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.732449:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x76709d63 (ffff8e5a18b3f300) 00010000:00010000:0.0:1788572465.732451:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572465.732454:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572465.732938:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109befe1 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb542 expref: 35 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.733042:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109beff6 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb542 expref: 34 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.733053:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1d:0x0].0x0 (ffff8e5a18b3f000) 00010000:00010000:0.0:1788572465.733055:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572465.733058:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e200, rc 0) 00000100:00100000:0.0:1788572465.733287:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+35:164272:x1875444569548288:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 3132us (3670us total) trans 25769803791 rc 0/0 00000100:00100000:0.0:1788572465.733298:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1221 00000100:00100000:3.0:1788572465.748948:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.749132:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569548544 00000100:00100000:0.0:1788572465.749143:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569548544 00000100:00100000:0.0:1788572465.749213:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 43 00000100:00100000:0.0:1788572465.749228:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+35:164272:x1875444569548544:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572465.750097:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+36:164272:x1875444569548544:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 871us (1157us total) trans 25769803792 rc 0/0 00000100:00100000:0.0:1788572465.750106:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 43 00000100:00100000:1.0:1788572465.754050:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.754333:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569548800 00000100:00100000:0.0:1788572465.754344:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569548800 00000100:00100000:0.0:1788572465.754402:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1222 00000100:00100000:0.0:1788572465.754414:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+36:164272:x1875444569548800:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572465.754442:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572465.754467:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf004 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb549 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.754791:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.754806:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.754819:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.754833:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xa3936bac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.754840:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.754847:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572465.755355:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x265:0x0], index 1: 0 00010000:00010000:0.0:1788572465.755939:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf019 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.755952:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf019 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.755961:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf019 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756076:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756088:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756096:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756102:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572465.756106:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756113:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756126:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3fa00) 00010000:00010000:0.0:1788572465.756130:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572465.756135:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756143:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf00b lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572465.756219:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2475248 reply state 000000005a406a92 transno 25769803793 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756232:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756238:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xa3936bac (ffff8e5a18b3f200) 00010000:00010000:0.0:1788572465.756241:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572465.756244:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572465.756278:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf004 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb549 expref: 39 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756299:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf019 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb549 expref: 38 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.756307:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1e:0x0].0x0 (ffff8e5a18b3ff00) 00010000:00010000:0.0:1788572465.756309:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572465.756312:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117fc00, rc 0) 00000100:00100000:0.0:1788572465.756451:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+39:164272:x1875444569548800:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 2038us (2410us total) trans 25769803793 rc 0/0 00000100:00100000:0.0:1788572465.756459:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1222 00000100:00100000:2.0:1788572465.764922:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.765410:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569549056 00000100:00100000:0.0:1788572465.765421:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569549056 00000100:00100000:0.0:1788572465.765473:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 44 00000100:00100000:0.0:1788572465.765517:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+39:164272:x1875444569549056:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572465.765830:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+40:164272:x1875444569549056:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 315us (915us total) trans 25769803794 rc 0/0 00000100:00100000:0.0:1788572465.765841:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 44 00000100:00100000:0.0:1788572465.769917:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572465.774322:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569549312 00000100:00100000:1.0:1788572465.774336:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569549312 00000100:00100000:1.0:1788572465.774417:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1223 00000100:00100000:1.0:1788572465.774428:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+40:164272:x1875444569549312:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:1.0:1788572465.774452:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572465.774474:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bf027 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb550 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.774745:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.774760:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.774771:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.774790:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.774797:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.774803:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572465.775701:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x266:0x0], index 0: 0 00010000:00010000:1.0:1788572465.775851:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109bf03c lrc: 3/1,0 mode: --/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776219:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109bf03c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776231:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109bf03c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776269:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776276:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776282:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776288:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572465.776293:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776304:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776316:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:1.0:1788572465.776319:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572465.776323:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776329:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf02e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572465.776342:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004626a680 reply state 0000000088888fb3 transno 25769803795 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776353:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776359:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xd0b639f4 (ffff8e590b3b4700) 00010000:00010000:1.0:1788572465.776361:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572465.776364:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572465.776397:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bf027 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb550 expref: 43 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776417:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109bf03c lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb550 expref: 42 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.776425:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1f:0x0].0x0 (ffff8e590b3b4200) 00010000:00010000:1.0:1788572465.776428:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572465.776430:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255600, rc 0) 00000100:00100000:1.0:1788572465.777885:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+43:164272:x1875444569549312:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 3448us (8029us total) trans 25769803795 rc 0/0 00000100:00100000:1.0:1788572465.777898:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1223 00000100:00100000:2.0:1788572465.780593:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.788200:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569549568 00000100:00100000:0.0:1788572465.788219:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569549568 00010000:00010000:1.0:1788572465.788732:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572465.788836:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 45 00000100:00100000:2.0:1788572465.788847:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+43:164272:x1875444569549568:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572465.789349:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+44:164272:x1875444569549568:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 502us (8765us total) trans 25769803796 rc 0/0 00000100:00100000:2.0:1788572465.789358:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 45 00000100:00100000:0.0:1788572465.795665:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.795749:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569549824 00000100:00100000:2.0:1788572465.795760:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569549824 00000100:00100000:2.0:1788572465.795823:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1224 00000100:00100000:2.0:1788572465.795833:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+44:164272:x1875444569549824:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572465.795867:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572465.795891:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf04a lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb557 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796008:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796021:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796032:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796044:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796050:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796056:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572465.796383:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x266:0x0], index 1: 0 00010000:00010000:2.0:1788572465.796559:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf05f lrc: 3/1,0 mode: --/PR res: [0x240002729:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796567:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf05f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796576:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf05f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796609:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796616:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796622:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796628:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796634:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572465.796638:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796646:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796657:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18beb800) 00010000:00010000:2.0:1788572465.796660:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572465.796664:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796671:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf051 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572465.796683:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049ffbabd reply state 000000007be081d3 transno 25769803797 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796693:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796700:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xfdd9083c (ffff8e5a18bebf00) 00010000:00010000:2.0:1788572465.796703:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572465.796705:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572465.796732:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf04a lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb557 expref: 47 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796750:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf05f lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb557 expref: 46 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.796758:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x20:0x0].0x0 (ffff8e5a18beb900) 00010000:00010000:2.0:1788572465.796761:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572465.796763:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7a000, rc 0) 00000100:00100000:2.0:1788572465.796820:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+47:164272:x1875444569549824:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 989us (1166us total) trans 25769803797 rc 0/0 00000100:00100000:2.0:1788572465.796827:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1224 00000100:00100000:0.0:1788572465.804209:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.804306:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569550080 00000100:00100000:2.0:1788572465.804317:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569550080 00000100:00100000:2.0:1788572465.804376:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 46 00000100:00100000:2.0:1788572465.804388:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+47:164272:x1875444569550080:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572465.804876:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+48:164272:x1875444569550080:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 489us (676us total) trans 25769803798 rc 0/0 00000100:00100000:2.0:1788572465.804884:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 46 00000100:00100000:1.0:1788572465.809476:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.810238:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569550336 00000100:00100000:2.0:1788572465.810250:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569550336 00000100:00100000:2.0:1788572465.810313:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1225 00000100:00100000:2.0:1788572465.810325:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+48:164272:x1875444569550336:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572465.810350:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572465.810374:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf06d lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb55e expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.810790:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.810805:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.810817:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.810832:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.810839:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.810846:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572465.811416:0:188048:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x267:0x0], index 0: 0 00010000:00010000:2.0:1788572465.811750:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109bf082 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811762:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109bf082 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811771:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109bf082 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811804:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811810:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811815:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811822:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811828:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572465.811833:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811840:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811851:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18beb800) 00010000:00010000:2.0:1788572465.811918:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572465.811925:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811932:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf074 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572465.811946:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087828998 reply state 00000000dda7aa21 transno 25769803799 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811957:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.811963:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x1b7026cc (ffff8e5a18beb700) 00010000:00010000:2.0:1788572465.812223:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572465.812226:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572465.812264:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf06d lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb55e expref: 51 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.812290:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109bf082 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb55e expref: 50 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.812298:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x21:0x0].0x0 (ffff8e5a18beb600) 00010000:00010000:2.0:1788572465.812300:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572465.812303:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7be00, rc 0) 00000100:00100000:2.0:1788572465.812445:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+51:164272:x1875444569550336:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 2122us (2978us total) trans 25769803799 rc 0/0 00000100:00100000:2.0:1788572465.812453:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1225 00000100:00100000:0.0:1788572465.818162:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.818278:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569550592 00000100:00100000:2.0:1788572465.818290:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569550592 00000100:00100000:2.0:1788572465.818359:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 47 00000100:00100000:2.0:1788572465.818370:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+51:164272:x1875444569550592:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572465.818697:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+52:164272:x1875444569550592:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 328us (544us total) trans 25769803800 rc 0/0 00000100:00100000:2.0:1788572465.818706:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 47 00000100:00100000:2.0:1788572465.825355:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.826099:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569550848 00000100:00100000:0.0:1788572465.826112:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569550848 00000100:00100000:0.0:1788572465.826181:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1226 00000100:00100000:0.0:1788572465.826192:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+52:164272:x1875444569550848:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572465.826217:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572465.826241:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf090 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb565 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.826359:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.826373:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.826384:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.826397:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.826405:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.826411:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572465.826922:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x267:0x0], index 1: 0 00010000:00010000:1.0:1788572465.827066:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109bf0a5 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827076:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109bf0a5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827084:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109bf0a5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827113:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827120:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827126:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827132:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572465.827135:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827143:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827166:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3fa00) 00010000:00010000:1.0:1788572465.827170:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572465.827175:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827181:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf097 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572465.827193:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4d0a4e2 reply state 00000000fb040ad2 transno 25769803801 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827203:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827208:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x3e3e6f26 (ffff8e590430c000) 00010000:00010000:1.0:1788572465.827210:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572465.827213:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572465.827238:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf090 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb565 expref: 55 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827255:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109bf0a5 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb565 expref: 54 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.827262:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x22:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:1.0:1788572465.827264:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572465.827266:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255000, rc 0) 00000100:00100000:1.0:1788572465.827333:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+55:164272:x1875444569550848:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1142us (1988us total) trans 25769803801 rc 0/0 00000100:00100000:1.0:1788572465.827340:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1226 00000100:00100000:1.0:1788572465.830730:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.830955:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569551104 00000100:00100000:0.0:1788572465.830975:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569551104 00000100:00100000:0.0:1788572465.831043:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 48 00000100:00100000:0.0:1788572465.831055:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+55:164272:x1875444569551104:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572465.831382:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+56:164272:x1875444569551104:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 329us (660us total) trans 25769803802 rc 0/0 00000100:00100000:0.0:1788572465.831392:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 48 00000100:00100000:0.0:1788572465.835548:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.835758:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569551360 00000100:00100000:2.0:1788572465.835769:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569551360 00000100:00100000:2.0:1788572465.835827:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1227 00000100:00100000:2.0:1788572465.835836:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+56:164272:x1875444569551360:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572465.835872:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572465.835893:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf0b3 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb56c expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.836006:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.836021:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.836034:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.836047:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x610cb780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.836054:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.836061:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572465.836409:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x268:0x0], index 0: 0 00010000:00010000:2.0:1788572465.836964:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109bf0c8 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.836989:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109bf0c8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.836997:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109bf0c8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837032:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837040:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837045:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837051:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837057:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572465.837061:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837069:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837081:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18beb800) 00010000:00010000:2.0:1788572465.837085:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572465.837090:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837095:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf0ba lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572465.837108:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc9f515a reply state 00000000ba5a9a64 transno 25769803803 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837119:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837125:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x610cb780 (ffff8e5a18beb300) 00010000:00010000:2.0:1788572465.837127:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572465.837130:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572465.837219:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf0b3 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb56c expref: 59 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837240:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109bf0c8 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb56c expref: 58 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.837247:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x23:0x0].0x0 (ffff8e5a18bebc00) 00010000:00010000:2.0:1788572465.837250:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572465.837252:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5904a7b600, rc 0) 00000100:00100000:2.0:1788572465.837321:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+59:164272:x1875444569551360:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1485us (1791us total) trans 25769803803 rc 0/0 00000100:00100000:2.0:1788572465.837330:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1227 00000100:00100000:3.0:1788572465.839902:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.840130:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569551616 00000100:00100000:0.0:1788572465.840139:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569551616 00000100:00100000:0.0:1788572465.840204:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 49 00000100:00100000:0.0:1788572465.840214:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+59:164272:x1875444569551616:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572465.840565:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+60:164272:x1875444569551616:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 351us (669us total) trans 25769803804 rc 0/0 00000100:00100000:0.0:1788572465.840573:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 49 00000100:00100000:1.0:1788572465.846362:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.846466:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569551872 00000100:00100000:0.0:1788572465.846532:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569551872 00000100:00100000:0.0:1788572465.846595:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1228 00000100:00100000:0.0:1788572465.846606:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+60:164272:x1875444569551872:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572465.846629:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572465.846652:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf0d6 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb573 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.846761:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.846776:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.846787:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.846800:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.846807:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.846812:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572465.847458:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x268:0x0], index 1: 0 00010000:00010000:1.0:1788572465.847646:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf0eb lrc: 3/1,0 mode: --/PR res: [0x240002729:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847658:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf0eb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847667:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf0eb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847700:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847708:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847715:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847721:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572465.847725:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847732:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847744:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590430cb00) 00010000:00010000:1.0:1788572465.847747:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572465.847751:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847757:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf0dd lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572465.847775:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a142231 reply state 0000000053742cd7 transno 25769803805 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847786:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847793:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x83daffd9 (ffff8e590430c600) 00010000:00010000:1.0:1788572465.847795:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572465.847798:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572465.847828:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf0d6 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb573 expref: 63 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.847848:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf0eb lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb573 expref: 62 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.848041:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x24:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:1.0:1788572465.848044:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572465.848046:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255c00, rc 0) 00000100:00100000:1.0:1788572465.848187:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+63:164272:x1875444569551872:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1582us (1834us total) trans 25769803805 rc 0/0 00000100:00100000:1.0:1788572465.848196:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1228 00000100:00100000:1.0:1788572465.858596:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572465.858765:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569552128 00000100:00100000:3.0:1788572465.858777:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569552128 00000100:00100000:3.0:1788572465.858846:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 50 00000100:00100000:3.0:1788572465.858866:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+63:164272:x1875444569552128:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572465.859200:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+64:164272:x1875444569552128:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 345us (613us total) trans 25769803806 rc 0/0 00000100:00100000:3.0:1788572465.859214:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 50 00000100:00100000:3.0:1788572465.868927:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572465.869083:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569552384 00000100:00100000:1.0:1788572465.869096:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569552384 00000100:00100000:1.0:1788572465.869170:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1229 00000100:00100000:1.0:1788572465.869182:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+64:164272:x1875444569552384:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:1.0:1788572465.869207:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572465.869235:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109bf0f9 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb57a expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.869344:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.869359:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.869371:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.869385:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.869393:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.869400:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572465.870038:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x269:0x0], index 0: 0 00010000:00010000:1.0:1788572465.870184:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf10e lrc: 3/1,0 mode: --/PR res: [0x240002729:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870194:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf10e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870202:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf10e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870235:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870243:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870250:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870256:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572465.870260:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870266:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870277:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4600) 00010000:00010000:1.0:1788572465.870280:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572465.870285:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870290:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf100 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572465.870305:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1f1e318 reply state 00000000cb639757 transno 25769803807 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870315:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870321:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xa6a94833 (ffff8e590b3b4e00) 00010000:00010000:1.0:1788572465.870324:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572465.870326:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572465.870359:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109bf0f9 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb57a expref: 67 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870377:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf10e lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb57a expref: 66 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.870384:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x25:0x0].0x0 (ffff8e590b3b4a00) 00010000:00010000:1.0:1788572465.870386:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572465.870388:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254a00, rc 0) 00000100:00100000:1.0:1788572465.871743:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+67:164272:x1875444569552384:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 2555us (2816us total) trans 25769803807 rc 0/0 00000100:00100000:1.0:1788572465.871756:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1229 00000100:00100000:1.0:1788572465.884876:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572465.885051:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569552640 00000100:00100000:3.0:1788572465.885062:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569552640 00000100:00100000:3.0:1788572465.885124:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 51 00000100:00100000:3.0:1788572465.885135:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+67:164272:x1875444569552640:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572465.885417:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+68:164272:x1875444569552640:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 284us (562us total) trans 25769803808 rc 0/0 00000100:00100000:3.0:1788572465.885426:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 51 00000100:00100000:1.0:1788572465.888310:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.888455:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569552896 00000100:00100000:2.0:1788572465.888464:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569552896 00000100:00100000:2.0:1788572465.888572:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1230 00000100:00100000:2.0:1788572465.888582:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+68:164272:x1875444569552896:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572465.888605:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572465.888629:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf11c lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb581 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.888741:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.888754:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.888766:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.888777:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xc977908d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.888783:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.888789:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572465.889350:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x269:0x0], index 1: 0 00010000:00010000:3.0:1788572465.889831:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf131 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.889845:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf131 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.889864:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf131 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.889905:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.889912:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.889919:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.889925:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.889936:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572465.889940:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.889947:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.889959:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18beb800) 00010000:00010000:3.0:1788572465.889961:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572465.889997:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.890004:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf123 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572465.890018:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049469771 reply state 000000009528cb6f transno 25769803809 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.890028:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.890035:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xc977908d (ffff8e5a18beb100) 00010000:00010000:3.0:1788572465.890038:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572465.890041:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572465.890077:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf11c lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb581 expref: 71 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.890098:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf131 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb581 expref: 70 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.890109:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x26:0x0].0x0 (ffff8e590d91eb00) 00010000:00010000:3.0:1788572465.890111:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572465.890114:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcea00, rc 0) 00000100:00100000:3.0:1788572465.890198:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+71:164272:x1875444569552896:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1617us (1898us total) trans 25769803809 rc 0/0 00000100:00100000:3.0:1788572465.890207:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1230 00000100:00100000:2.0:1788572465.894174:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572465.894299:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569553152 00000100:00100000:3.0:1788572465.894309:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569553152 00000100:00100000:3.0:1788572465.894369:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 52 00000100:00100000:3.0:1788572465.894380:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+71:164272:x1875444569553152:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572465.894920:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+72:164272:x1875444569553152:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 540us (763us total) trans 25769803810 rc 0/0 00000100:00100000:3.0:1788572465.894929:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 52 00000100:00100000:1.0:1788572465.898258:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.898682:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569553408 00000100:00100000:2.0:1788572465.898692:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569553408 00000100:00100000:2.0:1788572465.899081:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1231 00000100:00100000:2.0:1788572465.899095:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+72:164272:x1875444569553408:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:2.0:1788572465.899121:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572465.899145:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf13f lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb588 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.899271:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.899286:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.899298:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.899313:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.899320:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572465.899327:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572465.900008:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x26a:0x0], index 0: 0 00010000:00010000:3.0:1788572465.900178:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109bf154 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900189:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109bf154 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900197:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109bf154 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900229:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900236:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900244:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900250:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ba00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572465.900254:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900262:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900274:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18beb000) 00010000:00010000:3.0:1788572465.900277:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572465.900282:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900288:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf146 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572465.900304:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b9049b7 reply state 0000000033a061c7 transno 25769803811 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900316:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900322:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xec45d8e7 (ffff8e5a18beb200) 00010000:00010000:3.0:1788572465.900325:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572465.900328:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572465.900357:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf13f lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb588 expref: 75 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900382:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109bf154 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb588 expref: 74 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.900390:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x27:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:3.0:1788572465.900392:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572465.900395:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce000, rc 0) 00000100:00100000:3.0:1788572465.900471:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+75:164272:x1875444569553408:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1380us (2223us total) trans 25769803811 rc 0/0 00000100:00100000:3.0:1788572465.900758:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1231 00000100:00100000:1.0:1788572465.903210:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572465.903350:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569553664 00000100:00100000:2.0:1788572465.903360:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569553664 00000100:00100000:2.0:1788572465.903413:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 53 00000100:00100000:2.0:1788572465.903425:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+75:164272:x1875444569553664:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:2.0:1788572465.903948:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+76:164272:x1875444569553664:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 524us (745us total) trans 25769803812 rc 0/0 00000100:00100000:2.0:1788572465.903955:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 53 00000100:00100000:2.0:1788572465.908251:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572465.908398:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569553920 00000100:00100000:1.0:1788572465.908408:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569553920 00000100:00100000:1.0:1788572465.908521:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1232 00000100:00100000:1.0:1788572465.908734:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+76:164272:x1875444569553920:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:1.0:1788572465.908761:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572465.908785:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254e00/0x265cfe11109bf162 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb58f expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.908990:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.909006:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.909019:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.909033:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xf142140 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.909041:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.909048:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572465.909426:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x26a:0x0], index 1: 0 00010000:00010000:1.0:1788572465.909800:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109bf177 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.909811:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109bf177 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.909820:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109bf177 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.909853:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910083:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910091:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910097:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572465.910102:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910111:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910123:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4600) 00010000:00010000:1.0:1788572465.910126:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572465.910131:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910137:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf169 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572465.910152:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb96381f reply state 00000000aa2039e2 transno 25769803813 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910175:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910182:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xf142140 (ffff8e590b3b4000) 00010000:00010000:1.0:1788572465.910185:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572465.910188:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572465.910220:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254e00/0x265cfe11109bf162 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb58f expref: 79 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910242:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109bf177 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb58f expref: 78 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572465.910249:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x28:0x0].0x0 (ffff8e590b3b4100) 00010000:00010000:1.0:1788572465.910251:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572465.910254:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254c00, rc 0) 00000100:00100000:1.0:1788572465.910332:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+79:164272:x1875444569553920:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1801us (2090us total) trans 25769803813 rc 0/0 00000100:00100000:1.0:1788572465.910341:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1232 00000100:00100000:1.0:1788572465.920798:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572465.923105:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569554176 00000100:00100000:3.0:1788572465.923122:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569554176 00000100:00100000:3.0:1788572465.929062:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 54 00000100:00100000:3.0:1788572465.929086:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+79:164272:x1875444569554176:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572465.929713:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+80:164272:x1875444569554176:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 637us (8924us total) trans 25769803814 rc 0/0 00000100:00100000:3.0:1788572465.929723:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 54 00000100:00100000:2.0:1788572465.937378:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572465.937473:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569554432 00000100:00100000:0.0:1788572465.937533:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569554432 00000100:00100000:0.0:1788572465.937609:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1233 00000100:00100000:0.0:1788572465.937621:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+80:164272:x1875444569554432:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572465.937646:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572465.937671:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf185 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb596 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.937810:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.937823:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.937836:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.937848:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x31e2699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.937866:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.937874:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572465.938239:0:198183:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x26b:0x0], index 0: 0 00010000:00010000:0.0:1788572465.938388:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf19a lrc: 3/1,0 mode: --/PR res: [0x240002729:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938396:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf19a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938403:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf19a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938434:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938440:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938447:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938453:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572465.938457:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938464:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938474:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590430c800) 00010000:00010000:0.0:1788572465.938506:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572465.938512:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938523:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf18c lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572465.938536:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7928abd reply state 00000000a13465f8 transno 25769803815 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938547:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938553:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x31e2699a (ffff8e590430c400) 00010000:00010000:0.0:1788572465.938555:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572465.938558:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572465.938587:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf185 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb596 expref: 83 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938608:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf19a lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb596 expref: 82 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.938615:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x29:0x0].0x0 (ffff8e590430c500) 00010000:00010000:0.0:1788572465.938617:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572465.938620:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164fe00, rc 0) 00000100:00100000:0.0:1788572465.938677:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+83:164272:x1875444569554432:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 1058us (1309us total) trans 25769803815 rc 0/0 00000100:00100000:0.0:1788572465.938685:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1233 00000100:00100000:3.0:1788572465.949289:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572465.951674:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569554688 00000100:00100000:1.0:1788572465.951690:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569554688 00000100:00100000:1.0:1788572465.951758:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 55 00000100:00100000:1.0:1788572465.951770:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+83:164272:x1875444569554688:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572465.952115:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+84:164272:x1875444569554688:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 346us (2837us total) trans 25769803816 rc 0/0 00000100:00100000:1.0:1788572465.952123:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 55 00000100:00100000:1.0:1788572465.957826:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572465.957947:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569554944 00000100:00100000:3.0:1788572465.957957:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569554944 00000100:00100000:3.0:1788572465.958027:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1234 00000100:00100000:3.0:1788572465.958038:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+84:164272:x1875444569554944:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572465.958061:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572465.958087:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf1a8 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb59d expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.958188:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.958201:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.958212:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.958226:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.958232:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.958238:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572465.958698:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x26b:0x0], index 1: 0 00010000:00010000:3.0:1788572465.958834:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf1bd lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.958844:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf1bd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.958852:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf1bd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.959827:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.959840:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.959847:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.959853:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572465.960699:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.960710:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.960727:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590d91e800) 00010000:00010000:3.0:1788572465.960730:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572465.960735:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.960742:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf1af lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572465.960760:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d9404de reply state 000000000229086a transno 25769803817 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.960771:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572465.960779:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x54b0b1f4 (ffff8e590d91e400) 00010000:00010000:3.0:1788572465.960781:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572465.960785:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572465.961045:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf1a8 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb59d expref: 87 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.961072:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf1bd lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb59d expref: 86 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572465.961079:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2a:0x0].0x0 (ffff8e590d91e300) 00010000:00010000:0.0:1788572465.961081:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572465.961084:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcfa00, rc 0) 00000100:00100000:0.0:1788572465.961172:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+87:164272:x1875444569554944:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 3135us (3353us total) trans 25769803817 rc 0/0 00000100:00100000:0.0:1788572465.961181:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1234 00000100:00100000:0.0:1788572465.968154:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572465.968250:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569555200 00000100:00100000:1.0:1788572465.968261:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569555200 00000100:00100000:1.0:1788572465.968316:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 56 00000100:00100000:1.0:1788572465.968326:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+87:164272:x1875444569555200:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572465.968666:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+88:164272:x1875444569555200:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 340us (524us total) trans 25769803818 rc 0/0 00000100:00100000:1.0:1788572465.968674:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 56 00000100:00100000:3.0:1788572466.028450:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572466.028853:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569555456 00000100:00100000:0.0:1788572466.028872:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569555456 00000100:00100000:1.0:1788572466.029062:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1235 00000100:00100000:1.0:1788572466.029073:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+88:164277:x1875444569555456:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572466.029101:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572466.029123:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf1cb lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5a4 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572466.029230:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x16:0x0]: returning size 4096 00010000:00010000:1.0:1788572466.029326:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf1cb lrc: 1/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5a4 expref: 90 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.029340:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590b3b4600) 00010000:00010000:1.0:1788572466.029343:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572466.029349:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf1cb lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5a4 expref: 90 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.029369:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255a00, rc 0) 00000100:00100000:1.0:1788572466.029432:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+89:164277:x1875444569555456:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 360us (991us total) trans 25769803819 rc 301/301 00000100:00100000:1.0:1788572466.029440:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1235 00000100:00100000:2.0:1788572466.037574:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572466.037712:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569555712 00000100:00100000:0.0:1788572466.037724:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569555712 00000100:00100000:0.0:1788572466.037800:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1236 00000100:00100000:0.0:1788572466.037811:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+89:164277:x1875444569555712:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572466.037838:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572466.038026:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf1d9 lrc: 2/0,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5ab expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.038172:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf1e0 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.038187:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf1e0 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.038201:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf1e0 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572466.038212:0:198183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x18:0x0]: returning size 0 00010000:00010000:0.0:1788572466.038318:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf1d9 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ab expref: 92 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.038343:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf1e0 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ab expref: 91 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.038352:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x18:0x0].0x0 (ffff8e5a18b3f900) 00010000:00010000:0.0:1788572466.038355:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572466.038358:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164e800, rc 0) 00000100:00100000:0.0:1788572466.038422:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+91:164277:x1875444569555712:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 613us (858us total) trans 25769803820 rc 0/0 00000100:00100000:0.0:1788572466.038429:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1236 00000100:00100000:0.0:1788572466.041101:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.041194:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569555968 00000100:00100000:1.0:1788572466.041204:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569555968 00000100:00100000:1.0:1788572466.041263:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 57 00000100:00100000:1.0:1788572466.041275:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+91:164277:x1875444569555968:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:1.0:1788572466.041763:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:164277:x1875444569555968:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 477us (658us total) trans 25769803821 rc 0/0 00000100:00100000:1.0:1788572466.041772:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 57 00000100:00100000:3.0:1788572466.043817:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572466.044049:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569556224 00000100:00100000:0.0:1788572466.044058:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569556224 00000100:00100000:0.0:1788572466.044106:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 58 00000100:00100000:0.0:1788572466.044118:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:164277:x1875444569556224:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:0.0:1788572466.044352:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:164277:x1875444569556224:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 236us (544us total) trans 25769803822 rc 0/0 00000100:00100000:0.0:1788572466.044360:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 58 00000100:00100000:2.0:1788572466.046048:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572466.046129:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569556352 00000100:00100000:0.0:1788572466.046138:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569556352 00000100:00100000:0.0:1788572466.046213:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4673 00000100:00100000:0.0:1788572466.046223:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a11060c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:2399:x1875444569556352:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572466.046245:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572466.046270:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf1e0 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ab expref: 93 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.046296:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x18:0x0].0x0 (ffff8e5a18b3f900) 00010000:00010000:0.0:1788572466.046302:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572466.046354:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a11060c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:2399:x1875444569556352:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 132us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572466.046361:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4673 00000100:00100000:2.0:1788572466.059751:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.060038:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569556480 00000100:00100000:1.0:1788572466.060046:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569556480 00000100:00100000:1.0:1788572466.060101:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1237 00000100:00100000:1.0:1788572466.060108:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164279:x1875444569556480:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572466.060127:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572466.060145:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf1ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5b2 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.060210:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.060221:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.060230:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572466.060268:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1788572466.060270:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1788572466.060283:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.060302:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf1ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b2 expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.060316:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b2 expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.060321:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:1.0:1788572466.060323:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572466.060326:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254e00, rc 0) 00010000:00000080:1.0:1788572466.060332:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36bd7800 x1875444569556480/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:127/0 lens 576/688 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572466.060395:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164279:x1875444569556480:12345-192.168.202.57@tcp:101:rm.0 Request processed in 286us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572466.060405:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1237 00000100:00100000:3.0:1788572466.067025:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.067319:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569556736 00000100:00100000:1.0:1788572466.067330:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569556736 00000100:00100000:1.0:1788572466.067398:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1238 00000100:00100000:1.0:1788572466.067409:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164279:x1875444569556736:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572466.067432:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572466.067453:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf1fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5b9 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572466.067579:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1788572466.067693:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf1fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b9 expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.067705:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572466.067707:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572466.067711:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf1fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b9 expref: 12 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.067722:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255a00, rc 0) 00010000:00000080:1.0:1788572466.067728:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a2746e300 x1875444569556736/t347892350999(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:127/0 lens 648/664 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/600/0 rc 301/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572466.067791:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2746e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164279:x1875444569556736:12345-192.168.202.57@tcp:101:rm.0 Request processed in 385us (779us total) trans 347892350999 rc 301/301 00000100:00100000:1.0:1788572466.067797:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1238 00000100:00100000:2.0:1788572466.080025:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572466.080142:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569556864 00000100:00100000:0.0:1788572466.080217:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569556864 00000100:00100000:0.0:1788572466.080321:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 59 00000100:00100000:0.0:1788572466.080334:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4137c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164279:x1875444569556864:12345-192.168.202.57@tcp:37:rm.0 00010000:00000080:3.0:1788572466.092292:0:188052:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4137c050 x1875444569556864/t0(0) o37->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:127/0 lens 448/440 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788572466.092450:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4137c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164279:x1875444569556864:12345-192.168.202.57@tcp:37:rm.0 Request processed in 12118us (12434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572466.092462:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 59 00000100:00100000:3.0:1788572466.106426:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.106688:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569557120 00000100:00100000:1.0:1788572466.106699:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569557120 00000100:00100000:1.0:1788572466.106759:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 60 00000100:00100000:1.0:1788572466.106771:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164279:x1875444569557120:12345-192.168.202.57@tcp:35:rm.0 00010000:00000080:1.0:1788572466.107194:0:188051:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36efb480 x1875444569557120/t347892351000(0) o35->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:127/0 lens 392/456 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572466.107267:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:164279:x1875444569557120:12345-192.168.202.57@tcp:35:rm.0 Request processed in 497us (854us total) trans 347892351000 rc 0/0 00000100:00100000:1.0:1788572466.107275:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 60 00000100:00100000:2.0:1788572466.110808:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572466.111120:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569557376 00000100:00100000:3.0:1788572466.111131:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569557376 00000100:00100000:3.0:1788572466.111195:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1239 00000100:00100000:3.0:1788572466.111206:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:164279:x1875444569557376:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572466.111228:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572466.111249:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf20a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5c0 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.111358:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bf211 lrc: 3/1,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.111376:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bf211 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.111388:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bf211 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572466.111398:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1788572466.111662:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf20a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5c0 expref: 15 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.111687:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bf211 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5c0 expref: 14 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.111696:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:3.0:1788572466.111699:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788572466.111703:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcfe00, rc 0) 00010000:00000080:3.0:1788572466.111711:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36bd4700 x1875444569557376/t347892351001(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:127/0 lens 648/664 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788572466.112392:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:164279:x1875444569557376:12345-192.168.202.57@tcp:101:rm.0 Request processed in 1183us (1588us total) trans 347892351001 rc 0/0 00000100:00100000:2.0:1788572466.112401:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1239 00000100:00100000:0.0:1788572466.117829:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.118120:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569557504 00000100:00100000:1.0:1788572466.118131:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569557504 00000100:00100000:1.0:1788572466.118190:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1240 00000100:00100000:1.0:1788572466.118199:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:164279:x1875444569557504:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572466.118224:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572466.118246:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf21f lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5c7 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.118323:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf226 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.118338:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf226 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.118351:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf226 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572466.118391:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x16:0x0]: returning size 4096 00000004:00200000:1.0:1788572466.118395:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572466.118429:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf226 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.118459:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf21f lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5c7 expref: 94 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.118673:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf226 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5c7 expref: 93 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.118685:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.118688:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788572466.118691:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e400, rc 0) 00000100:00100000:1.0:1788572466.118754:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:164279:x1875444569557504:12345-192.168.202.57@tcp:101:rm.0 Request processed in 556us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572466.118762:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1240 00000100:00100000:3.0:1788572466.121788:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.121913:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569557760 00000100:00100000:1.0:1788572466.121922:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569557760 00000100:00100000:1.0:1788572466.121992:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1241 00000100:00100000:1.0:1788572466.122003:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:164279:x1875444569557760:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572466.122025:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572466.122050:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf22d lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5ce expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.122158:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bf234 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.122172:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bf234 lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.122184:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bf234 lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572466.122195:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x16:0x0]: returning size 4096 00010000:00010000:1.0:1788572466.122291:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf22d lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ce expref: 96 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.122314:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bf234 lrc: 3/0,0 mode: CR/CR res: [0x240002729:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ce expref: 95 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.122324:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.122327:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788572466.122330:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf000, rc 0) 00000100:00100000:1.0:1788572466.122379:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:164279:x1875444569557760:12345-192.168.202.57@tcp:101:rm.0 Request processed in 379us (601us total) trans 25769803823 rc 0/0 00000100:00100000:1.0:1788572466.122387:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1241 00000100:00100000:2.0:1788572466.134044:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.134184:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569557888 00000100:00100000:1.0:1788572466.134195:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569557888 00000100:00100000:1.0:1788572466.134252:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 61 00000100:00100000:1.0:1788572466.134263:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:164279:x1875444569557888:12345-192.168.202.57@tcp:37:rm.0 00000100:00100000:1.0:1788572466.143309:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:164279:x1875444569557888:12345-192.168.202.57@tcp:37:rm.0 Request processed in 9036us (9263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572466.143323:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 61 00000100:00100000:0.0:1788572466.152221:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.152454:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569558144 00000100:00100000:1.0:1788572466.152465:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569558144 00000100:00100000:1.0:1788572466.152563:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1242 00000100:00100000:1.0:1788572466.152573:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:164279:x1875444569558144:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.152626:0:198183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788572466.152651:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf0eb lrc: 0/0,0 mode: --/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb573 expref: 95 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152673:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x24:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:1.0:1788572466.152693:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf226 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5c7 expref: 94 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152702:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.152705:0:198183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.152726:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152739:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152749:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152761:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152769:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152776:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152871:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152880:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.152888:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572466.153383:0:198183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].2, 64 off8320 00000004:00080000:1.0:1788572466.153394:0:198183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 9219147914173ns, next at 9220147911739ns, rc = 0 00010000:00010000:1.0:1788572466.153439:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153449:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153456:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153462:0:198183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153468:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153474:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153710:0:198183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.153731:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153737:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153744:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153750:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.153754:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153761:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153771:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x24:0x0].0x0 (ffff8e5a18b3fa00) 00010000:00010000:1.0:1788572466.153774:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.153778:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153784:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf250 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153799:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153805:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153811:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153816:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.153818:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153824:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153835:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.153837:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.153840:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.153845:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf242 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.153854:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f4de88 reply state 00000000cd733b8c transno 25769803824 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.154123:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.154129:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x83daffd9 (ffff8e590430c600) 00010000:00010000:1.0:1788572466.154132:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572466.154135:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572466.154250:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.154257:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.154263:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.154266:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.154273:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.154282:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x24:0x0].0x0 (ffff8e5a18b3fa00) 00010000:00010000:3.0:1788572466.154284:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.154287:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.154293:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf257 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.154311:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.154313:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.154314:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572466.154407:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:164279:x1875444569558144:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1832us (2193us total) trans 25769803824 rc 0/0 00000100:00100000:1.0:1788572466.154416:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1242 00000100:00100000:2.0:1788572466.157150:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572466.157302:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569558400 00000100:00100000:0.0:1788572466.157313:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569558400 00000100:00100000:0.0:1788572466.157378:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1243 00000100:00100000:0.0:1788572466.157388:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:164279:x1875444569558400:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572466.157444:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572466.157467:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bef6a lrc: 0/0,0 mode: --/PR res: [0x240002729:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb526 expref: 95 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.157537:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x19:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:0.0:1788572466.157551:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572466.157576:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.157590:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.157602:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.157612:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.157620:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.157626:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.157698:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 3/0,1 mode: --/EX res: [0x240002729:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.157706:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.157713:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572466.157949:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].2, 64 off8320 00000004:00080000:0.0:1788572466.157959:0:188050:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 9219152478967ns, next at 9220152476877ns, rc = 0 00010000:00010000:0.0:1788572466.158399:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158410:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158418:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158430:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158436:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158442:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158457:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572466.158660:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158668:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158675:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158681:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572466.158684:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158691:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158701:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x19:0x0].0x0 (ffff8e590430c800) 00010000:00010000:0.0:1788572466.158704:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572466.158708:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 2/0,0 mode: --/EX res: [0x240002729:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158719:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf26c lrc: 0/0,0 mode: --/EX res: [0x240002729:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158736:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158741:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158746:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158750:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572466.158753:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158758:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158765:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:0.0:1788572466.158767:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572466.158770:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158776:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf25e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572466.158785:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007af9b262 reply state 00000000117430f0 transno 25769803825 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158795:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.158801:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xc1e56442 (ffff8e590b3b4f00) 00010000:00010000:0.0:1788572466.158803:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572466.158806:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572466.158877:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+96:164279:x1875444569558400:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1488us (1734us total) trans 25769803825 rc 0/0 00000100:00100000:0.0:1788572466.158885:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1243 00010000:00010000:2.0:1788572466.159927:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572466.159939:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.159947:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572466.159951:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.159959:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.159985:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x19:0x0].0x0 (ffff8e590430c800) 00010000:00010000:2.0:1788572466.159988:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572466.159992:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.159997:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf273 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.160018:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.160020:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.160022:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572466.161426:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.161690:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569558656 00000100:00100000:1.0:1788572466.161700:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569558656 00000100:00100000:1.0:1788572466.161756:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1244 00000100:00100000:1.0:1788572466.161765:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+96:164279:x1875444569558656:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.161823:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572466.161846:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf019 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb549 expref: 96 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.161867:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1e:0x0].0x0 (ffff8e5a18b3ff00) 00010000:00010000:1.0:1788572466.161876:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.161897:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.161923:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.161933:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.161944:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xa3936bac bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.161952:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.161958:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162053:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162061:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162067:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572466.162271:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].3, 64 off8384 00010000:00010000:1.0:1788572466.162314:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162323:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162330:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162337:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162344:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162349:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162374:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.162390:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162396:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162402:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162407:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.162411:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162419:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162430:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1e:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:1.0:1788572466.162433:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.162436:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162442:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf288 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162456:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162462:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162467:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162472:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.162475:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162521:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162537:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.162539:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.162542:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162548:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf27a lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.162560:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcdf4095 reply state 00000000928fb0f4 transno 25769803826 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162571:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.162576:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xa3936bac (ffff8e5a18b3f200) 00010000:00010000:1.0:1788572466.162579:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572466.162581:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572466.162649:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+97:164279:x1875444569558656:12345-192.168.202.57@tcp:36:rm.0 Request processed in 884us (1230us total) trans 25769803826 rc 0/0 00000100:00100000:1.0:1788572466.162657:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1244 00010000:00010000:3.0:1788572466.162860:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.162868:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.162874:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.162877:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.162883:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.162893:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1e:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:3.0:1788572466.162895:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.162898:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 1/0,0 mode: --/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.162905:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf28f lrc: 0/0,0 mode: --/PW res: [0x240002729:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.162920:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.162922:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.162924:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572466.172019:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572466.172182:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569558912 00000100:00100000:2.0:1788572466.172192:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569558912 00000100:00100000:2.0:1788572466.172257:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1245 00000100:00100000:2.0:1788572466.172270:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+97:164279:x1875444569558912:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572466.172357:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572466.172385:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf19a lrc: 0/0,0 mode: --/PR res: [0x240002729:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb596 expref: 97 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172407:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x29:0x0].0x0 (ffff8e590430c500) 00010000:00010000:2.0:1788572466.172420:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572466.172442:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172457:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172468:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172534:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x31e2699a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172542:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172549:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172639:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172648:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172655:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572466.172860:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].3, 64 off8384 00010000:00010000:2.0:1788572466.172905:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 3/0,1 mode: --/PW res: [0x240002729:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172915:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172922:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172929:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172935:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.172940:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173097:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572466.173121:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173132:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173138:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173144:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.173149:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173156:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173165:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x29:0x0].0x0 (ffff8e5a18beb000) 00010000:00010000:2.0:1788572466.173168:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572466.173172:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173178:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2a4 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173194:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173199:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173206:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173211:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173217:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ba00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.173219:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173226:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173233:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:2.0:1788572466.173235:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572466.173238:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173244:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf296 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572466.173254:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9d803db reply state 0000000024bb7e48 transno 25769803827 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173265:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.173272:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x31e2699a (ffff8e590430c400) 00010000:00010000:2.0:1788572466.173274:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572466.173277:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572466.173352:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+98:164279:x1875444569558912:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1082us (1340us total) trans 25769803827 rc 0/0 00000100:00100000:2.0:1788572466.173360:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1245 00010000:00010000:3.0:1788572466.174148:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.174158:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.174166:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.174170:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.174177:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.174189:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x29:0x0].0x0 (ffff8e5a18beb000) 00010000:00010000:3.0:1788572466.174191:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.174195:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 1/0,0 mode: --/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.174201:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ab lrc: 0/0,0 mode: --/PW res: [0x240002729:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.174218:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.174220:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.174222:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572466.178458:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.178670:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569559168 00000100:00100000:1.0:1788572466.178682:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569559168 00000100:00100000:1.0:1788572466.178733:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1246 00000100:00100000:1.0:1788572466.178743:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+98:164279:x1875444569559168:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.178822:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572466.178852:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bef8d lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb52d expref: 98 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.178872:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1a:0x0].0x0 (ffff8e5a18bebd00) 00010000:00010000:1.0:1788572466.178883:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.178907:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.178920:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.178936:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.178947:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xef08328a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.178955:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.178963:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179062:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179071:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179078:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572466.179266:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].4, 64 off8448 00010000:00010000:1.0:1788572466.179308:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179318:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179327:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179335:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179343:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179350:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179379:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.179396:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179402:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179408:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179414:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.179419:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179428:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179437:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1a:0x0].0x0 (ffff8e590b3b4600) 00010000:00010000:1.0:1788572466.179440:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.179444:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179450:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2c0 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179470:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179524:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179532:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179539:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179545:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.179548:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179554:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179562:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.179564:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.179568:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179574:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2b2 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.179584:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006051fea6 reply state 00000000e81e9732 transno 25769803828 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179594:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.179601:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xef08328a (ffff8e590d91e200) 00010000:00010000:1.0:1788572466.179603:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572466.179606:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572466.179677:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+99:164279:x1875444569559168:12345-192.168.202.57@tcp:36:rm.0 Request processed in 934us (1228us total) trans 25769803828 rc 0/0 00000100:00100000:1.0:1788572466.179685:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1246 00010000:00010000:2.0:1788572466.180265:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572466.180273:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.180281:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572466.180285:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.180293:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.180303:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1a:0x0].0x0 (ffff8e590b3b4600) 00010000:00010000:2.0:1788572466.180306:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572466.180309:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.180315:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf2c7 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.180331:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.180333:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.180335:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572466.187447:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.187607:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569559424 00000100:00100000:1.0:1788572466.187618:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569559424 00000100:00100000:1.0:1788572466.187693:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1247 00000100:00100000:1.0:1788572466.187704:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+99:164279:x1875444569559424:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.187770:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572466.187801:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce000/0x265cfe11109bf154 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb588 expref: 99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.187821:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x27:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:1.0:1788572466.187832:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.187852:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.187865:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.187875:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.187885:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.187892:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.187898:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188102:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 3/0,1 mode: --/EX res: [0x240002729:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188111:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188118:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572466.188317:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].4, 64 off8448 00010000:00010000:1.0:1788572466.188363:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188373:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188381:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188388:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188394:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188401:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188418:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.188436:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188442:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188448:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188453:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.188459:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188466:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188475:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x27:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:1.0:1788572466.188773:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.188779:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 2/0,0 mode: --/EX res: [0x240002729:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188786:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4400/0x265cfe11109bf2dc lrc: 0/0,0 mode: --/EX res: [0x240002729:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188803:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188809:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188814:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188824:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.188827:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188833:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188842:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.188845:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.188848:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188854:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4800/0x265cfe11109bf2ce lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.188864:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003161c67b reply state 0000000077ad3b52 transno 25769803829 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188874:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.188882:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xec45d8e7 (ffff8e5a18beb200) 00010000:00010000:1.0:1788572466.188885:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572466.188887:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572466.189089:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+100:164279:x1875444569559424:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1386us (1649us total) trans 25769803829 rc 0/0 00000100:00100000:1.0:1788572466.189098:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1247 00010000:00010000:0.0:1788572466.189275:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572466.189282:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.189289:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572466.189293:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.189300:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.189310:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x27:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:0.0:1788572466.189313:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572466.189316:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.189322:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4c00/0x265cfe11109bf2e3 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.189339:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572466.189341:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572466.189342:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572466.191570:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572466.191785:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569559680 00000100:00100000:2.0:1788572466.191795:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569559680 00000100:00100000:2.0:1788572466.191848:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1248 00000100:00100000:2.0:1788572466.191858:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+100:164279:x1875444569559680:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572466.191919:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572466.191942:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109befb0 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb534 expref: 100 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.191960:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1b:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:2.0:1788572466.192135:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572466.192156:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192169:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192178:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192189:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192196:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192202:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192282:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192291:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192298:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572466.192689:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].5, 64 off8512 00010000:00010000:2.0:1788572466.192736:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192745:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192753:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192760:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192766:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192773:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192786:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572466.192801:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192807:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192813:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192819:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7aa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.192823:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192831:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192839:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1b:0x0].0x0 (ffff8e5a18beb800) 00010000:00010000:2.0:1788572466.192842:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572466.192846:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192852:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf2f8 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192867:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192873:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192879:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192884:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192888:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.192891:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.192896:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.193001:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572466.193009:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.193016:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572466.193019:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.193026:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.193035:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1b:0x0].0x0 (ffff8e5a18beb800) 00010000:00010000:0.0:1788572466.193037:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572466.193040:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 1/0,0 mode: --/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.193046:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf2ff lrc: 0/0,0 mode: --/PW res: [0x240002729:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.193060:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572466.193062:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572466.193064:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.193146:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:2.0:1788572466.193149:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572466.193153:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.193159:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf2ea lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572466.193169:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006de645fc reply state 000000000675e3dd transno 25769803830 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.193179:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.193185:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x1c2b00d3 (ffff8e5a18b3f500) 00010000:00010000:2.0:1788572466.193188:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572466.193191:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572466.193282:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+101:164279:x1875444569559680:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1422us (1719us total) trans 25769803830 rc 0/0 00000100:00100000:2.0:1788572466.193290:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1248 00000100:00100000:2.0:1788572466.196383:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.196454:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569559936 00000100:00100000:1.0:1788572466.196463:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569559936 00000100:00100000:1.0:1788572466.196561:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1249 00000100:00100000:1.0:1788572466.196572:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+101:164279:x1875444569559936:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.196633:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572466.196662:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf131 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb581 expref: 101 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.196684:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x26:0x0].0x0 (ffff8e590d91eb00) 00010000:00010000:1.0:1788572466.196694:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.196715:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.196728:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.196738:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.196747:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xc977908d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.196754:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.196760:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.196838:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.196845:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.196856:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572466.197368:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].5, 64 off8512 00010000:00010000:1.0:1788572466.197418:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 3/0,1 mode: --/PW res: [0x240002729:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197428:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197436:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197442:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197449:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197456:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197639:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.197660:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197666:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197672:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197682:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.197686:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197693:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197701:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x26:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:1.0:1788572466.197704:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.197707:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197712:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4000/0x265cfe11109bf314 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197728:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197733:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197737:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197742:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197746:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb4a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.197749:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197758:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197764:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.197766:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.197769:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197774:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb4a00/0x265cfe11109bf306 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.197783:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053065dbe reply state 00000000ec96ce85 transno 25769803831 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197793:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.197799:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xc977908d (ffff8e5a18beb100) 00010000:00010000:1.0:1788572466.197801:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572466.197804:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572466.197892:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+102:164279:x1875444569559936:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1320us (1517us total) trans 25769803831 rc 0/0 00000100:00100000:1.0:1788572466.197901:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1249 00010000:00010000:3.0:1788572466.203796:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.203811:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.203824:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.203830:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.203840:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.203859:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x26:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572466.203862:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.203867:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 1/0,0 mode: --/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.203875:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5e00/0x265cfe11109bf31b lrc: 0/0,0 mode: --/PW res: [0x240002729:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.203900:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.203902:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572466.204408:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.204611:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569560192 00000100:00100000:1.0:1788572466.204622:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569560192 00000100:00100000:1.0:1788572466.204680:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1250 00000100:00100000:1.0:1788572466.204690:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+102:164279:x1875444569560192:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.204752:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572466.204774:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bef24 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb518 expref: 102 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.204791:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x17:0x0].0x0 (ffff8e5a18b3f800) 00010000:00010000:1.0:1788572466.204800:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.204821:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.204835:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.204844:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.204855:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.204862:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.204868:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.204945:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.204954:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.204961:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.205136:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572466.206602:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].6, 64 off8576 00010000:00010000:1.0:1788572466.206672:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206688:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206698:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206707:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206713:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206719:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206739:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.206759:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206765:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206771:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206777:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.206781:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206789:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206800:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x17:0x0].0x0 (ffff8e590b3b4600) 00010000:00010000:1.0:1788572466.206803:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.206807:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206812:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf330 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206829:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206835:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206841:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206846:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.206848:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206854:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206862:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.206864:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.206866:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206871:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5200/0x265cfe11109bf322 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.206884:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3e928b7 reply state 00000000f851c3af transno 25769803832 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206893:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.206899:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x679fc7b1 (ffff8e5a18b3fb00) 00010000:00010000:1.0:1788572466.206901:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572466.207137:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.207144:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.207150:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.207154:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.207161:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.207170:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x17:0x0].0x0 (ffff8e590b3b4600) 00010000:00010000:3.0:1788572466.207172:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.207175:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.207181:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fc00/0x265cfe11109bf337 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.207199:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.207201:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.207203:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572466.208084:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572466.208194:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+103:164279:x1875444569560192:12345-192.168.202.57@tcp:36:rm.0 Request processed in 3500us (3787us total) trans 25769803832 rc 0/0 00000100:00100000:1.0:1788572466.208203:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1250 00000100:00100000:0.0:1788572466.216541:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.216793:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569560448 00000100:00100000:1.0:1788572466.216802:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569560448 00000100:00100000:1.0:1788572466.216861:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1251 00000100:00100000:1.0:1788572466.216871:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+103:164279:x1875444569560448:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.216936:0:198183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572466.216962:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255600/0x265cfe11109bf03c lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb550 expref: 103 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217144:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1f:0x0].0x0 (ffff8e590b3b4200) 00010000:00010000:1.0:1788572466.217156:0:198183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.217178:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217192:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217207:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217220:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217227:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217234:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217321:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217329:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217336:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572466.217683:0:198183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].7, 64 off8640 00010000:00010000:1.0:1788572466.217726:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217735:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217742:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217749:0:198183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217757:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217764:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217823:0:198183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.217839:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217845:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217851:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217857:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.217862:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217870:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217879:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1f:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:1.0:1788572466.217882:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.217886:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 2/0,0 mode: --/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217891:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255c00/0x265cfe11109bf34c lrc: 0/0,0 mode: --/EX res: [0x240002729:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217921:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217927:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217933:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217938:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.217940:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217946:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217952:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.217954:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.217957:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.217962:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bf33e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.218039:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e6f794e reply state 00000000c7276c97 transno 25769803833 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.218051:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.218057:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xd0b639f4 (ffff8e590b3b4700) 00010000:00010000:1.0:1788572466.218060:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572466.218063:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572466.218141:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+104:164279:x1875444569560448:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1269us (1663us total) trans 25769803833 rc 0/0 00000100:00100000:1.0:1788572466.218149:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1251 00010000:00010000:2.0:1788572466.219167:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572466.219176:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.219184:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572466.219188:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.219196:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.219208:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1f:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:2.0:1788572466.219210:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572466.219214:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.219220:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf353 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.219243:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.219244:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.219246:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572466.225184:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572466.227292:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569560704 00000100:00100000:0.0:1788572466.227307:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569560704 00000100:00100000:0.0:1788572466.227377:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1252 00000100:00100000:0.0:1788572466.227389:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+104:164279:x1875444569560704:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572466.227450:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572466.227507:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf05f lrc: 0/0,0 mode: --/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb557 expref: 104 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.227534:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x20:0x0].0x0 (ffff8e5a18beb900) 00010000:00010000:0.0:1788572466.227546:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572466.227567:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.227580:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.227591:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.227604:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.227612:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.227618:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.227700:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.227708:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.227715:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572466.227927:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].6, 64 off8576 00010000:00010000:0.0:1788572466.228108:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 3/0,1 mode: --/PW res: [0x240002729:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228118:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228127:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228134:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228139:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228145:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228166:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572466.228183:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228190:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228196:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228201:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572466.228205:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228213:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228221:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x20:0x0].0x0 (ffff8e590430cf00) 00010000:00010000:0.0:1788572466.228224:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572466.228229:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228234:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf368 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228249:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228256:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228261:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228267:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572466.228269:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228274:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228281:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:0.0:1788572466.228283:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572466.228286:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228292:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf35a lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572466.228300:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000230f39a0 reply state 0000000060c34a7c transno 25769803834 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228316:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.228322:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xfdd9083c (ffff8e5a18bebf00) 00010000:00010000:0.0:1788572466.228324:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572466.228327:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572466.228407:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+105:164279:x1875444569560704:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1019us (3235us total) trans 25769803834 rc 0/0 00000100:00100000:0.0:1788572466.228415:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1252 00010000:00010000:3.0:1788572466.229154:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.229164:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.229173:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.229177:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.229184:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.229195:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x20:0x0].0x0 (ffff8e590430cf00) 00010000:00010000:3.0:1788572466.229197:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.229200:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 1/0,0 mode: --/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.229205:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109bf36f lrc: 0/0,0 mode: --/PW res: [0x240002729:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.229221:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.229223:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.229224:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572466.236998:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572466.237174:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569560960 00000100:00100000:2.0:1788572466.237184:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569560960 00000100:00100000:2.0:1788572466.237245:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1253 00000100:00100000:2.0:1788572466.237256:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+105:164279:x1875444569560960:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572466.237312:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572466.237339:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255000/0x265cfe11109bf0a5 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb565 expref: 105 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.237359:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x22:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:2.0:1788572466.237370:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572466.237392:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.237405:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.237415:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.237425:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.237432:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.237442:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.237732:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.237742:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.237748:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572466.237962:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].7, 64 off8640 00010000:00010000:2.0:1788572466.238093:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 3/0,1 mode: --/PW res: [0x240002729:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238103:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238109:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238116:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238122:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238128:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238148:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572466.238165:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238172:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238178:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238184:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.238189:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238196:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238204:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x22:0x0].0x0 (ffff8e5a18beba00) 00010000:00010000:2.0:1788572466.238207:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572466.238211:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238216:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf384 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238230:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238235:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238240:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238248:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.238251:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238256:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238263:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:2.0:1788572466.238265:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572466.238267:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238272:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf376 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572466.238282:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4d6143f reply state 000000004d0de7f4 transno 25769803835 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238292:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.238298:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x3e3e6f26 (ffff8e590430c000) 00010000:00010000:2.0:1788572466.238301:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572466.238304:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572466.238637:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+106:164279:x1875444569560960:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1380us (1646us total) trans 25769803835 rc 0/0 00000100:00100000:2.0:1788572466.238645:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1253 00010000:00010000:3.0:1788572466.238720:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.238726:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.238732:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.238736:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.238742:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.238751:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x22:0x0].0x0 (ffff8e5a18beba00) 00010000:00010000:3.0:1788572466.238754:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.238757:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 1/0,0 mode: --/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.238762:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf38b lrc: 0/0,0 mode: --/PW res: [0x240002729:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.238776:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.238778:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.238779:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572466.247286:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572466.247383:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569561216 00000100:00100000:2.0:1788572466.247394:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569561216 00000100:00100000:2.0:1788572466.247459:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1254 00000100:00100000:2.0:1788572466.247470:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+106:164279:x1875444569561216:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572466.247680:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572466.247707:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf1bd lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb59d expref: 106 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.247728:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2a:0x0].0x0 (ffff8e590d91e300) 00010000:00010000:2.0:1788572466.247740:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572466.247763:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.247776:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.247786:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.247797:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.247803:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.247809:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.247893:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.247902:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248083:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572466.248304:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].8, 64 off8704 00010000:00010000:2.0:1788572466.248356:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248365:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248372:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248380:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248386:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248392:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248469:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572466.248592:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248599:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248604:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248614:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.248618:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248626:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248636:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2a:0x0].0x0 (ffff8e5a18beba00) 00010000:00010000:2.0:1788572466.248639:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572466.248643:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248649:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a400/0x265cfe11109bf3a0 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248667:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248673:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248679:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248685:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248691:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.248694:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248704:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248713:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:2.0:1788572466.248715:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572466.248719:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248725:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf392 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572466.248735:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000699318d9 reply state 0000000040462fbd transno 25769803836 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248746:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.248752:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x54b0b1f4 (ffff8e590d91e400) 00010000:00010000:2.0:1788572466.248754:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572466.248757:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572466.248835:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+107:164279:x1875444569561216:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1364us (1557us total) trans 25769803836 rc 0/0 00000100:00100000:2.0:1788572466.248843:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1254 00010000:00010000:3.0:1788572466.256804:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.256823:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.256834:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.256839:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.256851:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.256870:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2a:0x0].0x0 (ffff8e5a18beba00) 00010000:00010000:3.0:1788572466.256873:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.256878:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.256884:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3a7 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572466.257341:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572466.257422:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569561472 00000100:00100000:0.0:1788572466.257433:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569561472 00000100:00100000:0.0:1788572466.257534:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1255 00000100:00100000:0.0:1788572466.257544:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+107:164279:x1875444569561472:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572466.257601:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572466.257620:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254c00/0x265cfe11109bf177 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb58f expref: 107 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.257635:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x28:0x0].0x0 (ffff8e590b3b4100) 00010000:00010000:0.0:1788572466.257643:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572466.257664:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.257677:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.257687:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.257702:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xf142140 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.257710:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.257717:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.257803:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 3/0,1 mode: --/EX res: [0x240002729:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.257811:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.257818:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572466.258220:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].9, 64 off8768 00010000:00010000:0.0:1788572466.258267:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258277:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258285:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258292:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258298:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258305:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258325:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572466.258342:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258349:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258355:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258360:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572466.258364:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258372:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258380:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x28:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:0.0:1788572466.258383:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572466.258387:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 2/0,0 mode: --/EX res: [0x240002729:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258392:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109bf3bc lrc: 0/0,0 mode: --/EX res: [0x240002729:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258409:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258420:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258426:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258430:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572466.258433:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258439:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258446:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:0.0:1788572466.258448:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572466.258451:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258457:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f600/0x265cfe11109bf3ae lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572466.258465:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5851306 reply state 000000003e8a8f0a transno 25769803837 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258475:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.258508:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xf142140 (ffff8e590b3b4000) 00010000:00010000:0.0:1788572466.258511:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572466.258513:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572466.258780:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572466.258788:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.258795:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572466.258799:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.258807:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.258817:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x28:0x0].0x0 (ffff8e590430ca00) 00010000:00010000:2.0:1788572466.258820:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572466.258822:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.258828:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf3c3 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.258845:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.258847:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.258849:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.259326:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572466.259361:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+108:164279:x1875444569561472:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1814us (2022us total) trans 25769803837 rc 0/0 00000100:00100000:0.0:1788572466.259370:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1255 00000100:00100000:2.0:1788572466.271603:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.271816:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569561728 00000100:00100000:1.0:1788572466.271830:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569561728 00000100:00100000:1.0:1788572466.271905:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1256 00000100:00100000:1.0:1788572466.271915:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+108:164279:x1875444569561728:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.271994:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572466.272019:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bef47 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb51f expref: 108 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272041:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x18:0x0].0x0 (ffff8e5a18b3f900) 00010000:00010000:1.0:1788572466.272051:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.272076:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272091:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272101:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272113:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x94c295fa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272120:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272131:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272228:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272237:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272245:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572466.272453:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].10, 64 off8832 00010000:00010000:1.0:1788572466.272548:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 3/0,1 mode: --/PW res: [0x240002729:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272557:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272565:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272572:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272579:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272585:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.272605:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.272623:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.272627:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.272636:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.273021:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.273031:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.273334:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.273340:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.273351:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.273364:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x18:0x0].0x0 (ffff8e590b3b4200) 00010000:00010000:3.0:1788572466.273367:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.273371:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 1/0,0 mode: --/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.273378:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf3df lrc: 0/0,0 mode: --/PW res: [0x240002729:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.273392:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.273394:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.273396:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572466.278751:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.278766:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.278780:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.278801:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x18:0x0].0x0 (ffff8e590b3b4200) 00010000:00010000:1.0:1788572466.278804:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.278809:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.278816:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf3d8 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.278855:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.278863:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.278870:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.278880:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.278884:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.278889:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.278897:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.278899:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.278902:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.279038:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf3ca lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.279051:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a3f834f reply state 0000000081f729fd transno 25769803838 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.279063:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.279071:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x94c295fa (ffff8e5a18b3fc00) 00010000:00010000:1.0:1788572466.279073:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572466.279076:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572466.279230:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+109:164279:x1875444569561728:12345-192.168.202.57@tcp:36:rm.0 Request processed in 7311us (7633us total) trans 25769803838 rc 0/0 00000100:00100000:1.0:1788572466.279240:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1256 00000100:00100000:1.0:1788572466.288129:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572466.288241:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569561984 00000100:00100000:2.0:1788572466.288252:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569561984 00000100:00100000:2.0:1788572466.288313:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1257 00000100:00100000:2.0:1788572466.288325:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+109:164279:x1875444569561984:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572466.288382:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572466.288411:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7be00/0x265cfe11109bf082 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb55e expref: 109 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.288431:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x21:0x0].0x0 (ffff8e5a18beb600) 00010000:00010000:2.0:1788572466.288442:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572466.288463:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.288766:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.288781:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.288794:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.288802:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.288808:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.288888:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.288896:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.288903:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572466.289232:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].8, 64 off8704 00010000:00010000:2.0:1788572466.289288:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 3/0,1 mode: --/PW res: [0x240002729:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289298:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289305:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289312:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289318:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289324:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289345:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572466.289362:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289368:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289374:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289379:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.289383:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289391:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289400:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x21:0x0].0x0 (ffff8e5a18beb900) 00010000:00010000:2.0:1788572466.289404:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572466.289407:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289413:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf3f4 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289433:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289439:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289445:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289450:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289455:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.289458:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289464:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.289469:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572466.289473:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:2.0:1788572466.289477:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572466.289477:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.289510:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.289514:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.289522:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.289541:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x21:0x0].0x0 (ffff8e5a18beb900) 00010000:00010000:3.0:1788572466.289545:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.289548:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 1/0,0 mode: --/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.289554:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf3fb lrc: 0/0,0 mode: --/PW res: [0x240002729:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.289568:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.289570:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.289572:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.289630:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289636:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bf3e6 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572466.289647:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014b793fb reply state 00000000e0bba09b transno 25769803839 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289657:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.289663:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x1b7026cc (ffff8e5a18beb700) 00010000:00010000:2.0:1788572466.289665:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572466.289668:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572466.289748:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+110:164279:x1875444569561984:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1424us (1629us total) trans 25769803839 rc 0/0 00000100:00100000:2.0:1788572466.289755:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1257 00000100:00100000:2.0:1788572466.292837:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.293045:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569562240 00000100:00100000:1.0:1788572466.293055:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569562240 00000100:00100000:1.0:1788572466.293111:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1258 00000100:00100000:1.0:1788572466.293120:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b3e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+110:164279:x1875444569562240:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.293184:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572466.293214:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf10e lrc: 0/0,0 mode: --/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb57a expref: 110 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293236:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x25:0x0].0x0 (ffff8e590b3b4a00) 00010000:00010000:1.0:1788572466.293248:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.293269:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293283:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293294:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293306:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293314:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293321:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293413:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293421:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293429:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572466.293753:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].9, 64 off8768 00010000:00010000:1.0:1788572466.293805:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293815:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293822:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293831:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293837:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293843:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293867:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.293884:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293890:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293896:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293905:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.293909:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293917:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293927:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x25:0x0].0x0 (ffff8e590b3b4200) 00010000:00010000:3.0:1788572466.293929:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572466.293931:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.293938:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x25:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.293939:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.293950:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf410 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x25:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.293952:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.293959:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.293966:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.293988:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x25:0x0].0x0 (ffff8e590b3b4200) 00010000:00010000:3.0:1788572466.293991:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.293993:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.293998:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109bf417 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.294014:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.294016:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.294018:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572466.294239:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.294246:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.294252:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.294258:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.294262:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.294265:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.294274:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.294283:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.294286:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.294289:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.294294:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf402 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.294305:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039da69ce reply state 00000000104205f7 transno 25769803840 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.294315:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.294320:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xa6a94833 (ffff8e590b3b4e00) 00010000:00010000:1.0:1788572466.294322:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572466.294324:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572466.294439:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b3e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+111:164279:x1875444569562240:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1317us (1609us total) trans 25769803840 rc 0/0 00000100:00100000:1.0:1788572466.294446:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1258 00000100:00100000:2.0:1788572466.300117:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572466.300340:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569562496 00000100:00100000:3.0:1788572466.300351:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569562496 00000100:00100000:3.0:1788572466.300418:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1259 00000100:00100000:3.0:1788572466.300429:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+111:164279:x1875444569562496:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572466.300545:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572466.300572:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109befd3 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb53b expref: 111 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.300591:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1c:0x0].0x0 (ffff8e590b3b4d00) 00010000:00010000:3.0:1788572466.300603:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572466.300627:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.300639:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.300649:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.300660:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.300668:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.300673:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.300928:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.300941:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.300947:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572466.301384:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].11, 64 off8896 00010000:00010000:3.0:1788572466.301431:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301440:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301448:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301455:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301462:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301469:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301516:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572466.301596:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572466.301604:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.301612:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572466.301617:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.301627:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.301640:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1c:0x0].0x0 (ffff8e590d91ea00) 00010000:00010000:2.0:1788572466.301643:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572466.301647:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.301654:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf433 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.301667:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.301669:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.301671:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.301694:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301702:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301711:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301717:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572466.301720:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301726:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301735:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1c:0x0].0x0 (ffff8e590d91ea00) 00010000:00010000:3.0:1788572466.301738:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572466.301742:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 2/0,0 mode: --/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.301748:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf42c lrc: 0/0,0 mode: --/EX res: [0x240002729:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.302116:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.302122:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.302128:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.302133:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572466.302136:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.302147:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.302278:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:3.0:1788572466.302281:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572466.302285:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.302292:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf41e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572466.302301:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f04294e8 reply state 000000009d41e6e2 transno 25769803841 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.302312:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.302319:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x494dcf1b (ffff8e590b3b4300) 00010000:00010000:3.0:1788572466.302321:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572466.302324:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572466.302417:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+112:164279:x1875444569562496:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1987us (2307us total) trans 25769803841 rc 0/0 00000100:00100000:3.0:1788572466.302425:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1259 00000100:00100000:0.0:1788572466.307652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.307736:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569562752 00000100:00100000:1.0:1788572466.307747:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569562752 00000100:00100000:1.0:1788572466.307820:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1260 00000100:00100000:1.0:1788572466.307832:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+112:164279:x1875444569562752:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.307894:0:198183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572466.307931:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b600/0x265cfe11109bf0c8 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb56c expref: 112 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.307954:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x23:0x0].0x0 (ffff8e5a18bebc00) 00010000:00010000:1.0:1788572466.307966:0:198183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.308148:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308163:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308173:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308182:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x610cb780 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308189:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308194:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308281:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308289:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308296:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572466.308676:0:198183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].10, 64 off8832 00010000:00010000:1.0:1788572466.308724:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 3/0,1 mode: --/PW res: [0x240002729:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308735:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308742:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308749:0:198183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308754:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308760:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308827:0:198183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572466.308846:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308853:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308859:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308865:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.308869:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308876:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308887:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x23:0x0].0x0 (ffff8e590b3b4a00) 00010000:00010000:1.0:1788572466.308890:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572466.308893:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308899:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109bf448 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308927:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308933:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308939:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308944:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.308947:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308953:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.308960:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.308963:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.308966:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.309102:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109bf43a lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.309117:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a831580 reply state 00000000f2d59caa transno 25769803842 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.309128:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.309134:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x610cb780 (ffff8e5a18beb300) 00010000:00010000:1.0:1788572466.309136:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572466.309139:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572466.309231:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+113:164279:x1875444569562752:12345-192.168.202.57@tcp:36:rm.0 Request processed in 1400us (1587us total) trans 25769803842 rc 0/0 00000100:00100000:1.0:1788572466.309239:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1260 00010000:00010000:3.0:1788572466.313348:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.313362:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.313373:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.313378:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.313389:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.313407:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x23:0x0].0x0 (ffff8e590b3b4a00) 00010000:00010000:3.0:1788572466.313410:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.313415:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 1/0,0 mode: --/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.313422:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf44f lrc: 0/0,0 mode: --/PW res: [0x240002729:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.313664:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.313667:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.313669:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572466.317334:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572466.317435:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569563008 00000100:00100000:0.0:1788572466.317446:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569563008 00000100:00100000:0.0:1788572466.317552:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1261 00000100:00100000:0.0:1788572466.317563:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+113:164279:x1875444569563008:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572466.317628:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572466.317655:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109beff6 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb542 expref: 113 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.317676:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1d:0x0].0x0 (ffff8e5a18b3f000) 00010000:00010000:0.0:1788572466.317688:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572466.317709:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.317722:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.317733:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.317744:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x16:0x0].0x76709d63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.317751:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.317758:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.317842:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.317850:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.317857:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572466.318099:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].11, 64 off8896 00010000:00010000:0.0:1788572466.318148:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 3/0,1 mode: --/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318156:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318165:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318172:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318179:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318186:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318204:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572466.318220:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318231:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318237:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318242:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572466.318247:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318254:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318263:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1d:0x0].0x0 (ffff8e590430cc00) 00010000:00010000:0.0:1788572466.318266:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572466.318270:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318276:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109bf464 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318290:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318297:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318302:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318307:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572466.318311:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318316:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318323:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:0.0:1788572466.318325:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572466.318328:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318334:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109bf456 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572466.318343:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001eb6c9ad reply state 00000000f9f07c88 transno 25769803843 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318353:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.318359:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x76709d63 (ffff8e5a18b3f300) 00010000:00010000:0.0:1788572466.318362:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572466.318364:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572466.318436:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+114:164279:x1875444569563008:12345-192.168.202.57@tcp:36:rm.0 Request processed in 874us (1110us total) trans 25769803843 rc 0/0 00000100:00100000:0.0:1788572466.318444:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1261 00010000:00010000:3.0:1788572466.319474:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572466.319593:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.319602:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572466.319606:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.319615:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.319628:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x1d:0x0].0x0 (ffff8e590430cc00) 00010000:00010000:3.0:1788572466.319631:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572466.319634:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 1/0,0 mode: --/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.319640:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f800/0x265cfe11109bf46b lrc: 0/0,0 mode: --/PW res: [0x240002729:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.319658:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.319661:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572466.319663:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572466.339802:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.339915:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569563136 00000100:00100000:1.0:1788572466.339926:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569563136 00000100:00100000:1.0:1788572466.340158:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1262 00000100:00100000:1.0:1788572466.340171:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:164279:x1875444569563136:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572466.340197:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572466.340221:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf472 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5d5 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340287:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 3/1,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340303:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340316:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340337:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340345:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340353:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340409:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf487 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340418:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf487 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340425:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf487 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572466.340443:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf487 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340456:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340463:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 2/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340470:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340475:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.340530:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340538:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340548:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:1.0:1788572466.340551:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.340556:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340563:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf479 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340577:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340582:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340588:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340594:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.340597:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340603:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340610:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0xf7117594 (ffff8e590b3b4400) 00010000:00010000:1.0:1788572466.340613:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.340617:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340622:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf480 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340654:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf472 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5d5 expref: 16 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340671:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf487 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5d5 expref: 15 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.340679:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3f700) 00010000:00010000:1.0:1788572466.340681:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572466.340684:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255600, rc 0) 00010000:00000080:1.0:1788572466.340692:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa6d80 x1875444569563136/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:127/0 lens 584/584 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572466.340760:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:164279:x1875444569563136:12345-192.168.202.57@tcp:101:rm.0 Request processed in 592us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572466.340767:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1262 00000100:00100000:2.0:1788572466.347175:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.347254:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569563264 00000100:00100000:1.0:1788572466.347265:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569563264 00000100:00100000:1.0:1788572466.347328:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1263 00000100:00100000:1.0:1788572466.347338:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+114:164279:x1875444569563264:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572466.347362:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572466.347384:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf48e lrc: 2/0,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5dc expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.347449:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bf495 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.347463:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bf495 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.347474:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bf495 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572466.347538:0:198183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x16:0x0]: returning size 4096 00000004:00200000:1.0:1788572466.347542:0:198183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1788572466.347577:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254a00/0x265cfe11109bf48e lrc: 0/0,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5dc expref: 116 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.347599:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bf495 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5dc expref: 115 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.347608:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.347611:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788572466.347615:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e200, rc 0) 00000100:00100000:1.0:1788572466.347720:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:164279:x1875444569563264:12345-192.168.202.57@tcp:101:rm.0 Request processed in 383us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572466.347727:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1263 00000100:00100000:2.0:1788572466.352624:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572466.352648:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572466.352675:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572466.352740:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569563776 00000100:00100000:3.0:1788572466.352749:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569563776 00000100:00100000:3.0:1788572466.352802:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 62 00000100:00100000:3.0:1788572466.352811:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:164279:x1875444569563776:12345-192.168.202.57@tcp:35:rm.0 00000100:00100000:3.0:1788572466.353061:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+116:164279:x1875444569563776:12345-192.168.202.57@tcp:35:rm.0 Request processed in 250us (383us total) trans 25769803844 rc 0/0 00000100:00100000:3.0:1788572466.353069:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 62 00000100:00100000:0.0:1788572466.353198:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569563392 00000100:00100000:0.0:1788572466.353202:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569563392 00000100:00100000:0.0:1788572466.353240:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569563520 00000100:00100000:0.0:1788572466.353243:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569563520 00000100:00100000:0.0:1788572466.353263:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4674 00000100:00100000:0.0:1788572466.353270:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+16:2398:x1875444569563392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572466.353281:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572466.353302:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf487 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5d5 expref: 16 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.353321:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3f700) 00010000:00010000:0.0:1788572466.353326:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572466.353343:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:2398:x1875444569563392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 74us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572466.353349:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4674 00000100:00100000:0.0:1788572466.353362:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4675 00000100:00100000:0.0:1788572466.353368:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:2397:x1875444569563520:12345-192.168.202.57@tcp:103:rm.0 00010000:00010000:0.0:1788572466.353374:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572466.353382:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e800/0x265cfe11109beeec lrc: 0/0,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb50a expref: 14 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.353392:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18b3f700) 00010000:00010000:0.0:1788572466.353400:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572466.353413:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:2397:x1875444569563520:12345-192.168.202.57@tcp:103:rm.0 Request processed in 45us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572466.353419:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4675 00000100:00100000:0.0:1788572466.360090:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572466.360181:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569564032 00000100:00100000:1.0:1788572466.360192:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569564032 00000100:00100000:1.0:1788572466.360249:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1264 00000100:00100000:1.0:1788572466.360260:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+116:164279:x1875444569564032:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:1.0:1788572466.360325:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788572466.360354:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bf495 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5dc expref: 116 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.360376:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bf234 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ce expref: 115 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.360388:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572466.360401:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572466.360453:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 3/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.360462:0:188050:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 3/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.360473:0:188050:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 3/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572466.360535:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584432768:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1788572466.360584:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572466.360616:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572466.360730:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584432768 00000100:00100000:3.0:1788572466.360735:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584432768 00000100:00100000:3.0:1788572466.360767:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1788572466.360774:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188050:x1875444584432768:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788572466.360784:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572466.360799:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf4a3 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf49c expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.360821:0:189111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b2 expref: 12 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.360831:0:189111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf4a3 lrc: 4/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf49c expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.360854:0:189111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b2 expref: 12 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.360867:0:189111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b2 expref: 12 pid: 188048 timeout: 9319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572466.360882:0:189111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:189111:1875444584432896:192.168.202.57@tcp:104: 00000100:00100000:3.0:1788572466.360949:0:189111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a244ab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572466.362935:0:189111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:189111:1875444584432896:192.168.202.57@tcp:104: 00010000:00010000:3.0:1788572466.363095:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf4a3 lrc: 3/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf49c expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.363111:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:3.0:1788572466.363114:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572466.363119:0:189111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf4a3 lrc: 3/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf49c expref: 7 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.363128:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf000, rc 0) 00010000:00000080:3.0:1788572466.363136:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f8f1880 x1875444584432768/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 328/344 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572466.363260:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:188050:x1875444584432768:12345-0@lo:101:mdt00_002.0 Request processed in 2485us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572466.363269:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1788572466.363548:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584432768:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1788572466.363567:0:188050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 4/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.363578:0:188050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 4/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572466.363894:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572466.364090:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569564160 00000100:00100000:2.0:1788572466.364097:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569564160 00010000:00010000:2.0:1788572466.364128:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b2 expref: 13 pid: 188048 timeout: 9319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572466.364175:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12910 00000100:00100000:2.0:1788572466.364184:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:2397:x1875444569564160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572466.364199:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572466.364205:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b2 expref: 13 pid: 188048 timeout: 9319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.364218:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b2 expref: 13 pid: 188048 timeout: 9319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.364238:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf1f5 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5b2 expref: 13 pid: 188048 timeout: 9319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.364254:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:2.0:1788572466.364259:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf4a3 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf49c expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.364269:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf4a3 lrc: 2/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bf49c expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.364278:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf4a3 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109bf49c expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.364308:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf4a3 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf49c expref: 6 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572466.364321:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6503:1875444584433024:0@lo:105: 00000100:00100000:2.0:1788572466.364362:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572466.364401:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572466.364724:0:13337:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788572466.364736:0:13337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584433024 00000100:00100000:1.0:1788572466.364740:0:13337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584433024 00000100:00100000:1.0:1788572466.364771:0:13337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5403 00000100:00100000:1.0:1788572466.364779:0:13337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ea60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6503:x1875444584433024:12345-0@lo:105: 00010000:00010000:1.0:1788572466.364789:0:13337:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 5/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.364799:0:13337:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 5/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.364808:0:13337:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 5/0,1 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.364815:0:13337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 5/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.364822:0:13337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 6/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.364830:0:13337:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 6/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.364852:0:13337:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a4117fa00) 00000100:00100000:1.0:1788572466.364885:0:13337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ea60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6503:x1875444584433024:12345-0@lo:105: Request processed in 106us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572466.364894:0:13337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5403 00000100:00100000:2.0:1788572466.365364:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6503:1875444584433024:0@lo:105: 00010000:00010000:2.0:1788572466.365381:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572466.365431:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2397:x1875444569564160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1246us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572466.365439:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12910 00010000:00010000:2.0:1788572466.365464:0:188050:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.365475:0:188050:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572466.365517:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x4:0x0] 00010000:00010000:2.0:1788572466.365566:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 3/0,1 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.365577:0:188050:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 3/0,1 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.365586:0:188050:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 3/0,1 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572466.365603:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433152:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1788572466.365634:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572466.365663:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572466.365834:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584433152 00000100:00100000:3.0:1788572466.365839:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584433152 00000100:00100000:3.0:1788572466.365876:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1788572466.365886:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:188050:x1875444584433152:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788572466.365901:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572466.365927:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf4b1 lrc: 2/0,0 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf4aa expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.365955:0:188053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf4b1 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf4aa expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.366140:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf4b1 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf4aa expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.366151:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0xf7117594 (ffff8e590d91ea00) 00010000:00010000:3.0:1788572466.366218:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572466.366223:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcfa00, rc 0) 00010000:00000080:3.0:1788572466.366230:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729f480 x1875444584433152/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 328/344 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572466.366280:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188050:x1875444584433152:12345-0@lo:101:mdt00_002.0 Request processed in 396us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572466.366286:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1788572466.366965:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433152:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788572466.366998:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf4b1 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.367009:0:188050:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf4b1 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572466.367028:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x4:0x0] 00000100:00100000:0.0:1788572466.367069:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433280:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788572466.367105:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572466.367132:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a053bb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572466.367470:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584433280 00000100:00100000:3.0:1788572466.367506:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584433280 00000100:00100000:3.0:1788572466.367554:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1788572466.367565:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188050:x1875444584433280:12345-0@lo:1000:mdt00_002.0 00010000:00000080:3.0:1788572466.367610:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa4000 x1875444584433280/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 304/4320 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572466.367655:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188050:x1875444584433280:12345-0@lo:1000:mdt00_002.0 Request processed in 91us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572466.367661:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1788572466.367794:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433280:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788572466.367844:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433408:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788572466.367872:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572466.367898:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572466.368095:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584433408 00000100:00100000:3.0:1788572466.368099:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584433408 00000100:00100000:3.0:1788572466.368133:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1788572466.368141:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188050:x1875444584433408:12345-0@lo:1000:mdt00_002.0 00010000:00000080:3.0:1788572466.368194:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729e680 x1875444584433408/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 328/4320 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572466.368235:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188050:x1875444584433408:12345-0@lo:1000:mdt00_002.0 Request processed in 95us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572466.368241:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1788572466.368390:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433408:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788572466.368427:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433536:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788572466.368449:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572466.368473:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572466.368572:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584433536 00000100:00100000:0.0:1788572466.368577:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584433536 00000100:00100000:0.0:1788572466.368609:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1788572466.368616:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188050:x1875444584433536:12345-0@lo:1000:mdt00_002.0 00010000:00000080:0.0:1788572466.368666:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729ca80 x1875444584433536/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 328/4320 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 1/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572466.368709:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188050:x1875444584433536:12345-0@lo:1000:mdt00_002.0 Request processed in 93us (258us total) trans 0 rc 1/1 00000100:00100000:0.0:1788572466.368716:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1788572466.368807:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433536:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788572466.368859:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.368867:0:188050:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.368876:0:188050:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572466.368891:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433664:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1788572466.368913:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572466.368945:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59056d13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572466.369892:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584433664 00000100:00100000:0.0:1788572466.369900:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584433664 00000100:00100000:0.0:1788572466.369953:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1788572466.369962:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188050:x1875444584433664:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788572466.369986:0:188054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572466.370008:0:188054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf4bf lrc: 2/0,0 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf4b8 expref: -99 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.370034:0:188054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf4bf lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf4b8 expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.370049:0:188054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf4bf lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf4b8 expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.370056:0:188054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590430c200) 00010000:00010000:0.0:1788572466.370059:0:188054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572466.370063:0:188054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164e600, rc 0) 00010000:00000080:0.0:1788572466.370068:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729d880 x1875444584433664/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 328/344 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572466.370126:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:188050:x1875444584433664:12345-0@lo:101:mdt00_002.0 Request processed in 166us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572466.370132:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1788572466.370341:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433664:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788572466.370358:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.370373:0:188050:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.370401:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.370410:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.370419:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572466.370645:0:188050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433792:0@lo:700:mdt00_002.0 00000100:00100000:2.0:1788572466.370676:0:188050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572466.370696:0:188050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59049eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572466.370936:0:188058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584433792 00000100:00100000:0.0:1788572466.370941:0:188058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584433792 00000100:00100000:0.0:1788572466.370986:0:188058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788572466.370994:0:188058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+9:188050:x1875444584433792:12345-0@lo:700:mdt00_002.0 00010000:00000080:0.0:1788572466.371015:0:188058:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729c000 x1875444584433792/t0(0) o700->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 264/248 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572466.371060:0:188058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+9:188050:x1875444584433792:12345-0@lo:700:mdt00_002.0 Request processed in 67us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572466.371066:0:188058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572466.371246:0:188050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:188050:1875444584433792:0@lo:700:mdt00_002.0 00000040:00080000:1.0:1788572466.371356:0:188050:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572466.371374:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].9, 64 off33344 00000004:00080000:1.0:1788572466.371393:0:188050:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a1f29c180 with version 3 00000040:00080000:1.0:1788572466.371443:0:188050:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572466.371452:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].10, 64 off33408 00000004:00080000:1.0:1788572466.371455:0:188050:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a1f29ccc0 with version 4 00000004:00080000:0.0:1788572466.372512:0:198967:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e59050fe900 version 3 rpc_version 3 00000020:00100000:0.0:1788572466.372553:0:198967:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572466.372561:0:198967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1ffa5180 x1875444584434048/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572466.372581:0:198967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584434048:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572466.372631:0:198967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572466.372661:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a053bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572466.372760:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584434048 00000100:00100000:2.0:1788572466.372767:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584434048 00000100:00100000:2.0:1788572466.372806:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1788572466.372814:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198967:x1875444584434048:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:1.0:1788572466.373624:0:188050:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572466.373668:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].5, 64 off33088 00000040:00080000:1.0:1788572466.374139:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].1, 424 off33192 00000040:00080000:1.0:1788572466.374296:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027cd1:0x1:0x0].1, 504 off33272 00000004:00080000:1.0:1788572466.374304:0:188050:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e59056d13c0 with version 5 00000001:00080000:1.0:1788572466.375401:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351002 is committed 00000001:00080000:1.0:1788572466.375427:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351001 is committed 00010000:00000080:2.0:1788572466.375685:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa7b80 x1875444584434048/t347892351002(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 1312/4320 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572466.375818:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198967:x1875444584434048:12345-0@lo:1000:osp_up0-1.0 Request processed in 3004us (3186us total) trans 347892351002 rc 0/0 00000100:00100000:2.0:1788572466.375828:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1788572466.379432:0:198967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584434048:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1788572466.379459:0:198967:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e59050fe900 version 4 rpc_version 4 00000020:00100000:0.0:1788572466.379510:0:198967:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572466.379519:0:198967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1ffa6680 x1875444584434304/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572466.379545:0:198967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584434304:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572466.379617:0:198967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572466.379648:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a053bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572466.379834:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584434304 00000100:00100000:1.0:1788572466.379841:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584434304 00000100:00100000:1.0:1788572466.379900:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1788572466.379922:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198967:x1875444584434304:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1788572466.381918:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351003 is committed 00010000:00000080:1.0:1788572466.382147:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa4700 x1875444584434304/t347892351003(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 1312/4320 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572466.382246:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198967:x1875444584434304:12345-0@lo:1000:osp_up0-1.0 Request processed in 2325us (2628us total) trans 347892351003 rc 0/0 00000100:00100000:1.0:1788572466.382256:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1788572466.382386:0:198967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584434304:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1788572466.382407:0:198967:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e59050fe900 version 5 rpc_version 5 00000020:00100000:0.0:1788572466.382448:0:198967:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572466.382454:0:198967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1ffa7800 x1875444584434560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572466.382521:0:198967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584434560:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572466.382565:0:198967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572466.382727:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584434560 00000100:00100000:2.0:1788572466.382734:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584434560 00000100:00100000:2.0:1788572466.382784:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1788572466.382793:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198967:x1875444584434560:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:2.0:1788572466.384340:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fea5500 x1875444584434560/t347892351004(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:127/0 lens 264/4320 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572466.384391:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:198967:x1875444584434560:12345-0@lo:1000:osp_up0-1.0 Request processed in 1599us (1825us total) trans 347892351004 rc 0/0 00000100:00100000:2.0:1788572466.384401:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1788572466.385213:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a053bb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572466.385257:0:198967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584434560:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1788572466.385345:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x16:0x0]: returning size 4096 00010000:00010000:1.0:1788572466.385370:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385385:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385392:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385398:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572466.385405:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385413:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385429:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e5a18bebd00) 00010000:00010000:1.0:1788572466.385432:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572466.385437:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385443:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4c6 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385474:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385517:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385524:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385759:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788572466.385777:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x4:0x0] 00010000:00010000:1.0:1788572466.385786:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385794:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.385800:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.385859:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572466.385867:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.385874:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b600 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:3.0:1788572466.385878:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572466.385887:0:10395:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.386060:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.386068:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572466.386106:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 1/0,0 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.386113:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7b600/0x265cfe11109bf4b8 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf4bf expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.386130:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572466.386134:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 4/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.386139:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fa00 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572466.386144:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 5/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572466.386150:0:10395:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 5/0,0 mode: CW/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.386165:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 4/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.386170:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572466.386181:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 3/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.386188:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.386190:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572466.386191:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572466.386293:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572466.386310:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584434688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572466.386365:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572466.386409:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572466.386417:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584434816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572466.386442:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572466.386508:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584434688 00000100:00100000:0.0:1788572466.386515:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584434688 00000100:00100000:0.0:1788572466.386559:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584434816 00000100:00100000:0.0:1788572466.386563:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584434816 00000100:00100000:0.0:1788572466.386799:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4676 00000100:00100000:0.0:1788572466.386810:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3643:x1875444584434688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572466.386825:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572466.386843:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf4bf lrc: 0/0,0 mode: --/EX res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf4b8 expref: 11 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572466.386858:0:152004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x0 (ffff8e590430c200) 00010000:00010000:0.0:1788572466.386867:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572466.386918:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3643:x1875444584434688:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572466.386985:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584434688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572466.388820:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572466.388835:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fa00/0x265cfe11109bf49c lrc: 0/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf4a3 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572466.388868:0:188050:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x4:0x0] 00010000:00010000:1.0:1788572466.388876:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf4b1 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572466.388884:0:188050:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf4b1 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572466.389008:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572466.389170:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:164279:x1875444569564032:12345-192.168.202.57@tcp:36:rm.0 Request processed in 28907us (29090us total) trans 25769803845 rc 0/0 00000100:00100000:1.0:1788572466.389179:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1264 00000100:00100000:2.0:1788572466.389732:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4677 00000100:00100000:2.0:1788572466.389749:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3642:x1875444584434816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572466.389764:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572466.389788:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf4a3 lrc: 0/0,0 mode: --/CW res: [0x200027501:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf49c expref: 10 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.389806:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:2.0:1788572466.389811:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572466.389859:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3642:x1875444584434816:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (3416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572466.389865:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4677 00000100:00100000:2.0:1788572466.392362:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584434816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572466.392596:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4676 00000100:00100000:0.0:1788572466.396441:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572466.396872:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569564416 00000100:00100000:3.0:1788572466.396882:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569564416 00000100:00100000:3.0:1788572466.396948:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 63 00000100:00100000:3.0:1788572466.396959:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164279:x1875444569564416:12345-192.168.202.57@tcp:35:rm.0 00010000:00000080:3.0:1788572466.397311:0:188052:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fea6a00 x1875444569564416/t347892351005(0) o35->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:127/0 lens 392/456 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788572466.397422:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164279:x1875444569564416:12345-192.168.202.57@tcp:35:rm.0 Request processed in 464us (988us total) trans 347892351005 rc 0/0 00000100:00100000:3.0:1788572466.397431:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 63 00000100:00100000:3.0:1788572466.404411:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572466.404520:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569564672 00000100:00100000:2.0:1788572466.404540:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569564672 00000100:00100000:2.0:1788572466.404613:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1265 00000100:00100000:2.0:1788572466.404625:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164279:x1875444569564672:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572466.405034:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788572466.405062:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfe00/0x265cfe11109bf211 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5c0 expref: 10 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405084:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b200/0x265cfe11109beaee lrc: 0/0,0 mode: --/PR res: [0x200027501:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4b6 expref: 9 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405098:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e590430c300) 00010000:00010000:2.0:1788572466.405115:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109beec2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb503 expref: 8 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405124:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:2.0:1788572466.405127:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572466.405151:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405165:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405174:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405190:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405201:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405207:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405305:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 3/0,1 mode: --/EX res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405314:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.405321:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572466.406878:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1788572466.407036:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407048:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407055:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407061:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.407066:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407074:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407091:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e5a18beb000) 00010000:00010000:2.0:1788572466.407094:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572466.407098:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 2/0,0 mode: --/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407104:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a000/0x265cfe11109bf4db lrc: 0/0,0 mode: --/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407130:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407136:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407141:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407146:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572466.407149:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407155:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407162:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:2.0:1788572466.407164:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572466.407167:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407173:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7b600/0x265cfe11109bf4cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572466.407186:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd28d59a reply state 00000000aeab5358 transno 347892351006 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407196:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572466.407202:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8e5a18beb800) 00010000:00010000:2.0:1788572466.407204:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572466.407207:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1788572466.407230:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36a4e300 x1875444569564672/t347892351006(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:127/0 lens 512/456 e 0 to 0 dl 1788572477 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572466.407366:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164279:x1875444569564672:12345-192.168.202.57@tcp:36:rm.0 Request processed in 2743us (2965us total) trans 347892351006 rc 0/0 00000100:00100000:2.0:1788572466.407375:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1265 00010000:00010000:2.0:1788572466.815184:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572467.068945:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584435328:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069104:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.069148:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584435840:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069175:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.069195:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584436352:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.069241:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788572467.069247:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584434944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069277:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.069304:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584435456:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069325:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.069339:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584435968:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069362:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.069375:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584436480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069392:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572467.069425:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584435840 00000100:00100000:1.0:1788572467.069433:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584435840 00000100:00100000:1.0:1788572467.069582:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584436352 00000100:00100000:1.0:1788572467.069586:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584436352 00000100:00100000:1.0:1788572467.069611:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7838 00000100:00100000:1.0:1788572467.069620:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584435840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069674:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584435840:12345-0@lo:400:kworker.0 Request processed in 54us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.069680:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7838 00000100:00100000:1.0:1788572467.069697:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7839 00000100:00100000:1.0:1788572467.069703:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584436352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069731:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584436352:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.069737:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7839 00000100:00100000:1.0:1788572467.069758:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584434944 00000100:00100000:1.0:1788572467.069761:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584434944 00000100:00100000:1.0:1788572467.069787:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788572467.069794:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584434944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069820:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584434944:12345-0@lo:400:kworker.0 Request processed in 27us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.069826:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788572467.069870:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584434944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069883:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584435840:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069891:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584436352:0@lo:400:kworker.0 00000100:00100000:1.0:1788572467.069917:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584435328 00000100:00100000:1.0:1788572467.069921:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584435328 00000100:00100000:1.0:1788572467.069947:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584435456 00000100:00100000:1.0:1788572467.069950:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584435456 00000100:00100000:1.0:1788572467.069964:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584435968 00000100:00100000:1.0:1788572467.069967:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584435968 00000100:00080000:0.0:1788572467.070086:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572467.070090:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572467.070093:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572467.070109:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584436480 00000100:00100000:0.0:1788572467.070113:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584436480 00000100:00100000:0.0:1788572467.070135:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1788572467.070141:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584435328:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572467.070155:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f8f1f80 x1875444584435328/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1788572478 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572467.070198:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584435328:12345-0@lo:400:kworker.0 Request processed in 58us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.070208:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1788572467.070221:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1788572467.070227:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584435456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.070255:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584435456:12345-0@lo:400:kworker.0 Request processed in 28us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.070260:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1788572467.070269:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1788572467.070274:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584436480:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572467.070282:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f8f2680 x1875444584436480/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1788572478 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572467.070302:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584436480:12345-0@lo:400:kworker.0 Request processed in 29us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.070306:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1788572467.070354:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584435456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.070365:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584436480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.070372:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584435328:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.070642:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584435072:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.070669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.070699:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584435584:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.070718:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.070734:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584436096:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.070751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.070765:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584436608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572467.070779:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.070795:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572467.070800:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584435200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.070817:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.070829:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584435712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.070845:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.070861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584436224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.070877:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572467.070902:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584435712 00000100:00100000:3.0:1788572467.070906:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584435712 00000100:00100000:3.0:1788572467.070931:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584436224 00000100:00100000:3.0:1788572467.070933:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584436224 00000100:00100000:3.0:1788572467.070953:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7840 00000100:00100000:3.0:1788572467.070959:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584435712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.071067:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584435584 00000100:00100000:2.0:1788572467.071071:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584435584 00000100:00100000:2.0:1788572467.071094:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584436096 00000100:00100000:2.0:1788572467.071097:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584436096 00000100:00100000:2.0:1788572467.071107:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584436608 00000100:00100000:2.0:1788572467.071110:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584436608 00000100:00100000:2.0:1788572467.071120:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1788572467.071126:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584435584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.071166:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584435584:12345-0@lo:400:kworker.0 Request processed in 40us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.071172:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1788572467.071198:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1788572467.071204:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3643:x1875444584436096:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572467.071219:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36a4ca80 x1875444584436096/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1788572478 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572467.071245:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3643:x1875444584436096:12345-0@lo:400:kworker.0 Request processed in 41us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.071250:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1788572467.071262:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1788572467.071268:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3643:x1875444584436608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572467.071293:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:2.0:1788572467.071303:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36a4c700 x1875444584436608/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:128/0 lens 224/368 e 0 to 0 dl 1788572478 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572467.071328:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3643:x1875444584436608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.071334:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1788572467.071350:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584435072 00000100:00100000:2.0:1788572467.071354:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584435072 00000100:00100000:2.0:1788572467.071377:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584435200 00000100:00100000:2.0:1788572467.071380:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584435200 00000100:00100000:2.0:1788572467.071397:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1788572467.071403:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584435072:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572467.071413:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36a4d880 x1875444584435072/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1788572478 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572467.071439:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584435072:12345-0@lo:400:kworker.0 Request processed in 36us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.071444:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1788572467.071454:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1788572467.071459:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584435200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.071732:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584436736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572467.074149:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1788572467.074174:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584435968:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572467.074207:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f8f2d80 x1875444584435968/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1788572478 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572467.080045:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584435712:12345-0@lo:400:kworker.0 Request processed in 9075us (9188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572467.080061:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7840 00000100:00100000:3.0:1788572467.080099:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7841 00000100:00100000:3.0:1788572467.080113:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584436224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.080161:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584436224:12345-0@lo:400:kworker.0 Request processed in 56us (9283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572467.080166:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7841 00000100:00080000:3.0:1788572467.080202:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572467.080207:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572467.080212:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572467.080254:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584435200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.080266:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584435712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.080275:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584436224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.080285:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584435072:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.080295:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584435584:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.080306:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584436096:0@lo:400:kworker.0 00000100:00100000:3.0:1788572467.080322:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584436608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572467.081331:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584435200:12345-0@lo:400:kworker.0 Request processed in 9866us (10506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.081342:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1788572467.081534:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572467.081679:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584436736 00000100:00100000:2.0:1788572467.081687:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584436736 00000100:00100000:2.0:1788572467.081737:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1788572467.081746:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584436736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572467.081776:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445978112 avail 1299738624 00000100:00100000:2.0:1788572467.081830:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584436736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.081836:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1788572467.082027:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584436736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572467.082207:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584435968:12345-0@lo:400:kworker.0 Request processed in 8043us (12842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.082218:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1788572467.085343:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584435968:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.564122:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572467.564174:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572467.564197:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572467.564222:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572467.564246:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572467.564274:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569565312 00000100:00100000:2.0:1788572467.564284:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569565312 00000100:00100000:2.0:1788572467.564353:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569565184 00000100:00100000:2.0:1788572467.564357:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569565184 00000100:00100000:2.0:1788572467.564385:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7842 00000100:00100000:2.0:1788572467.564396:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569565312:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572467.564472:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569565312:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 68us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.564502:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7842 00000100:00100000:2.0:1788572467.564520:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7843 00000100:00100000:2.0:1788572467.564527:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569565184:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572467.564554:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569565184:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.564561:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7843 00000100:00100000:3.0:1788572467.564860:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569564800 00000100:00100000:3.0:1788572467.564865:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569564800 00000100:00100000:3.0:1788572467.564899:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 140 00000100:00100000:3.0:1788572467.564906:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569564800:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572467.564933:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569564800:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572467.564940:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 140 00000100:00100000:3.0:1788572467.564970:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569565056 00000100:00100000:3.0:1788572467.564974:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569565056 00000100:00100000:3.0:1788572467.565024:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569564928 00000100:00100000:3.0:1788572467.565027:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569564928 00000100:00100000:3.0:1788572467.565053:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 475 00000100:00100000:3.0:1788572467.565060:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:2399:x1875444569565056:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572467.565092:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:2399:x1875444569565056:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572467.565099:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 475 00000100:00100000:3.0:1788572467.565111:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 476 00000100:00100000:3.0:1788572467.565117:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:2399:x1875444569564928:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572467.565130:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b90e00 x1875444569564928/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:128/0 lens 224/224 e 0 to 0 dl 1788572478 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572467.565149:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:2399:x1875444569564928:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572467.565155:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 476 00000100:00080000:3.0:1788572467.565170:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572467.565174:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572467.565176:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572467.565178:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788572467.586109:0:198970:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 9220580627387ns, next at 9221580624646ns, rc = 0 00000100:00100000:0.0:1788572467.586133:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572467.586153:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584436864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572467.586221:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.586277:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584436864 00000100:00100000:0.0:1788572467.586285:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584436864 00000100:00100000:0.0:1788572467.586326:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6417 00000100:00100000:0.0:1788572467.586347:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584436864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572467.586375:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572467.586413:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584436864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.586420:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6417 00000100:00100000:0.0:1788572467.586462:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584436864:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788572467.586535:0:198972:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 9220581055389ns, next at 9221581054312ns, rc = 0 00000100:00100000:0.0:1788572467.586547:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584436992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572467.586569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.586605:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584436992 00000100:00100000:0.0:1788572467.586609:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584436992 00000100:00100000:0.0:1788572467.586628:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6418 00000100:00100000:0.0:1788572467.586634:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584436992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572467.586648:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572467.586674:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584436992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.586679:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6418 00000100:00100000:0.0:1788572467.586702:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584436992:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572467.836749:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572468.094270:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584437120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572468.094351:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.094413:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584437120 00000100:00100000:2.0:1788572468.094421:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584437120 00000100:00100000:2.0:1788572468.094472:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6419 00000100:00100000:2.0:1788572468.094687:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584437120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572468.094712:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572468.094775:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584437120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 295us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.094784:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6419 00000100:00100000:2.0:1788572468.094838:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584437120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572468.094923:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572468.095563:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584437248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572468.095603:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572468.095840:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584437248 00000100:00100000:3.0:1788572468.095846:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584437248 00000100:00100000:3.0:1788572468.095921:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6420 00000100:00100000:3.0:1788572468.095930:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584437248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572468.095951:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572468.096010:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584437248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572468.096017:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6420 00000100:00100000:1.0:1788572468.096078:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584437248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572468.860868:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572469.884716:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572470.909214:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572471.181244:0:198961:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:1.0:1788572471.181273:0:198961:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00010000:00010000:1.0:1788572471.181335:0:198961:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf4b1 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181351:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572471.181354:0:198961:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf4b1 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181367:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181378:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181389:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.181394:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181401:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181419:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x679fc7b1 (ffff8e5a18b3fb00) 00010000:00010000:1.0:1788572471.181420:0:198961:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 2/0,0 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf4b1 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181424:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.181431:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.181432:0:198961:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572471.181439:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f800/0x265cfe11109bef1d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181463:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.181467:0:198961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5904a7be00/0x265cfe11109bf4aa lrc: 0/0,0 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf4b1 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181471:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181506:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181512:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.181515:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788572471.181558:0:198961:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803845 is committed 00000004:00080000:1.0:1788572471.181611:0:198961:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000004:00080000:1.0:1788572471.181619:0:198961:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00010000:00010000:2.0:1788572471.181951:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181966:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x94c295fa (ffff8e5a18b3fc00) 00010000:00010000:2.0:1788572471.181969:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.181973:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181979:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e600/0x265cfe11109bef40 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.181992:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182008:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182014:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182020:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcea00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182023:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182029:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182036:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xc1e56442 (ffff8e590b3b4f00) 00010000:00010000:2.0:1788572471.182038:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182041:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182047:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bef63 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182060:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182067:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182072:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182077:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182079:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182085:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182092:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xef08328a (ffff8e590d91e200) 00010000:00010000:2.0:1788572471.182094:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182097:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182103:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcee00/0x265cfe11109bef86 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182113:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182119:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182124:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182129:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182132:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182138:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182145:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x1c2b00d3 (ffff8e5a18b3f500) 00010000:00010000:2.0:1788572471.182147:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182150:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182156:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f600/0x265cfe11109befa9 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182166:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182172:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182178:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182257:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182260:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182266:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182279:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x494dcf1b (ffff8e590b3b4300) 00010000:00010000:2.0:1788572471.182282:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182285:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182291:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109befcc lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182304:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182310:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182317:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182323:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ea00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182326:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182332:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182342:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x76709d63 (ffff8e5a18b3f300) 00010000:00010000:2.0:1788572471.182345:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182348:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182354:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109befef lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182368:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182374:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182379:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182384:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ec00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182386:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182391:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182398:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xa3936bac (ffff8e5a18b3f200) 00010000:00010000:2.0:1788572471.182400:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182403:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182409:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bf012 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182419:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182425:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182431:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182438:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182441:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182449:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182458:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xd0b639f4 (ffff8e590b3b4700) 00010000:00010000:2.0:1788572471.182461:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182463:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182468:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254600/0x265cfe11109bf035 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182508:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182516:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182534:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182541:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182544:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182550:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182563:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xfdd9083c (ffff8e5a18bebf00) 00010000:00010000:2.0:1788572471.182565:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182568:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182573:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b800/0x265cfe11109bf058 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182585:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182591:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182596:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182601:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182603:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182608:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182615:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x1b7026cc (ffff8e5a18beb700) 00010000:00010000:2.0:1788572471.182617:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182620:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182625:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b000/0x265cfe11109bf07b lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182636:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182642:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182648:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182652:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182655:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182661:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182667:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x3e3e6f26 (ffff8e590430c000) 00010000:00010000:2.0:1788572471.182669:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182672:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182677:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109bf09e lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182689:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182695:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182701:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182709:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182713:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182719:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182726:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x610cb780 (ffff8e5a18beb300) 00010000:00010000:2.0:1788572471.182728:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182730:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182736:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7b400/0x265cfe11109bf0c1 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182745:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182751:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182756:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182760:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182763:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182769:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182780:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x83daffd9 (ffff8e590430c600) 00010000:00010000:2.0:1788572471.182782:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182785:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182791:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109bf0e4 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182804:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182812:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182818:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182823:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182826:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182832:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182839:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xa6a94833 (ffff8e590b3b4e00) 00010000:00010000:2.0:1788572471.182841:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182844:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182850:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255e00/0x265cfe11109bf107 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182863:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182870:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.182874:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584437504:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1788572471.182877:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182899:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7bc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182902:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182909:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182918:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xc977908d (ffff8e5a18beb100) 00010000:00010000:2.0:1788572471.182920:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182924:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182930:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf12a lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182942:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182948:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182954:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.182962:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572471.182967:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.182971:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182978:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.182987:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xec45d8e7 (ffff8e5a18beb200) 00010000:00010000:2.0:1788572471.182990:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.182993:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183010:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a600/0x265cfe11109bf14d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183023:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183030:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183036:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183041:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183044:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183051:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183063:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xf142140 (ffff8e590b3b4000) 00010000:00010000:2.0:1788572471.183066:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183069:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183075:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11254800/0x265cfe11109bf170 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183088:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183094:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183100:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183106:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183109:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183115:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183121:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x31e2699a (ffff8e590430c400) 00010000:00010000:2.0:1788572471.183124:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183127:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183132:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f400/0x265cfe11109bf193 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183143:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183149:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183155:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183159:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584438016:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1788572471.183163:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183168:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183175:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572471.183196:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x54b0b1f4 (ffff8e590d91e400) 00010000:00010000:2.0:1788572471.183201:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183205:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183212:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf1b6 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183224:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183230:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183232:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584438528:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1788572471.183243:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183250:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183253:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183259:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183267:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x83daffd9 (ffff8e590430c600) 00010000:00010000:2.0:1788572471.183270:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183272:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183281:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572471.183283:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bf249 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183306:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183308:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584439040:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1788572471.183317:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183323:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183328:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ec00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183332:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183339:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572471.183340:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183354:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xc1e56442 (ffff8e590b3b4f00) 00010000:00010000:2.0:1788572471.183357:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183360:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183363:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00010000:00010000:2.0:1788572471.183369:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf265 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183374:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584437376:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1788572471.183387:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183394:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183401:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572471.183411:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183414:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183420:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183429:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xa3936bac (ffff8e5a18b3f200) 00000100:00100000:1.0:1788572471.183430:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584437888:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1788572471.183433:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183439:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183445:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5a00/0x265cfe11109bf281 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572471.183460:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183467:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183473:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183502:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183505:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.183511:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584438400:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1788572471.183513:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183524:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x31e2699a (ffff8e590430c400) 00010000:00010000:2.0:1788572471.183526:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183529:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183535:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a200/0x265cfe11109bf29d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183550:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183557:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183563:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183569:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183571:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183576:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183583:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xef08328a (ffff8e590d91e200) 00010000:00010000:2.0:1788572471.183585:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183588:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183593:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5600/0x265cfe11109bf2b9 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183605:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183609:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183615:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183620:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183623:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183628:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183638:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xec45d8e7 (ffff8e5a18beb200) 00010000:00010000:2.0:1788572471.183640:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183643:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183649:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5400/0x265cfe11109bf2d5 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183664:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183669:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183674:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183679:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ba00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183682:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183687:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183694:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x1c2b00d3 (ffff8e5a18b3f500) 00010000:00010000:2.0:1788572471.183696:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183699:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183705:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf2f1 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183718:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183724:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183729:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183734:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905bb5c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183736:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183742:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183750:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xc977908d (ffff8e5a18beb100) 00010000:00010000:2.0:1788572471.183753:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183755:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183760:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905bb5c00/0x265cfe11109bf30d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183775:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183780:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183785:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183791:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.183794:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183800:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183807:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x679fc7b1 (ffff8e5a18b3fb00) 00010000:00010000:2.0:1788572471.183809:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.183812:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183818:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bf329 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183832:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183838:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.183843:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.184090:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184123:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584438912:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572471.184154:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184173:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584439424:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572471.184193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184227:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584437632:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1788572471.184251:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184266:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584438144:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1788572471.184284:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184301:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584438656:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572471.184319:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184335:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584439168:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572471.184353:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184380:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788572471.184386:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584437760:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1788572471.184406:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184422:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584438272:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1788572471.184441:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184457:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584438784:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572471.184474:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572471.184506:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584439296:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788572471.184525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572471.184750:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584437504 00000100:00100000:3.0:1788572471.184759:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584437504 00000100:00100000:3.0:1788572471.184813:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584438016 00000100:00100000:1.0:1788572471.184816:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584438528 00000100:00100000:3.0:1788572471.184817:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584438016 00000100:00100000:3.0:1788572471.184837:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584439040 00000100:00100000:3.0:1788572471.184840:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584439040 00000100:00100000:3.0:1788572471.184855:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584437888 00000100:00100000:3.0:1788572471.184857:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584437888 00000100:00100000:3.0:1788572471.184868:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584438400 00000100:00100000:3.0:1788572471.184871:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584438400 00000100:00100000:3.0:1788572471.184881:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584438912 00000100:00100000:3.0:1788572471.184884:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584438912 00000100:00100000:1.0:1788572471.184891:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584438528 00000100:00100000:3.0:1788572471.184895:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584439424 00000100:00100000:3.0:1788572471.184900:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584439424 00000100:00100000:1.0:1788572471.184930:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584437632 00000100:00100000:1.0:1788572471.184934:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584437632 00010000:00010000:2.0:1788572471.186127:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.186135:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186147:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186169:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xd0b639f4 (ffff8e590b3b4700) 00010000:00010000:2.0:1788572471.186172:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.186177:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186612:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a11255a00/0x265cfe11109bf345 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186653:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186662:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186670:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186675:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.186679:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186685:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186695:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xfdd9083c (ffff8e5a18bebf00) 00010000:00010000:2.0:1788572471.186698:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.186701:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186708:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e200/0x265cfe11109bf361 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186727:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186733:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186739:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186744:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7aa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.186747:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186752:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186759:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x3e3e6f26 (ffff8e590430c000) 00010000:00010000:2.0:1788572471.186761:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.186765:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186771:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7aa00/0x265cfe11109bf37d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186791:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186797:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186803:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186809:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.186812:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186818:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186824:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x54b0b1f4 (ffff8e590d91e400) 00010000:00010000:2.0:1788572471.186826:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.186829:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186833:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5904a7a800/0x265cfe11109bf399 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186848:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186855:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186861:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186866:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.186869:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.186875:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187268:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xf142140 (ffff8e590b3b4000) 00010000:00010000:2.0:1788572471.187272:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.187276:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187284:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fe00/0x265cfe11109bf3b5 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187310:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187317:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187323:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187329:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.187332:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187338:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187346:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x94c295fa (ffff8e5a18b3fc00) 00010000:00010000:2.0:1788572471.187348:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.187351:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187357:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109bf3d1 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187378:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187384:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187389:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187395:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.187398:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187404:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187411:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x1b7026cc (ffff8e5a18beb700) 00010000:00010000:2.0:1788572471.187414:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.187416:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187422:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bf3ed lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187439:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187446:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187451:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187457:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.187460:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187466:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187474:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0xa6a94833 (ffff8e590b3b4e00) 00010000:00010000:2.0:1788572471.187476:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.187511:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187518:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109bf409 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187980:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187986:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.187992:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188008:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.188012:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188018:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188032:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x494dcf1b (ffff8e590b3b4300) 00010000:00010000:2.0:1788572471.188035:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.188038:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188044:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf425 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188060:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188066:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188073:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188078:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.188081:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188088:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188096:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x610cb780 (ffff8e5a18beb300) 00010000:00010000:2.0:1788572471.188098:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.188102:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188108:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109bf441 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188123:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188130:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188135:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188140:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572471.188142:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188149:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188156:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x16:0x0].0x76709d63 (ffff8e5a18b3f300) 00010000:00010000:2.0:1788572471.188158:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572471.188161:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188168:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e400/0x265cfe11109bf45d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572471.188638:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584437376 00000100:00100000:2.0:1788572471.188649:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584437376 00000100:00100000:2.0:1788572471.188716:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4678 00000100:00100000:2.0:1788572471.188726:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3642:x1875444584437376:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1788572471.188740:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572471.188760:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcfa00/0x265cfe11109bf4b1 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf4aa expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.188772:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0xf7117594 (ffff8e590d91ea00) 00010000:00010000:2.0:1788572471.188780:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572471.188853:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3642:x1875444584437376:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 129us (5450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572471.188861:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4678 00000100:00100000:1.0:1788572471.189188:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584438144 00000100:00100000:1.0:1788572471.189194:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584438144 00000100:00100000:1.0:1788572471.189224:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584438656 00000100:00100000:1.0:1788572471.189227:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584438656 00000100:00100000:1.0:1788572471.189240:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584439168 00000100:00100000:1.0:1788572471.189243:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584439168 00000100:00100000:1.0:1788572471.189252:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584437760 00000100:00100000:1.0:1788572471.189255:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584437760 00000100:00100000:2.0:1788572471.189265:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584438272 00000100:00100000:2.0:1788572471.189272:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584438272 00000100:00100000:1.0:1788572471.189274:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584438784 00000100:00100000:1.0:1788572471.189279:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584438784 00000100:00100000:2.0:1788572471.189297:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584439296 00000100:00100000:2.0:1788572471.189302:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584439296 00000100:00100000:1.0:1788572471.189306:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22699 00000100:00100000:1.0:1788572471.189318:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3642:x1875444584437504:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1788572471.189325:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22700 00000100:00100000:2.0:1788572471.189335:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3642:x1875444584438016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1788572471.189353:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:614 count 1 00002000:00080000:1.0:1788572471.189354:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:616 count 1 00002000:00010000:1.0:1788572471.189402:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x268:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788572471.189402:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x266:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572471.189419:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.189420:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.189450:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x268:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:2.0:1788572471.189450:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x266:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:1.0:1788572471.189462:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.189462:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.189474:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.189475:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.189510:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.189514:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.189526:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.189534:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.189960:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.189968:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.189983:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572471.190162:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584438016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 827us (6968us total) trans 4294975689 rc 0/0 00000100:00100000:2.0:1788572471.190169:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22700 00000100:00100000:2.0:1788572471.190623:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22701 00000100:00100000:2.0:1788572471.190634:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3642:x1875444584439040:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1788572471.190652:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:610 count 1 00002000:00010000:2.0:1788572471.190673:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x262:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572471.190678:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.190689:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x262:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:2.0:1788572471.190693:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.190698:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.190710:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.190717:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.190728:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.190747:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572471.190839:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584439040:12345-0@lo:6:osp-syn-0-1.0 Request processed in 209us (7501us total) trans 38654705680 rc 0/0 00000100:00100000:2.0:1788572471.190845:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22701 00000100:00100000:2.0:1788572471.190859:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22702 00000100:00100000:2.0:1788572471.190866:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3642:x1875444584437888:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1788572471.190877:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:617 count 1 00010000:00010000:1.0:1788572471.191289:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572471.191390:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584437504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2075us (8431us total) trans 4294975690 rc 0/0 00000100:00100000:1.0:1788572471.191398:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22699 00000100:00100000:1.0:1788572471.191417:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22703 00000100:00100000:1.0:1788572471.191425:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3642:x1875444584438400:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1788572471.191441:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:618 count 1 00002000:00010000:1.0:1788572471.191459:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572471.191465:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191476:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26a:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:1.0:1788572471.191495:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572471.191500:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191517:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191527:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191535:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191613:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788572471.191621:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x269:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572471.191629:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.191638:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x269:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:2.0:1788572471.191642:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.191646:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.191683:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584438400:12345-0@lo:6:osp-syn-1-1.0 Request processed in 259us (8141us total) trans 4294975691 rc 0/0 00000100:00100000:1.0:1788572471.191690:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22703 00000100:00100000:1.0:1788572471.191704:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22704 00000100:00100000:1.0:1788572471.191712:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3642:x1875444584438912:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1788572471.191784:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:612 count 1 00002000:00010000:1.0:1788572471.191800:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x264:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572471.191806:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191815:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x264:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:1.0:1788572471.191818:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.191822:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191823:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.191844:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191854:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.191870:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191873:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191888:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.191910:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788572471.191924:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572471.191932:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.191942:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572471.191947:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.191951:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788572471.191957:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.191974:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.191982:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039ac9446/0x265cfe11109bf4e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192013:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572471.192017:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192024:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572471.192027:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572471.192034:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584437888:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1168us (8575us total) trans 4294975692 rc 0/0 00010000:00010000:0.0:1788572471.192036:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572471.192041:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22702 00010000:00010000:0.0:1788572471.192051:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572471.192055:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22705 00010000:00010000:0.0:1788572471.192058:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bf9e4f0/0x265cfe11109bf4e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572471.192062:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584438528:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1788572471.192074:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00002000:00080000:2.0:1788572471.192074:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:611 count 1 00010000:00010000:0.0:1788572471.192077:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192083:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572471.192086:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572471.192087:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x263:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572471.192092:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192094:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.192100:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x263:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:0.0:1788572471.192104:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.192104:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.192108:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192112:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bf4f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.192117:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192124:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572471.192125:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192127:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192134:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572471.192138:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.192139:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192145:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.192147:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788572471.192154:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192160:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f35faf6/0x265cfe11109bf4f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192172:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572471.192176:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192182:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572471.192185:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.192185:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584438912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 281us (7836us total) trans 38654705681 rc 0/0 00000100:00100000:2.0:1788572471.192201:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3642:x1875444584438528:12345-0@lo:6:osp-syn-0-1.0 Request processed in 140us (8924us total) trans 38654705682 rc 0/0 00010000:00010000:0.0:1788572471.192202:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.192203:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22704 00000100:00100000:2.0:1788572471.192212:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22705 00010000:00010000:0.0:1788572471.192216:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192223:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bf505 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.192229:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22706 00010000:00010000:0.0:1788572471.192243:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788572471.192244:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3642:x1875444584439424:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1788572471.192248:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192256:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572471.192259:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572471.192260:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:617 count 1 00010000:00010000:0.0:1788572471.192271:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192279:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572471.192282:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x269:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572471.192290:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e447316/0x265cfe11109bf4fe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.192293:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192308:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572471.192309:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x269:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:0.0:1788572471.192314:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.192315:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572471.192325:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192327:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572471.192333:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192356:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.192360:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192369:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.192373:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192380:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bf50c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.192387:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572471.192388:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22707 00010000:00010000:0.0:1788572471.192397:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572471.192399:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3643:x1875444584437632:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1788572471.192400:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572471.192402:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572471.192405:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572471.192407:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00080000:2.0:1788572471.192411:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:613 count 1 00010000:00010000:0.0:1788572471.192413:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192419:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572471.192422:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572471.192428:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x265:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572471.192430:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.192432:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.192441:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x265:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:0.0:1788572471.192442:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.192444:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.192449:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192450:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bf513 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.192459:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192465:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.192466:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.192467:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572471.192469:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.192503:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.192508:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584439424:12345-0@lo:6:osp-syn-0-1.0 Request processed in 267us (8312us total) trans 38654705683 rc 0/0 00000100:00100000:1.0:1788572471.192518:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22706 00000100:00100000:1.0:1788572471.192531:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22708 00000100:00100000:1.0:1788572471.192538:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3643:x1875444584438144:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1788572471.192551:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:615 count 1 00010000:00010000:2.0:1788572471.193253:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572471.193274:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x267:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572471.193281:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.193293:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x267:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:1.0:1788572471.193297:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572471.193301:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.193319:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.193329:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.193337:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.193347:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572471.193367:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3643:x1875444584437632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 968us (9112us total) trans 4294975693 rc 0/0 00000100:00100000:2.0:1788572471.193375:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22707 00000100:00100000:2.0:1788572471.193396:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22709 00000100:00100000:2.0:1788572471.193405:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3643:x1875444584438656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1788572471.193420:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:619 count 1 00000100:00100000:1.0:1788572471.193422:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3643:x1875444584438144:12345-0@lo:6:osp-syn-1-1.0 Request processed in 883us (9135us total) trans 4294975694 rc 0/0 00000100:00100000:1.0:1788572471.193430:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22708 00002000:00010000:2.0:1788572471.193438:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572471.193446:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572471.193449:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22710 00010000:00010000:2.0:1788572471.193460:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26b:0x0].0x0 since=9224s v=(0 0) 00000100:00100000:1.0:1788572471.193461:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3643:x1875444584439168:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1788572471.193468:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.193474:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572471.193505:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:614 count 1 00010000:00010000:2.0:1788572471.193518:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572471.193524:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x266:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572471.193530:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.193539:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x266:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:1.0:1788572471.193542:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572471.193546:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.193958:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.193970:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.193978:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572471.194079:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3643:x1875444584438656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 676us (9758us total) trans 38654705684 rc 0/0 00000100:00100000:2.0:1788572471.194086:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22709 00000100:00100000:2.0:1788572471.194101:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22711 00000100:00100000:2.0:1788572471.194108:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3643:x1875444584437760:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1788572471.194122:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:611 count 1 00002000:00010000:2.0:1788572471.194137:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x263:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572471.194143:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.194151:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x263:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:2.0:1788572471.194154:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.194158:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.194168:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.194175:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.194595:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.194607:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788572471.194655:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.194666:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.194674:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572471.194687:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3643:x1875444584437760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 579us (10279us total) trans 4294975695 rc 0/0 00000100:00100000:2.0:1788572471.194694:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22711 00000100:00100000:2.0:1788572471.194709:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22712 00000100:00100000:2.0:1788572471.194715:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3643:x1875444584438272:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1788572471.194727:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:619 count 1 00002000:00010000:2.0:1788572471.194741:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572471.194746:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.194755:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26b:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:2.0:1788572471.194758:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.194762:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.194772:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.194779:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788572471.194781:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.194797:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.194807:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1788572471.194873:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3643:x1875444584439168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1412us (10516us total) trans 38654705685 rc 0/0 00000100:00100000:1.0:1788572471.194880:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22710 00000100:00100000:1.0:1788572471.194897:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22713 00000100:00100000:1.0:1788572471.194905:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3643:x1875444584438784:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1788572471.194918:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:618 count 1 00002000:00010000:1.0:1788572471.194936:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572471.194941:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.194950:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26a:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:1.0:1788572471.194954:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572471.194958:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.194974:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.194983:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.195223:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.195234:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1788572471.195312:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3643:x1875444584438784:12345-0@lo:6:osp-syn-0-1.0 Request processed in 407us (10836us total) trans 38654705686 rc 0/0 00000100:00100000:1.0:1788572471.195320:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22713 00000100:00100000:1.0:1788572471.195336:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22714 00000100:00100000:1.0:1788572471.195345:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3643:x1875444584439296:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1788572471.195358:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:615 count 1 00002000:00010000:1.0:1788572471.195372:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x267:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572471.195377:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.195386:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x267:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:1.0:1788572471.195389:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572471.195394:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.195408:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.195416:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.195424:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572471.195433:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:1.0:1788572471.195519:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3643:x1875444584439296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 176us (10992us total) trans 38654705687 rc 0/0 00000100:00100000:1.0:1788572471.195525:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22714 00000100:00080000:3.0:1788572471.196704:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572471.196712:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572471.196918:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788572471.196928:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.196940:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572471.196947:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.196960:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.196992:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197012:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bf51a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197035:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788572471.197039:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197044:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572471.197048:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197056:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197064:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197071:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd40334/0x265cfe11109bf521 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197088:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572471.197093:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197101:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572471.197104:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197113:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197124:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197130:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f8f5cad/0x265cfe11109bf528 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197142:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572471.197146:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197152:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572471.197155:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197162:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197171:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197179:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bf536 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197191:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572471.197194:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197201:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572471.197205:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197212:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197221:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197229:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bf52f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197241:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572471.197244:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197249:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572471.197252:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197259:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197268:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197273:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bf53d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197285:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572471.197289:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197294:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572471.197297:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197305:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197313:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197321:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda0ca95/0x265cfe11109bf544 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197334:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572471.197338:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197345:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572471.197348:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197355:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197363:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197370:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966ced81/0x265cfe11109bf54b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.197381:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572471.197383:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572471.197385:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572471.197442:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584437376:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:3.0:1788572471.197457:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1fea4380/2, rc 0, transno 4294975692 00000100:00100000:3.0:1788572471.197470:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584437888:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1788572471.197617:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1fea6d80/2, rc 0, transno 4294975691 00000100:00100000:3.0:1788572471.197622:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584438400:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1788572471.197638:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a84a300/2, rc 0, transno 38654705681 00000100:00100000:3.0:1788572471.197649:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584438912:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1788572471.197659:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590cb0a680/2, rc 0, transno 38654705683 00000100:00100000:3.0:1788572471.197663:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584439424:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1788572471.197672:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a3f8f2a00/2, rc 0, transno 4294975690 00000100:00100000:3.0:1788572471.197676:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584437504:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1788572471.197686:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1fea4e00/2, rc 0, transno 4294975689 00000100:00100000:3.0:1788572471.197690:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584438016:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1788572471.197700:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1fea4700/2, rc 0, transno 38654705682 00000100:00100000:3.0:1788572471.197703:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584438528:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1788572471.197712:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31cdf480/2, rc 0, transno 38654705680 00000100:00100000:3.0:1788572471.197716:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584439040:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1788572471.198317:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3643:x1875444584438272:12345-0@lo:6:osp-syn-1-1.0 Request processed in 170us (10442us total) trans 4294975696 rc 0/0 00000100:00100000:2.0:1788572471.198334:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22712 00000100:00100000:3.0:1788572471.198390:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584439808:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1788572471.198445:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.198452:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.198458:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.198464:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572471.198476:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584439936:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1788572471.198546:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584439680:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1788572471.198914:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572471.199084:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584439808 00000100:00100000:0.0:1788572471.199093:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584439808 00000100:00100000:0.0:1788572471.199149:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22715 00000100:00100000:0.0:1788572471.199161:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3644:x1875444584439808:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1788572471.199188:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:616 count 1 00002000:00010000:0.0:1788572471.199221:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x268:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572471.199228:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.199244:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x268:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:0.0:1788572471.199250:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572471.199257:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.199270:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.199279:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.199293:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.199311:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572471.199468:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3644:x1875444584439808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 310us (992us total) trans 38654705688 rc 0/0 00000100:00100000:0.0:1788572471.199475:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22715 00000100:00100000:2.0:1788572471.199615:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572471.199653:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584439936 00000100:00100000:2.0:1788572471.199657:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584439936 00000100:00100000:3.0:1788572471.199885:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584439552:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1788572471.199919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572471.199954:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584439552 00000100:00100000:3.0:1788572471.199958:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584439552 00010000:00010000:0.0:1788572471.200591:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572471.200599:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.200610:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572471.200614:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.200626:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.200658:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.200666:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bf552 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572471.200690:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572471.200694:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572471.200696:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572471.201648:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22716 00000100:00100000:2.0:1788572471.201758:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+14:3641:x1875444584439936:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1788572471.201796:0:43928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:613 count 1 00002000:00010000:2.0:1788572471.201834:0:43928:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x265:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572471.201841:0:43928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.201856:0:43928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x265:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:2.0:1788572471.201860:0:43928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.201868:0:43928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.202264:0:43928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.202278:0:43928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.202286:0:43928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.202309:0:43928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572471.202619:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+15:3641:x1875444584439936:12345-0@lo:6:osp-syn-0-1.0 Request processed in 871us (3002us total) trans 38654705689 rc 0/0 00000100:00100000:2.0:1788572471.202628:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22716 00010000:00010000:2.0:1788572471.202768:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572471.202774:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.202783:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572471.202788:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.202798:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.202820:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.202829:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a22b5fdf/0x265cfe11109bf559 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.202852:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.202855:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.202857:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572471.202953:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a36a4fb80/2, rc 0, transno 38654705689 00000100:00100000:2.0:1788572471.202960:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584439936:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1788572471.202984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572471.203033:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1fea4000/2, rc 0, transno 4294975695 00000100:00100000:2.0:1788572471.203038:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584437760:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1788572471.203046:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1fea7480/2, rc 0, transno 4294975696 00000100:00100000:2.0:1788572471.203049:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584438272:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1788572471.203058:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e590a849f80/2, rc 0, transno 38654705686 00000100:00100000:2.0:1788572471.203061:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584438784:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1788572471.203069:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31cded80/2, rc 0, transno 38654705687 00000100:00100000:2.0:1788572471.203072:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584439296:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1788572471.203080:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a3f8f3480/2, rc 0, transno 4294975693 00000100:00100000:2.0:1788572471.203083:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584437632:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1788572471.203091:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1fea7b80/2, rc 0, transno 4294975694 00000100:00100000:2.0:1788572471.203094:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584438144:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1788572471.203102:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1fea4a80/2, rc 0, transno 38654705684 00000100:00100000:2.0:1788572471.203105:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584438656:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1788572471.203113:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31cdce00/2, rc 0, transno 38654705685 00000100:00100000:2.0:1788572471.203116:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584439168:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1788572471.203136:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584439680 00000100:00100000:2.0:1788572471.203142:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584439680 00000100:00100000:2.0:1788572471.203174:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22717 00000100:00100000:2.0:1788572471.203181:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+14:3643:x1875444584439680:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1788572471.203274:0:43929:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:612 count 1 00002000:00010000:2.0:1788572471.203299:0:43929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x264:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572471.203305:0:43929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203317:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x264:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:2.0:1788572471.203320:0:43929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572471.203327:0:43929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203338:0:43929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203347:0:43929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203355:0:43929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203369:0:43929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572471.203471:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584439680:12345-0@lo:6:osp-syn-1-1.0 Request processed in 289us (485us total) trans 4294975697 rc 0/0 00000100:00100000:2.0:1788572471.203503:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22717 00010000:00010000:2.0:1788572471.203584:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572471.203589:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203596:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572471.203599:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203608:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203619:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203625:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bf560 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.203651:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572471.203769:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22718 00000100:00100000:3.0:1788572471.203782:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3642:x1875444584439552:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1788572471.203795:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:610 count 1 00002000:00010000:3.0:1788572471.203812:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x262:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572471.203819:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.203827:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x262:0x0].0x0 since=9224s v=(0 0) 00010000:00010000:3.0:1788572471.203831:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572471.203836:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.203845:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.203853:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.203860:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572471.203874:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572471.203952:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+15:3642:x1875444584439552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 175us (4033us total) trans 4294975698 rc 0/0 00000100:00100000:3.0:1788572471.203958:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22718 00000004:00080000:3.0:1788572471.204031:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a36a4f480/2, rc 0, transno 38654705688 00000100:00100000:3.0:1788572471.204037:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584439808:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1788572471.204045:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.204048:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572471.204052:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572471.204058:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a36a4c380/2, rc 0, transno 4294975698 00010000:00010000:2.0:1788572471.204061:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfe00 already unused, calling callback (ffffffffc0c114f0) 00000100:00100000:3.0:1788572471.204062:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584439552:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1788572471.204065:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.204072:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.204082:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572471.204090:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2966a0f/0x265cfe11109bf567 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572471.204092:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a36a4df80/2, rc 0, transno 4294975697 00000100:00100000:3.0:1788572471.204096:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584439680:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1788572471.204106:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.204107:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.204109:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572471.204109:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572471.933262:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572472.189207:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572472.189232:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584440064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572472.189303:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572472.189775:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584440448:0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.189815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572472.189837:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584440960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.189860:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572472.189874:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584441472:0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.189893:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572472.189908:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572472.189912:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584440576:0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.189929:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572472.189942:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584441088:0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.189960:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572472.189973:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584441600:0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.189989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572472.190033:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584440448 00000100:00100000:2.0:1788572472.190040:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584440448 00000100:00100000:2.0:1788572472.190087:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584440576 00000100:00100000:2.0:1788572472.190090:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584440576 00000100:00100000:2.0:1788572472.190106:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584441088 00000100:00100000:2.0:1788572472.190108:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584441088 00000100:00100000:2.0:1788572472.190122:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584441600 00000100:00100000:2.0:1788572472.190124:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584441600 00000100:00100000:2.0:1788572472.190138:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1788572472.190146:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584440448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.190196:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584440448:12345-0@lo:400:kworker.0 Request processed in 51us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572472.190203:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1788572472.190220:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1788572472.190226:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584440576:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572472.190238:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f8f1c00 x1875444584440576/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1788572483 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572472.190265:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584440576:12345-0@lo:400:kworker.0 Request processed in 39us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572472.190270:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1788572472.190281:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1788572472.190287:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584441088:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572472.190297:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f8f0a80 x1875444584441088/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1788572483 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572472.190320:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584441088:12345-0@lo:400:kworker.0 Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572472.190325:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1788572472.190336:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1788572472.190342:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584441600:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572472.190352:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f8f1500 x1875444584441600/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1788572483 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572472.190376:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584441600:12345-0@lo:400:kworker.0 Request processed in 35us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572472.190381:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00080000:2.0:1788572472.190408:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572472.190412:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572472.190442:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584440576:0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.190453:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584441088:0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.190461:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584441600:0@lo:400:kworker.0 00000100:00100000:2.0:1788572472.190469:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584440448:0@lo:400:kworker.0 00000100:00100000:3.0:1788572472.190926:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584440192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572472.190966:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572472.191013:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584440704:0@lo:400:kworker.0 00000100:00100000:3.0:1788572472.191035:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572472.191052:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584441216:0@lo:400:kworker.0 00000100:00100000:3.0:1788572472.191072:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572472.191407:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584440960 00000100:00100000:1.0:1788572472.191413:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584440960 00000100:00100000:1.0:1788572472.191453:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584441472 00000100:00100000:1.0:1788572472.191456:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584441472 00000100:00100000:1.0:1788572472.191474:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7844 00000100:00100000:1.0:1788572472.191502:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584440960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.191548:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584440960:12345-0@lo:400:kworker.0 Request processed in 67us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572472.191555:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7844 00000100:00100000:1.0:1788572472.191568:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7845 00000100:00100000:1.0:1788572472.191574:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+15:3641:x1875444584441472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.191603:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+15:3641:x1875444584441472:12345-0@lo:400:kworker.0 Request processed in 29us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572472.191609:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7845 00000100:00100000:1.0:1788572472.191629:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584440704 00000100:00100000:1.0:1788572472.191632:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584440704 00000100:00100000:1.0:1788572472.191655:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1788572472.191661:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584440704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.191689:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584440704:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572472.191708:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00080000:1.0:1788572472.191730:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572472.191734:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788572472.191844:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351006 is committed 00000001:00080000:1.0:1788572472.191854:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351004 is committed 00000100:00100000:1.0:1788572472.191895:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584440960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.191908:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584441472:0@lo:400:kworker.0 00010000:00010000:1.0:1788572472.191948:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572472.191958:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572472.191966:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572472.191971:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572472.191977:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572472.191984:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572472.192012:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8e5a18beb800) 00010000:00010000:1.0:1788572472.192015:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572472.192021:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572472.192030:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf4d4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572472.192078:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584440320:0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.192108:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572472.192125:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584440832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.192147:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572472.192164:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584441344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.192185:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572472.192212:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584440832 00000100:00100000:1.0:1788572472.192215:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584440832 00000100:00100000:1.0:1788572472.192241:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584441344 00000100:00100000:1.0:1788572472.192245:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584441344 00000100:00100000:1.0:1788572472.192262:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7846 00000100:00100000:1.0:1788572472.192268:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584440832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.192303:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584440832:12345-0@lo:400:kworker.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572472.192309:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7846 00000100:00100000:1.0:1788572472.192322:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7847 00000100:00100000:1.0:1788572472.192328:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3644:x1875444584441344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.192354:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3644:x1875444584441344:12345-0@lo:400:kworker.0 Request processed in 26us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572472.192360:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7847 00000100:00080000:1.0:1788572472.192380:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572472.192397:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584440832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.192408:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584441344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.192440:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584440192 00000100:00100000:1.0:1788572472.192444:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584440192 00000100:00100000:1.0:1788572472.192469:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788572472.192475:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584440192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.192540:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584440192:12345-0@lo:400:kworker.0 Request processed in 65us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572472.192548:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788572472.192602:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584440320 00000100:00100000:1.0:1788572472.192607:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584440320 00000100:00100000:1.0:1788572472.192633:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1788572472.192639:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584440320:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572472.192652:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590542d880 x1875444584440320/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1788572483 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572472.192682:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584440320:12345-0@lo:400:kworker.0 Request processed in 44us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572472.192688:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00080000:1.0:1788572472.192701:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572472.192718:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584440320:0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.193194:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572472.193204:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584441728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572472.199519:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584440192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572472.199547:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584440704:0@lo:400:kworker.0 00000100:00100000:3.0:1788572472.199599:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572472.199634:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584440064 00000100:00100000:3.0:1788572472.199641:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584440064 00000100:00100000:3.0:1788572472.199680:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584441216 00000100:00100000:3.0:1788572472.199684:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584441216 00000100:00100000:3.0:1788572472.199708:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584441728 00000100:00100000:3.0:1788572472.199711:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584441728 00000100:00100000:3.0:1788572472.199724:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1788572472.199733:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584440064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572472.199772:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445978112 avail 1299738624 00000100:00100000:3.0:1788572472.199841:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584440064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (10536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572472.199848:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1788572472.199868:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1788572472.199874:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584441216:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572472.199895:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b1500 x1875444584441216/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1788572483 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572472.199926:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584441216:12345-0@lo:400:kworker.0 Request processed in 52us (8853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572472.199933:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1788572472.199944:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1788572472.199951:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584441728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572472.199970:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:3.0:1788572472.199980:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b0e00 x1875444584441728/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:133/0 lens 224/368 e 0 to 0 dl 1788572483 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572472.200040:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584440064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572472.200315:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584441728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 364us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572472.200321:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1788572472.200350:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584441216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572472.200427:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584441728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572472.694826:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572472.694875:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572472.694909:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572472.694940:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572472.694963:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572472.694992:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569565696 00000100:00100000:2.0:1788572472.694992:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569565952 00000100:00100000:1.0:1788572472.695002:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569565696 00000100:00100000:2.0:1788572472.695002:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569565952 00000100:00100000:3.0:1788572472.695062:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569565440 00000100:00100000:3.0:1788572472.695066:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569565440 00000100:00100000:1.0:1788572472.695069:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569565568 00000100:00100000:1.0:1788572472.695071:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569565568 00000100:00100000:0.0:1788572472.695111:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569565824 00000100:00100000:0.0:1788572472.695115:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569565824 00000100:00100000:3.0:1788572472.695241:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 142 00000100:00100000:3.0:1788572472.695252:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569565440:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572472.695323:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569565440:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 73us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572472.695330:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 142 00000100:00100000:2.0:1788572472.697545:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 483 00000100:00100000:2.0:1788572472.697573:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569565696:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572472.697690:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569565696:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 133us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572472.697697:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 483 00000100:00100000:1.0:1788572472.701341:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 484 00000100:00100000:1.0:1788572472.701362:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569565568:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572472.701395:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b90700 x1875444569565568/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:133/0 lens 224/224 e 0 to 0 dl 1788572483 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572472.701461:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569565568:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 108us (6520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572472.701469:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 484 00000100:00100000:0.0:1788572472.704316:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7848 00000100:00100000:0.0:1788572472.704333:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569565824:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572472.704413:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569565824:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 85us (9449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572472.704420:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7848 00000100:00100000:0.0:1788572472.704862:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572472.704880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584441856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572472.704935:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572472.704979:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584441984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572472.705017:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572472.705052:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584441856 00000100:00100000:0.0:1788572472.705060:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584441856 00000100:00100000:0.0:1788572472.705090:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584441984 00000100:00100000:0.0:1788572472.705093:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584441984 00000100:00100000:0.0:1788572472.705108:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6421 00000100:00100000:0.0:1788572472.705116:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584441856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572472.705140:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572472.705179:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584441856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572472.705187:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6421 00000100:00100000:0.0:1788572472.705201:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6422 00000100:00100000:0.0:1788572472.705207:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3641:x1875444584441984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572472.705222:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572472.705253:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3641:x1875444584441984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572472.705260:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6422 00000100:00100000:0.0:1788572472.705309:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584441984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572472.705341:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584441856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572472.705612:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7849 00000100:00100000:2.0:1788572472.705830:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569565952:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572472.705872:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569565952:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 49us (10961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572472.705878:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7849 00000100:00080000:3.0:1788572472.706395:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572472.706533:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572472.706537:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572472.706540:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788572472.957315:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572473.216200:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584442112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572473.216273:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572473.216340:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572473.216348:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584442240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572473.216388:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572473.216419:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584442112 00000100:00100000:1.0:1788572473.216426:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584442112 00000100:00100000:1.0:1788572473.216472:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584442240 00000100:00100000:1.0:1788572473.216475:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584442240 00000100:00100000:1.0:1788572473.216521:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6423 00000100:00100000:1.0:1788572473.216528:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584442112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572473.216550:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572473.216592:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584442112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572473.216599:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6423 00000100:00100000:1.0:1788572473.216616:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6424 00000100:00100000:1.0:1788572473.216623:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584442240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572473.216636:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572473.216669:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584442240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572473.216675:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6424 00000100:00100000:1.0:1788572473.216735:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584442112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572473.216765:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584442240:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788572473.582607:0:199768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80c: DNE: create remote dir, drop update rep from MDT1, fail MDT[0,1] ========================================================== 21:41:12 (1788572472) 00000100:00100000:0.0:1788572473.670885:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572473.670959:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569566080 00000100:00100000:1.0:1788572473.670970:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569566080 00000100:00100000:1.0:1788572473.671043:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1266 00000100:00100000:1.0:1788572473.671053:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:164859:x1875444569566080:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572473.671076:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572473.671111:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf56e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5e3 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.671182:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf575 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.671197:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.671210:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572473.671261:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572473.671265:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1788572473.671287:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.671311:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf56e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5e3 expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.671328:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5e3 expref: 7 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.671336:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572473.671338:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572473.671342:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254c00, rc 0) 00010000:00000080:1.0:1788572473.671350:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99ce00 x1875444569566080/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:134/0 lens 576/688 e 0 to 0 dl 1788572484 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572473.671422:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164859:x1875444569566080:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 371us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572473.680504:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1266 00000100:00100000:2.0:1788572473.680651:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572473.680812:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569566208 00000100:00100000:1.0:1788572473.680822:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569566208 00000100:00100000:1.0:1788572473.680872:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1267 00000100:00100000:1.0:1788572473.680882:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164859:x1875444569566208:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572473.680902:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572473.680924:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf57c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5ea expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681007:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681404:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681421:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681440:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681448:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681455:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681551:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681559:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681565:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681644:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681650:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572473.681655:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681663:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681675:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572473.681677:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572473.681682:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681688:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf583 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681702:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681708:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681713:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.681718:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572473.681992:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.682000:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.682020:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e590b478f00) 00010000:00010000:1.0:1788572473.682023:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572473.682027:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.682032:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf58a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.682076:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf57c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ea expref: 8 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.682170:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572473.682173:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572473.682178:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf57c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ea expref: 8 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.682188:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255600, rc 0) 00010000:00000080:1.0:1788572473.682196:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b91500 x1875444569566208/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:134/0 lens 592/584 e 0 to 0 dl 1788572484 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572473.682267:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164859:x1875444569566208:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1386us (1616us total) trans 0 rc 301/301 00000100:00100000:1.0:1788572473.682275:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1267 00000100:00100000:3.0:1788572473.691627:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572473.693241:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569566464 00000100:00100000:1.0:1788572473.693258:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569566464 00000100:00100000:1.0:1788572473.693334:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1268 00000100:00100000:1.0:1788572473.693345:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164859:x1875444569566464:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:1.0:1788572473.693419:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572473.693448:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf575 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5e3 expref: 7 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.693493:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572473.693499:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572473.693581:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.693596:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.693607:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.693622:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.693629:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.693635:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694159:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 3/0,1 mode: --/PW res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694169:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694176:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572473.694190:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4e3b75a reply state 00000000cd733b8c transno 347892351007 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694205:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694211:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:1.0:1788572473.694214:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572473.694217:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788572473.694222:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00010000:00010000:1.0:1788572473.694230:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694237:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694244:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694250:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694256:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572473.694260:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694267:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694274:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572473.694277:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572473.694281:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694290:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf591 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572473.694301:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4e3b75a reply state 00000000cd733b8c transno 347892351007 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694308:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572473.694313:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e590b478d00) 00010000:00010000:1.0:1788572473.694315:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572473.694317:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00000080:1.0:1788572473.694341:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b1f80 x1875444569566464/t347892351007(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:134/0 lens 568/448 e 0 to 0 dl 1788572484 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572473.694430:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164859:x1875444569566464:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 1086us (2815us total) trans 347892351007 rc 0/0 00000100:00100000:1.0:1788572473.694437:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1268 00010000:00010000:1.0:1788572473.982075:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572474.698533:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572474.698870:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569566592 00000100:00100000:1.0:1788572474.698882:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569566592 00000100:00100000:1.0:1788572474.698964:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1269 00000100:00100000:1.0:1788572474.698977:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164868:x1875444569566592:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572474.699005:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572474.699039:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf5a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5f1 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.699106:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf5ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.699123:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf5ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.699135:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf5ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572474.699182:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572474.699186:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1788572474.699333:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf5ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.699362:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf5a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5f1 expref: 10 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.699383:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf5ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5f1 expref: 9 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.699391:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572474.699394:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572474.699398:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255a00, rc 0) 00010000:00000080:1.0:1788572474.699406:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b1c00 x1875444569566592/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:135/0 lens 576/688 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572474.699547:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164868:x1875444569566592:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 573us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572474.699555:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1269 00000100:00080000:3.0:1788572474.701255:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572474.720281:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572474.720397:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569566720 00000100:00100000:1.0:1788572474.720407:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569566720 00000100:00100000:1.0:1788572474.720467:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1270 00000100:00100000:1.0:1788572474.720507:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164868:x1875444569566720:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572474.720532:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572474.720554:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf5b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5f8 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720630:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720646:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720658:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720670:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720676:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720683:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720786:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf5c9 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720794:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf5c9 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720802:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf5c9 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572474.720839:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1788572474.720843:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1788572474.720862:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf5c9 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720876:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720881:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720887:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720894:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720900:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572474.720904:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720913:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720926:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572474.720930:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572474.720934:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720941:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254e00/0x265cfe11109bf5bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720961:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720967:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720972:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720978:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572474.720980:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720987:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.720993:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e590b478d00) 00010000:00010000:1.0:1788572474.720995:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572474.720998:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.721005:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf5c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.721041:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf5b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5f8 expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.721056:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf5c9 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5f8 expref: 10 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.721069:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:1.0:1788572474.721071:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788572474.721074:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254c00, rc 0) 00010000:00000080:1.0:1788572474.721082:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b92300 x1875444569566720/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:135/0 lens 592/688 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572474.721144:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164868:x1875444569566720:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 668us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572474.721151:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1270 00000100:00100000:3.0:1788572474.727305:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572474.727424:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569566848 00000100:00100000:0.0:1788572474.727434:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569566848 00000100:00100000:0.0:1788572474.727548:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1271 00000100:00100000:0.0:1788572474.727559:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164868:x1875444569566848:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572474.727721:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572474.727747:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf5d0 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb5ff expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727827:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 3/1,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727846:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727858:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727875:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 3/1,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727886:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727893:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727940:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727947:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 2/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727953:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727960:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ea00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572474.727964:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727971:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727983:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:0.0:1788572474.727986:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572474.727992:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.727997:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ea00/0x265cfe11109bf5d7 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.728008:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.731255:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.731271:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.731276:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572474.731281:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.731290:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.731307:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0xf7117594 (ffff8e5a36aab100) 00010000:00010000:0.0:1788572474.731310:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572474.731315:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 2/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.731322:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e600/0x265cfe11109bf5de lrc: 0/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.731387:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf5d0 lrc: 1/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ff expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.731398:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:0.0:1788572474.731400:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572474.731404:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ee00/0x265cfe11109bf5d0 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5ff expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.731418:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164ee00, rc 0) 00010000:00000080:0.0:1788572474.731428:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b0380 x1875444569566848/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:135/0 lens 584/584 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788572474.731525:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164868:x1875444569566848:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3967us (4227us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572474.731535:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1271 00000100:00100000:3.0:1788572474.737245:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572474.737373:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569566976 00000100:00100000:2.0:1788572474.737382:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569566976 00000100:00100000:2.0:1788572474.737443:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1272 00000100:00100000:2.0:1788572474.737454:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164868:x1875444569566976:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572474.737474:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572474.737519:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bf5e5 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb606 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737688:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 3/1,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737704:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737720:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737735:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737742:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737748:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737892:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 4/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737898:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 4/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737905:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737910:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737915:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572474.737920:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737926:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 5/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737937:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:2.0:1788572474.737940:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572474.737946:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 3/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737952:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf5ec lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737967:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737973:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737980:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737985:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572474.737987:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.737993:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.738000:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0xf7117594 (ffff8e5a122fb900) 00010000:00010000:2.0:1788572474.738002:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572474.738005:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.738011:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf5f3 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.738189:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bf5e5 lrc: 1/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb606 expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.738199:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:2.0:1788572474.738269:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572474.738275:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bf5e5 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb606 expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.738286:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00031a00, rc 0) 00010000:00000080:2.0:1788572474.738295:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b2680 x1875444569566976/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:135/0 lens 584/584 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788572474.738360:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164868:x1875444569566976:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 907us (1126us total) trans 0 rc 301/301 00000100:00100000:2.0:1788572474.738368:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1272 00000100:00100000:3.0:1788572474.743841:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572474.743878:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569567104 00000100:00100000:3.0:1788572474.743887:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569567104 00000100:00100000:3.0:1788572474.743942:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1273 00000100:00100000:3.0:1788572474.743952:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164868:x1875444569567104:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572474.743972:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572474.743994:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf5fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb60d expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.744074:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.744089:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.744103:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572474.744147:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1788572474.744152:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1788572474.744171:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.744198:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf5fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb60d expref: 12 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.744596:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb60d expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.744605:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:3.0:1788572474.744608:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572474.744612:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf000, rc 0) 00010000:00000080:3.0:1788572474.744621:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b3480 x1875444569567104/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:135/0 lens 576/688 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788572474.744701:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164868:x1875444569567104:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 751us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572474.744708:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1273 00000100:00100000:3.0:1788572474.750676:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572474.750769:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569567360 00000100:00100000:0.0:1788572474.750779:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569567360 00000100:00100000:0.0:1788572474.750839:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1274 00000100:00100000:0.0:1788572474.750849:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164868:x1875444569567360:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572474.750870:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572474.750890:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f800/0x265cfe11109bf608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb614 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572474.750994:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1788572474.751112:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f800/0x265cfe11109bf608 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb614 expref: 13 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.751127:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:0.0:1788572474.751130:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572474.751135:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f800/0x265cfe11109bf608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb614 expref: 13 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.751150:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164f800, rc 0) 00010000:00000080:0.0:1788572474.751158:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b0700 x1875444569567360/t347892351008(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:135/0 lens 648/664 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788572474.751233:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:164868:x1875444569567360:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 385us (568us total) trans 347892351008 rc 301/301 00000100:00100000:0.0:1788572474.751240:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1274 00000100:00100000:0.0:1788572474.759323:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572474.759404:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569567616 00000100:00100000:3.0:1788572474.759415:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569567616 00000100:00100000:3.0:1788572474.759513:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1275 00000100:00100000:3.0:1788572474.759526:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:164868:x1875444569567616:12345-192.168.202.57@tcp:36:lfs.0 00000100:00100000:3.0:1788572474.759667:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584442368:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788572474.759716:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572474.759742:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5901bd26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572474.759908:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584442368 00000100:00100000:0.0:1788572474.759913:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584442368 00000100:00100000:0.0:1788572474.759949:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1788572474.759955:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584442368:12345-0@lo:1000:mdt00_003.0 00010000:00000080:0.0:1788572474.759990:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b2a00 x1875444584442368/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 304/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572474.760048:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584442368:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572474.760055:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00080000:0.0:1788572474.760079:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572474.760112:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584442368:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572474.760171:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584442496:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572474.760198:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572474.760222:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572474.760268:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584442496 00000100:00100000:3.0:1788572474.760273:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584442496 00000100:00100000:3.0:1788572474.760308:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1788572474.760316:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584442496:12345-0@lo:1000:mdt00_003.0 00010000:00000080:3.0:1788572474.760352:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99c380 x1875444584442496/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 328/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572474.760386:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584442496:12345-0@lo:1000:mdt00_003.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572474.760392:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1788572474.760451:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584442496:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572474.760514:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584442624:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572474.760537:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572474.760552:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572474.760659:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584442624 00000100:00100000:3.0:1788572474.760663:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584442624 00000100:00100000:3.0:1788572474.760785:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1788572474.760793:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584442624:12345-0@lo:1000:mdt00_003.0 00010000:00000080:3.0:1788572474.760839:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99d880 x1875444584442624/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 328/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc -2/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572474.760874:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584442624:12345-0@lo:1000:mdt00_003.0 Request processed in 83us (337us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572474.760881:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1788572474.761291:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584442624:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788572474.761339:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 3/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.761349:0:188833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 3/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.761359:0:188833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 3/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572474.761371:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584442752:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1788572474.761399:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572474.761425:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788572474.761657:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584442752 00000100:00100000:1.0:1788572474.761663:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584442752 00000100:00100000:1.0:1788572474.761688:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1788572474.761695:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584442752:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1788572474.761705:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572474.761720:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf61d lrc: 2/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf616 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.761741:0:188053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 2/0,1 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.761766:0:188053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb60d expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.761776:0:188053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf61d lrc: 5/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf616 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.761802:0:188053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb60d expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.761816:0:188053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb60d expref: 11 pid: 188050 timeout: 9327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572474.761828:0:188053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:188053:1875444584442880:192.168.202.57@tcp:104: 00010000:00010000:1.0:1788572474.761898:0:188053:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1788572474.761928:0:188053:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788572474.761961:0:188053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0f3d3780 going to sleep for 11 seconds 00000001:00080000:1.0:1788572474.762389:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351008 is committed 00010000:00010000:1.0:1788572474.762418:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762427:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762433:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762439:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572474.762443:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762451:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762468:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e590b478d00) 00010000:00010000:1.0:1788572474.762471:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572474.762499:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762506:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf598 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762525:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762532:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 2/0,0 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762538:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762542:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572474.762545:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762550:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 4/0,0 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762557:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:1.0:1788572474.762559:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572474.762564:0:3628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf61d lrc: 3/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf616 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762573:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 2/0,0 mode: --/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.762579:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254a00/0x265cfe11109bf59f lrc: 0/0,0 mode: --/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572474.772592:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572474.773859:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569567744 00000100:00100000:3.0:1788572474.773873:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569567744 00010000:00010000:3.0:1788572474.773921:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 5/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb60d expref: 9 pid: 188050 timeout: 9327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572474.773967:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12911 00000100:00100000:3.0:1788572474.773977:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a04f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:2398:x1875444569567744:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572474.773992:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572474.773998:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 5/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb60d expref: 9 pid: 188050 timeout: 9327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.774012:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb60d expref: 9 pid: 188050 timeout: 9327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.774048:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:3.0:1788572474.774055:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf61d lrc: 3/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf616 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.774067:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf61d lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109bf616 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.774076:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf61d lrc: 4/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x265cfe11109bf616 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572474.774113:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf61d lrc: 4/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf616 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572474.774126:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6502:1875444584443008:0@lo:105: 00000100:00100000:3.0:1788572474.774182:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572474.777090:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5901bd29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572474.777691:0:13337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584443008 00000100:00100000:1.0:1788572474.777702:0:13337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584443008 00000100:00100000:1.0:1788572474.777750:0:13337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5404 00000100:00100000:1.0:1788572474.777760:0:13337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6502:x1875444584443008:12345-0@lo:105: 00010000:00010000:1.0:1788572474.777777:0:13337:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 4/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.777789:0:13337:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 4/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.777798:0:13337:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 4/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.777806:0:13337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.777813:0:13337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 5/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.777822:0:13337:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 5/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572474.777841:0:13337:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a3164ee00) 00000100:00100000:1.0:1788572474.777919:0:13337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6502:x1875444584443008:12345-0@lo:105: Request processed in 160us (3736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572474.777926:0:13337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5404 00000100:00100000:1.0:1788572474.777968:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6502:1875444584443008:0@lo:105: 00010000:00010000:1.0:1788572474.777988:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572474.778063:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a04f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:2398:x1875444569567744:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4086us (5479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572474.778071:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12911 00010000:00010000:2.0:1788572474.780979:0:188053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf000/0x265cfe11109bf601 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb60d expref: 8 pid: 188050 timeout: 9327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572474.781004:0:188053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:188053:1875444584442880:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572474.781050:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf61d lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf616 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.781060:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:2.0:1788572474.781063:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572474.781067:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254800, rc 0) 00010000:00000080:2.0:1788572474.781075:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99ea00 x1875444584442752/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 328/344 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572474.781164:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:188833:x1875444584442752:12345-0@lo:101:mdt00_003.0 Request processed in 19469us (19763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572474.781174:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:0.0:1788572474.781291:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584442752:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788572474.781313:0:188833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572474.781335:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x7:0x0] 00010000:00010000:0.0:1788572474.781383:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.781391:0:188833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572474.781401:0:188833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572474.781421:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443136:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1788572474.781461:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572474.781520:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572474.786555:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584443136 00000100:00100000:2.0:1788572474.786582:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584443136 00000100:00100000:2.0:1788572474.786651:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1788572474.786662:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:188833:x1875444584443136:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1788572474.786685:0:188054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572474.786709:0:188054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bf62b lrc: 2/0,0 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf624 expref: -99 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.786743:0:188054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bf62b lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf624 expref: 8 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.786760:0:188054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bf62b lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf624 expref: 8 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.786770:0:188054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0xf7117594 (ffff8e5a122fb900) 00010000:00010000:2.0:1788572474.786773:0:188054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572474.786777:0:188054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00031a00, rc 0) 00010000:00000080:2.0:1788572474.786785:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99c700 x1875444584443136/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 328/344 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572474.786869:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443136:12345-0@lo:101:mdt00_003.0 Request processed in 209us (5407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572474.786875:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1788572474.786925:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443136:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1788572474.786945:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf62b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572474.786962:0:188833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf62b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572474.786984:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x7:0x0] 00000100:00100000:2.0:1788572474.787044:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443264:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.787081:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572474.787104:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572474.787119:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584443264 00000100:00100000:2.0:1788572474.787123:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584443264 00000100:00100000:2.0:1788572474.787148:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1788572474.787155:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443264:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1788572474.787190:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b92680 x1875444584443264/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 304/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572474.787224:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443264:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572474.787231:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1788572474.787258:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443264:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.787297:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443392:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.787320:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572474.787334:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572474.787344:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584443392 00000100:00100000:2.0:1788572474.787347:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584443392 00000100:00100000:2.0:1788572474.787365:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1788572474.787371:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443392:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1788572474.787409:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b91880 x1875444584443392/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 328/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc -2/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572474.787440:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443392:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (119us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572474.787447:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1788572474.787472:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443392:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.787560:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443520:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.787585:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572474.787601:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572474.787612:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584443520 00000100:00100000:2.0:1788572474.787615:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584443520 00000100:00100000:2.0:1788572474.787635:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1788572474.787640:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443520:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1788572474.787665:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b91c00 x1875444584443520/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 328/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc -2/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572474.787698:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443520:12345-0@lo:1000:mdt00_003.0 Request processed in 57us (113us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572474.787704:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1788572474.787744:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443520:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.787788:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443648:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.787812:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572474.787827:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572474.787837:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584443648 00000100:00100000:2.0:1788572474.787840:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584443648 00000100:00100000:2.0:1788572474.787859:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1788572474.787865:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443648:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1788572474.787892:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b92d80 x1875444584443648/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 344/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572474.787924:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443648:12345-0@lo:1000:mdt00_003.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572474.787931:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1788572474.787961:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443648:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.788005:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443776:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.788040:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572474.788053:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572474.788065:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584443776 00000100:00100000:2.0:1788572474.788068:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584443776 00000100:00100000:2.0:1788572474.788088:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1788572474.788094:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443776:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1788572474.788130:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b90000 x1875444584443776/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 328/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572474.788161:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443776:12345-0@lo:1000:mdt00_003.0 Request processed in 67us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572474.788167:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1788572474.788192:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443776:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.788229:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443904:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.788251:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572474.788263:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905129180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572474.788275:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584443904 00000100:00100000:2.0:1788572474.788278:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584443904 00000100:00100000:2.0:1788572474.788296:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:2.0:1788572474.788301:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443904:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1788572474.788328:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729fb80 x1875444584443904/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 328/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572474.788359:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584443904:12345-0@lo:1000:mdt00_003.0 Request processed in 57us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572474.788364:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:2.0:1788572474.788389:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584443904:0@lo:1000:mdt00_003.0 00000040:00080000:2.0:1788572474.788906:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].2, 1096 off34288 00000100:00100000:2.0:1788572474.788983:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584444032:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572474.789032:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572474.789052:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572474.789066:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584444032 00000100:00100000:2.0:1788572474.789070:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584444032 00000100:00100000:2.0:1788572474.789096:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:2.0:1788572474.789104:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584444032:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1788572474.789137:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729ed80 x1875444584444032/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 304/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572474.789173:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584444032:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572474.789180:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:2.0:1788572474.789210:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584444032:0@lo:1000:mdt00_003.0 00000040:00080000:2.0:1788572474.789237:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027cd1:0x1:0x0].2, 1240 off34512 00000004:00080000:2.0:1788572474.789244:0:188833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e59051293c0 with version 6 00000004:00080000:0.0:1788572474.789547:0:198967:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e59050fe900 version 6 rpc_version 6 00000020:00100000:0.0:1788572474.789581:0:198967:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788572474.789589:0:198967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a3f99df80 x1875444584444288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572474.789606:0:198967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584444288:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572474.789643:0:198967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572474.789660:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572474.798719:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584444288 00000100:00100000:1.0:1788572474.798739:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584444288 00000100:00100000:1.0:1788572474.798824:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1788572474.798834:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:198967:x1875444584444288:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:1.0:1788572474.799535:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99fb80 x1875444584444288/t347892351009(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 2520/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788572474.799546:0:188053:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00010000:00020000:1.0:1788572474.799551:0:188053:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8e5a3f99fb80 x1875444584444288/t347892351009(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:135/0 lens 2520/4320 e 0 to 0 dl 1788572485 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572474.834165:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:198967:x1875444584444288:12345-0@lo:1000:osp_up0-1.0 Request processed in 35321us (44509us total) trans 347892351009 rc 0/0 00000100:00100000:1.0:1788572474.834181:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00010000:00010000:3.0:1788572475.004716:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788572475.929353:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351009 is committed 00000001:00080000:0.0:1788572475.931071:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705689 is committed 00000001:00080000:3.0:1788572475.931071:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975698 is committed 00000001:00080000:3.0:1788572475.931683:0:198961:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803846 is committed 00010000:00010000:2.0:1788572476.033111:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572476.091139:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572476.094893:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569567872 00000100:00100000:1.0:1788572476.094915:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569567872 00000100:00080000:3.0:1788572476.095000:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572476.095069:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1276 00000100:00100000:1.0:1788572476.095086:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164877:x1875444569567872:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:1.0:1788572476.095162:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00010000:00000080:1.0:1788572476.095189:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b2300 x1875444569567872/t0(0) o41->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:137/0 lens 224/368 e 0 to 0 dl 1788572487 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572476.095286:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164877:x1875444569567872:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 204us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572476.095296:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1276 00000100:00100000:1.0:1788572476.102339:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572476.102474:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569568000 00000100:00100000:0.0:1788572476.102519:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569568000 00000100:00100000:0.0:1788572476.102741:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1277 00000100:00100000:0.0:1788572476.102756:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164877:x1875444569568000:12345-192.168.202.57@tcp:41:lfs.0 00000100:00080000:3.0:1788572476.102867:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1788572476.102884:0:196070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00000100:00100000:0.0:1788572476.102987:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164877:x1875444569568000:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 236us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572476.102996:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1277 00000100:00100000:0.0:1788572476.152836:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572476.152995:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569568128 00000100:00100000:3.0:1788572476.153009:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569568128 00000100:00100000:3.0:1788572476.153118:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6425 00000100:00100000:3.0:1788572476.153136:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164877:x1875444569568128:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572476.153186:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572476.153273:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164877:x1875444569568128:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 144us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572476.153281:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6425 00000100:00080000:0.0:1788572476.153709:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572476.163965:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572476.164074:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569568256 00000100:00100000:2.0:1788572476.164089:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569568256 00000100:00100000:2.0:1788572476.164170:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6426 00000100:00100000:2.0:1788572476.164183:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164877:x1875444569568256:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:2.0:1788572476.164233:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572476.164339:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164877:x1875444569568256:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 158us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572476.164347:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6426 00000100:00080000:0.0:1788572476.164600:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572476.298799:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572476.298859:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569568512 00000100:00100000:0.0:1788572476.298875:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569568512 00000100:00100000:0.0:1788572476.298967:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1278 00000100:00100000:0.0:1788572476.298984:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164884:x1875444569568512:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00010000:0.0:1788572476.299091:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572476.299129:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf5ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5f1 expref: 8 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299151:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:0.0:1788572476.299158:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572476.299276:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299297:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299310:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299331:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299338:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299345:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299915:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299927:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299933:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299940:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299946:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572476.299951:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299964:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299976:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:0.0:1788572476.299979:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572476.299984:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.299991:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f400/0x265cfe11109bf632 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572476.300005:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000229887cd reply state 00000000c31f35e5 transno 347892351010 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.300017:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.300034:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a36aabb00) 00010000:00010000:0.0:1788572476.300037:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572476.300040:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788572476.300079:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99e680 x1875444569568512/t347892351010(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:137/0 lens 528/448 e 0 to 0 dl 1788572487 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572476.300181:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164884:x1875444569568512:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 1201us (1402us total) trans 347892351010 rc 0/0 00000100:00100000:0.0:1788572476.300190:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1278 00000100:00100000:1.0:1788572476.340970:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572476.341035:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569568640 00000100:00100000:1.0:1788572476.341049:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569568640 00000100:00100000:1.0:1788572476.341126:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1279 00000100:00100000:1.0:1788572476.341141:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164887:x1875444569568640:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572476.341177:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572476.341211:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb61b expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572476.341306:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf647 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572476.341325:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572476.341340:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572476.341410:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572476.341416:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1788572476.341444:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572476.341503:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255000/0x265cfe11109bf640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb61b expref: 11 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572476.341527:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf647 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb61b expref: 10 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572476.341539:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572476.341542:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572476.341547:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255a00, rc 0) 00010000:00000080:1.0:1788572476.341558:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a2462f800 x1875444569568640/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:137/0 lens 576/688 e 0 to 0 dl 1788572487 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572476.344030:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164887:x1875444569568640:12345-192.168.202.57@tcp:101:rm.0 Request processed in 2867us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572476.344048:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1279 00000100:00100000:0.0:1788572476.370696:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572476.370958:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569568768 00000100:00100000:2.0:1788572476.370973:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569568768 00000100:00100000:2.0:1788572476.371061:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1280 00000100:00100000:2.0:1788572476.371076:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164887:x1875444569568768:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:2.0:1788572476.371276:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572476.371311:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030c00/0x265cfe11109bf64e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb622 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.371409:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.371430:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.371446:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.371461:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.371469:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.371850:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.371978:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109bf663 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.371986:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109bf663 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.371994:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109bf663 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572476.372064:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x8:0x0]: returning size 0 00000004:00200000:2.0:1788572476.372068:0:196070:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:2.0:1788572476.372089:0:196070:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109bf663 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372321:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109bf663 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372336:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372343:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372351:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372360:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372372:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572476.372378:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372387:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372403:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:2.0:1788572476.372406:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572476.372411:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372418:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030200/0x265cfe11109bf655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372438:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372444:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372451:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372456:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572476.372459:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372464:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372476:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a36aabb00) 00010000:00010000:2.0:1788572476.372544:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572476.372548:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372554:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031000/0x265cfe11109bf65c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372722:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030c00/0x265cfe11109bf64e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb622 expref: 12 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372753:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109bf663 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb622 expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.372761:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x8:0x0].0x0 (ffff8e5a039c6e00) 00010000:00010000:2.0:1788572476.372764:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572476.372767:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00030600, rc 0) 00010000:00000080:2.0:1788572476.372896:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99dc00 x1875444569568768/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:137/0 lens 600/584 e 0 to 0 dl 1788572487 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788572476.373060:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164887:x1875444569568768:12345-192.168.202.57@tcp:101:rm.0 Request processed in 1987us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572476.373070:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1280 00000100:00100000:0.0:1788572476.379781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572476.381301:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569569024 00000100:00100000:2.0:1788572476.381329:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569569024 00000100:00100000:2.0:1788572476.381437:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1281 00000100:00100000:2.0:1788572476.381449:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164887:x1875444569569024:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572476.381544:0:198183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788572476.381580:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030600/0x265cfe11109bf663 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb622 expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.381613:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x8:0x0].0x0 (ffff8e5a039c6e00) 00010000:00010000:2.0:1788572476.381631:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf647 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb61b expref: 10 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.381642:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:2.0:1788572476.381645:0:198183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572476.381673:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.381690:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.381703:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.381714:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.381722:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.381731:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382144:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 3/0,1 mode: --/EX res: [0x200027501:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382155:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382165:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382454:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 3/0,1 mode: --/PW res: [0x200027501:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382465:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382473:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382526:0:198183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382534:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382541:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382561:0:198183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572476.382591:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382597:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382604:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382610:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572476.382617:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382626:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382636:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x8:0x0].0x0 (ffff8e5a039c6500) 00010000:00010000:2.0:1788572476.382638:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572476.382642:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 2/0,0 mode: --/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382649:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031200/0x265cfe11109bf678 lrc: 0/0,0 mode: --/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.382669:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572476.382671:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.382681:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382682:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382698:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.382700:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572476.382709:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572476.382710:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382714:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.382731:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382732:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.382747:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x8:0x0].0x0 (ffff8e5a039c6500) 00010000:00010000:2.0:1788572476.382752:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:0.0:1788572476.382753:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572476.382758:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572476.382760:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 1/0,0 mode: --/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.382762:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.382777:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf67f lrc: 0/0,0 mode: --/PW res: [0x200027501:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572476.382796:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572476.382799:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572476.382801:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572476.383888:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031800/0x265cfe11109bf66a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572476.383910:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044a6372d reply state 00000000c7276c97 transno 347892351011 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.383927:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572476.383937:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a36aabb00) 00010000:00010000:2.0:1788572476.383940:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572476.383944:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1788572476.383982:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27420000 x1875444569569024/t347892351011(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:137/0 lens 512/456 e 0 to 0 dl 1788572487 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572476.384199:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164887:x1875444569569024:12345-192.168.202.57@tcp:36:rm.0 Request processed in 2751us (4434us total) trans 347892351011 rc 0/0 00000100:00100000:2.0:1788572476.384209:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1281 00010000:00010000:0.0:1788572477.052956:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572477.308941:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572477.308972:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584444416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572477.309076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572477.309973:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584444416 00000100:00100000:0.0:1788572477.309987:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584444416 00000100:00100000:0.0:1788572477.310073:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1788572477.310087:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584444416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572477.310149:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00000100:00100000:0.0:1788572477.310240:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584444416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572477.310249:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1788572477.310309:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584444416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572477.311918:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584444544:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.312003:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.312065:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584445056:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.312097:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.312118:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584445568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.312145:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.312168:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572477.312174:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584444672:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.312196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.312215:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584445184:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.312237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.312257:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584445696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.312279:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.312317:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584444544 00000100:00100000:1.0:1788572477.312338:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584444544 00000100:00100000:1.0:1788572477.312394:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788572477.312404:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584444544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.312462:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584444544:12345-0@lo:400:kworker.0 Request processed in 58us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.312470:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788572477.312550:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584445056 00000100:00100000:1.0:1788572477.312555:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584445056 00000100:00100000:1.0:1788572477.312598:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584444672 00000100:00100000:1.0:1788572477.312601:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584444672 00000100:00100000:1.0:1788572477.312622:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1788572477.312628:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584445056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.312661:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584445056:12345-0@lo:400:kworker.0 Request processed in 34us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.312667:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1788572477.312679:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1788572477.312685:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584444672:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572477.312698:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4101b800 x1875444584444672/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:138/0 lens 224/224 e 0 to 0 dl 1788572488 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572477.312725:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584444672:12345-0@lo:400:kworker.0 Request processed in 40us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.312731:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1788572477.312750:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584445568 00000100:00100000:1.0:1788572477.312754:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584445568 00000100:00100000:1.0:1788572477.312782:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1788572477.312789:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584445568:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572477.312805:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41019880 x1875444584445568/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:138/0 lens 224/224 e 0 to 0 dl 1788572488 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572477.312831:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584445568:12345-0@lo:400:kworker.0 Request processed in 43us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.312837:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1788572477.312860:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584445184 00000100:00100000:1.0:1788572477.312863:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584445184 00000100:00100000:1.0:1788572477.312893:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584445696 00000100:00100000:1.0:1788572477.312896:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584445696 00000100:00100000:1.0:1788572477.312920:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7850 00000100:00100000:1.0:1788572477.312926:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584445184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.312958:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584445184:12345-0@lo:400:kworker.0 Request processed in 31us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.312964:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7850 00000100:00100000:1.0:1788572477.312975:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7851 00000100:00100000:1.0:1788572477.312981:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584445696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313005:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584445696:12345-0@lo:400:kworker.0 Request processed in 25us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.313011:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7851 00000100:00080000:1.0:1788572477.313051:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572477.313057:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572477.313059:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572477.313087:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584444928:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313117:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.313138:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584445440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313162:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.313178:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584445952:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313200:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.313219:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572477.313226:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584444800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313253:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.313270:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584445312:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313292:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.313309:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584445824:0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313329:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.313356:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584445312 00000100:00100000:1.0:1788572477.313360:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584445312 00000100:00100000:1.0:1788572477.313392:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584445824 00000100:00100000:1.0:1788572477.313395:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584445824 00000100:00100000:1.0:1788572477.313427:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7852 00000100:00100000:1.0:1788572477.313434:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584445312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313476:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584445312:12345-0@lo:400:kworker.0 Request processed in 43us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.313510:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7852 00000100:00100000:1.0:1788572477.313524:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7853 00000100:00100000:1.0:1788572477.313530:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584445824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313558:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584445824:12345-0@lo:400:kworker.0 Request processed in 29us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.313564:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7853 00000100:00100000:1.0:1788572477.313580:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584444928 00000100:00100000:1.0:1788572477.313584:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584444928 00000100:00100000:1.0:1788572477.313611:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584445440 00000100:00100000:1.0:1788572477.313614:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584445440 00000100:00100000:1.0:1788572477.313624:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584445952 00000100:00100000:1.0:1788572477.313626:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584445952 00000100:00100000:1.0:1788572477.313637:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584444800 00000100:00100000:1.0:1788572477.313639:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584444800 00000100:00100000:1.0:1788572477.313654:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1788572477.313659:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584444928:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572477.313673:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41019f80 x1875444584444928/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:138/0 lens 224/224 e 0 to 0 dl 1788572488 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572477.313701:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584444928:12345-0@lo:400:kworker.0 Request processed in 41us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.313707:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1788572477.313719:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1788572477.313725:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584445440:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572477.313737:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41019180 x1875444584445440/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:138/0 lens 224/224 e 0 to 0 dl 1788572488 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572477.313763:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584445440:12345-0@lo:400:kworker.0 Request processed in 38us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.313769:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1788572477.313780:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1788572477.313785:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584445952:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572477.313797:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4101a300 x1875444584445952/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:138/0 lens 224/224 e 0 to 0 dl 1788572488 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572477.313821:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584445952:12345-0@lo:400:kworker.0 Request processed in 35us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.313826:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1788572477.313837:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1788572477.313842:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584444800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572477.313867:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584444800:12345-0@lo:400:kworker.0 Request processed in 26us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.313873:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00080000:1.0:1788572477.313891:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572477.313894:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572477.313896:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572477.314349:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584444672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314365:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584445184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314375:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705689 gen 2 00000004:00080000:0.0:1788572477.314381:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a31cdf480, transno 38654705680 00000004:00080000:0.0:1788572477.314393:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a84a300, transno 38654705681 00000004:00080000:0.0:1788572477.314397:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a1fea4700, transno 38654705682 00000004:00080000:0.0:1788572477.314400:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590cb0a680, transno 38654705683 00000004:00080000:0.0:1788572477.314403:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a1fea4a80, transno 38654705684 00000004:00080000:0.0:1788572477.314406:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a31cdce00, transno 38654705685 00000004:00080000:0.0:1788572477.314409:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e590a849f80, transno 38654705686 00000004:00080000:0.0:1788572477.314411:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a31cded80, transno 38654705687 00000004:00080000:0.0:1788572477.314414:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a36a4f480, transno 38654705688 00000004:00080000:0.0:1788572477.314418:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a36a4fb80, transno 38654705689 00000100:00100000:0.0:1788572477.314422:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584445696:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314437:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584444544:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314450:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584445056:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314464:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584445568:0@lo:400:kworker.0 00000004:00080000:0.0:1788572477.314711:0:198969:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 10 done 00000100:00100000:0.0:1788572477.314773:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584444800:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314787:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584445312:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314800:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975698 gen 2 00000004:00080000:0.0:1788572477.314804:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a1fea4e00, transno 4294975689 00000004:00080000:0.0:1788572477.314815:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a3f8f2a00, transno 4294975690 00000004:00080000:0.0:1788572477.314820:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a1fea6d80, transno 4294975691 00000004:00080000:0.0:1788572477.314823:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a1fea4380, transno 4294975692 00000004:00080000:0.0:1788572477.314826:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a3f8f3480, transno 4294975693 00000004:00080000:0.0:1788572477.314839:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a1fea7b80, transno 4294975694 00000004:00080000:0.0:1788572477.314842:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a1fea4000, transno 4294975695 00000004:00080000:0.0:1788572477.314846:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a1fea7480, transno 4294975696 00000004:00080000:0.0:1788572477.314848:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a36a4df80, transno 4294975697 00000004:00080000:0.0:1788572477.314851:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5a36a4c380, transno 4294975698 00000100:00100000:0.0:1788572477.314855:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584445824:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314869:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584444928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314881:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584445440:0@lo:400:kworker.0 00000100:00100000:0.0:1788572477.314893:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584445952:0@lo:400:kworker.0 00000004:00080000:0.0:1788572477.315004:0:198971:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 10 done 00000100:00100000:2.0:1788572477.315191:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572477.315207:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584446080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572477.315271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572477.315318:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584446080 00000100:00100000:2.0:1788572477.315325:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584446080 00000100:00100000:2.0:1788572477.315374:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:2.0:1788572477.315384:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3642:x1875444584446080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572477.315421:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00010000:00000080:2.0:1788572477.315439:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b91f80 x1875444584446080/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:138/0 lens 224/368 e 0 to 0 dl 1788572488 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572477.315498:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3642:x1875444584446080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572477.315507:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:2.0:1788572477.315553:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584446080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572477.804173:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572477.804234:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572477.804243:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569569280 00000100:00100000:2.0:1788572477.804253:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569569280 00000100:00100000:1.0:1788572477.804275:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572477.804305:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572477.804335:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572477.804357:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569569152 00000100:00100000:1.0:1788572477.804362:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569569152 00000100:00100000:2.0:1788572477.804364:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569569408 00000100:00100000:2.0:1788572477.804369:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569569408 00000100:00100000:2.0:1788572477.804404:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 491 00000100:00100000:1.0:1788572477.804406:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 144 00000100:00100000:2.0:1788572477.804414:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2400:x1875444569569280:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572477.804419:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569569152:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:2.0:1788572477.804451:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4101b100 x1875444569569280/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:138/0 lens 224/224 e 0 to 0 dl 1788572488 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572477.804507:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569569152:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 92us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.804516:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 144 00000100:00100000:1.0:1788572477.804554:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 492 00000100:00100000:1.0:1788572477.804562:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569569408:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572477.804595:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2400:x1875444569569280:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 180us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.804597:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569569408:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572477.804610:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 491 00000100:00100000:2.0:1788572477.804647:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569569536 00000100:00100000:2.0:1788572477.804651:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569569536 00000100:00100000:0.0:1788572477.804661:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569569664 00000100:00100000:0.0:1788572477.804667:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569569664 00000100:00100000:2.0:1788572477.804683:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7854 00000100:00100000:2.0:1788572477.804692:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569569536:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572477.804705:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7855 00000100:00100000:0.0:1788572477.804714:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569569664:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572477.804748:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569569664:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 35us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572477.804754:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7855 00000100:00100000:2.0:1788572477.804873:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569569536:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572477.804881:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7854 00000100:00100000:1.0:1788572477.811573:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 492 00000100:00100000:0.0:1788572477.823932:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572477.823954:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584446208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572477.824023:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572477.824085:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584446208 00000100:00100000:0.0:1788572477.824092:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584446208 00000100:00100000:0.0:1788572477.824140:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6427 00000100:00100000:0.0:1788572477.824148:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584446208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572477.824171:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572477.824217:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584446208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572477.824234:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6427 00000100:00100000:0.0:1788572477.824288:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584446208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572477.829564:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584446336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572477.829637:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572477.829730:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584446336 00000100:00100000:1.0:1788572477.829739:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584446336 00000100:00100000:1.0:1788572477.829791:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6428 00000100:00100000:1.0:1788572477.829802:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584446336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572477.829825:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572477.829871:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584446336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572477.829878:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6428 00000100:00100000:0.0:1788572477.830023:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584446336:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572478.077265:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572478.333001:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584446464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572478.333098:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572478.333349:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584446464 00000100:00100000:1.0:1788572478.333360:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584446464 00000100:00100000:1.0:1788572478.333429:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6429 00000100:00100000:1.0:1788572478.333439:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584446464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572478.333475:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572478.333569:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584446464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572478.333577:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6429 00000100:00100000:0.0:1788572478.333740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584446464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572478.334985:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572478.335005:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584446592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572478.335073:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572478.336827:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584446592 00000100:00100000:2.0:1788572478.336846:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584446592 00000100:00100000:2.0:1788572478.336918:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6430 00000100:00100000:2.0:1788572478.336932:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584446592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572478.336971:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572478.337072:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584446592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572478.337079:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6430 00000100:00100000:2.0:1788572478.337151:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584446592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572479.104021:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572480.129793:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572481.151359:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572482.175302:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572482.428689:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572482.428712:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584446720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572482.428782:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572482.428845:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584446720 00000100:00100000:0.0:1788572482.428852:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584446720 00000100:00100000:0.0:1788572482.428897:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1788572482.428907:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584446720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572482.428944:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00000100:00100000:0.0:1788572482.428988:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584446720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572482.428995:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1788572482.429043:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584446720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572482.430559:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584446976:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.430610:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.430648:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584447488:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.430674:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.430692:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584448000:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.430712:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.430731:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572482.430737:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584446848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.430762:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.430786:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584447360:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.430806:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.430822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584447872:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.430842:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.430869:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584446976 00000100:00100000:2.0:1788572482.430874:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584446976 00000100:00100000:2.0:1788572482.430914:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584447360 00000100:00100000:2.0:1788572482.430917:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584447360 00000100:00100000:2.0:1788572482.430939:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1788572482.430947:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584446976:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572482.430967:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905f6f800 x1875444584446976/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:143/0 lens 224/224 e 0 to 0 dl 1788572493 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572482.431004:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584446976:12345-0@lo:400:kworker.0 Request processed in 58us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.431011:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1788572482.431027:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1788572482.431034:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584447360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.431073:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584447360:12345-0@lo:400:kworker.0 Request processed in 40us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.431079:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1788572482.431098:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584446848 00000100:00100000:2.0:1788572482.431101:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584446848 00000100:00100000:2.0:1788572482.431126:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788572482.431132:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584446848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.431161:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584446848:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.431168:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788572482.431196:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584447872 00000100:00100000:2.0:1788572482.431199:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584447872 00000100:00100000:2.0:1788572482.431221:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1788572482.431227:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584447872:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572482.431239:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905f6f100 x1875444584447872/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:143/0 lens 224/224 e 0 to 0 dl 1788572493 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572482.431509:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584447872:12345-0@lo:400:kworker.0 Request processed in 281us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.431520:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00080000:2.0:1788572482.431537:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572482.431542:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572482.431563:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584447232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.431589:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.431609:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584447744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.431854:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.431920:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584448256:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.431942:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572482.432107:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584447488 00000100:00100000:3.0:1788572482.432113:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584447488 00000100:00100000:3.0:1788572482.432155:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584448000 00000100:00100000:3.0:1788572482.432158:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584448000 00000100:00100000:3.0:1788572482.432188:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7856 00000100:00100000:3.0:1788572482.432196:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584447488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572482.432237:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584447488:12345-0@lo:400:kworker.0 Request processed in 42us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572482.432243:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7856 00000100:00100000:3.0:1788572482.432269:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7857 00000100:00100000:3.0:1788572482.432276:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584448000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572482.432302:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584448000:12345-0@lo:400:kworker.0 Request processed in 27us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572482.432308:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7857 00000100:00080000:3.0:1788572482.432329:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572482.432561:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584447104:0@lo:400:kworker.0 00000100:00100000:3.0:1788572482.432607:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584446848:0@lo:400:kworker.0 00000100:00100000:3.0:1788572482.432634:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584447360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572482.432645:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584447872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572482.432656:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584446976:0@lo:400:kworker.0 00000100:00100000:3.0:1788572482.432665:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584447488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572482.432673:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584448000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572482.432697:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572482.432703:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584448384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572482.432727:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572482.436906:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584447232 00000100:00100000:0.0:1788572482.436922:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584447232 00000100:00100000:0.0:1788572482.436989:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584447744 00000100:00100000:0.0:1788572482.436993:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584447744 00000100:00100000:0.0:1788572482.437012:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584448256 00000100:00100000:0.0:1788572482.437015:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584448256 00000100:00100000:0.0:1788572482.437035:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1788572482.437045:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584447232:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572482.437085:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905f6fb80 x1875444584447232/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:143/0 lens 224/224 e 0 to 0 dl 1788572493 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572482.437153:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584447232:12345-0@lo:400:kworker.0 Request processed in 109us (5562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572482.437160:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1788572482.437181:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1788572482.437188:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584447744:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572482.437203:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905f6c380 x1875444584447744/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:143/0 lens 224/224 e 0 to 0 dl 1788572493 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572482.437234:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584447744:12345-0@lo:400:kworker.0 Request processed in 47us (5380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572482.437240:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1788572482.437267:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1788572482.437274:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584448256:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572482.437286:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905f6c000 x1875444584448256/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:143/0 lens 224/224 e 0 to 0 dl 1788572493 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572482.437314:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584448256:12345-0@lo:400:kworker.0 Request processed in 41us (5371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572482.437320:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00080000:0.0:1788572482.437345:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572482.440521:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584448384 00000100:00100000:0.0:1788572482.440537:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584448384 00000100:00100000:0.0:1788572482.440603:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1788572482.440625:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584448384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572482.440664:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00010000:00000080:0.0:1788572482.440856:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b3800 x1875444584448384/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:143/0 lens 224/368 e 0 to 0 dl 1788572493 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572482.441384:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584448384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 770us (8654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572482.441393:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1788572482.441494:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584448384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572482.443129:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.443228:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584447616:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.443302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.443324:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584448128:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.443347:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.443382:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584447616 00000100:00100000:2.0:1788572482.443389:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584447616 00000100:00100000:2.0:1788572482.443445:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584448128 00000100:00100000:2.0:1788572482.443448:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584448128 00000100:00100000:2.0:1788572482.443472:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7858 00000100:00100000:2.0:1788572482.443497:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584447616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.443551:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584447616:12345-0@lo:400:kworker.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.443558:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7858 00000100:00100000:2.0:1788572482.443574:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7859 00000100:00100000:2.0:1788572482.443581:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584448128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.443616:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584448128:12345-0@lo:400:kworker.0 Request processed in 36us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.443622:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7859 00000100:00100000:2.0:1788572482.444005:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584447616:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.444021:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584448128:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.444069:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584448256:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.444093:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584447232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572482.444106:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584447744:0@lo:400:kworker.0 00000100:00080000:0.0:1788572482.446065:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572482.447775:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584447104 00000100:00100000:1.0:1788572482.447790:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584447104 00000100:00100000:1.0:1788572482.447913:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1788572482.447923:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584447104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572482.448015:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584447104:12345-0@lo:400:kworker.0 Request processed in 93us (4893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572482.448023:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00080000:2.0:1788572482.448797:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572482.448994:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584447104:0@lo:400:kworker.0 00000100:00100000:1.0:1788572482.930206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572482.930259:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572482.930300:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572482.930396:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569570176 00000100:00100000:2.0:1788572482.930409:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569570176 00000100:00100000:3.0:1788572482.930435:0:196587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569569792 00000100:00100000:3.0:1788572482.930439:0:196587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569569792 00000100:00100000:3.0:1788572482.930502:0:196587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 146 00000100:00100000:2.0:1788572482.930504:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7860 00000100:00100000:2.0:1788572482.930512:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569570176:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572482.930512:0:196587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569569792:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572482.930604:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569569920 00000100:00100000:0.0:1788572482.930608:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569569920 00000100:00100000:0.0:1788572482.930642:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 499 00000100:00100000:0.0:1788572482.930650:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2399:x1875444569569920:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:0.0:1788572482.930667:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41018a80 x1875444569569920/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:143/0 lens 224/224 e 0 to 0 dl 1788572493 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572482.930731:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572482.930735:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572482.930864:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569570176:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 353us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.930872:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7860 00000100:00100000:3.0:1788572482.935013:0:196587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569569792:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 4490us (4740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572482.935029:0:196587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 146 00000100:00100000:2.0:1788572482.935537:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2399:x1875444569569920:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 4884us (5338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.935548:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 499 00000100:00100000:0.0:1788572482.939298:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572482.939345:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572482.939440:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569570048 00000100:00100000:2.0:1788572482.939450:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569570048 00000100:00100000:3.0:1788572482.939549:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569570304 00000100:00100000:2.0:1788572482.939551:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 500 00000100:00100000:3.0:1788572482.939554:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569570304 00000100:00100000:2.0:1788572482.939562:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569570048:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572482.939590:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7861 00000100:00100000:3.0:1788572482.939596:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569570304:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572482.939705:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569570048:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 145us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.939712:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 500 00000100:00080000:1.0:1788572482.940083:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572482.940088:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572482.940720:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584448512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572482.940817:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5906a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584448640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572482.940960:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569570304:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 1361us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572482.940969:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7861 00000100:00100000:2.0:1788572482.942327:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572482.942458:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.942557:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584448512 00000100:00100000:2.0:1788572482.942566:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584448512 00000100:00100000:2.0:1788572482.942611:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584448640 00000100:00100000:2.0:1788572482.942615:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584448640 00000100:00100000:2.0:1788572482.942632:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6431 00000100:00100000:2.0:1788572482.942640:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584448512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572482.942670:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572482.942734:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584448512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.942741:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6431 00000100:00100000:2.0:1788572482.942757:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6432 00000100:00100000:2.0:1788572482.942763:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584448640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572482.942779:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572482.942803:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584448512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572482.942809:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584448640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.942814:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6432 00000100:00100000:2.0:1788572482.942841:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5906a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584448640:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788572483.144125:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351011 is committed 00010000:00010000:0.0:1788572483.144274:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144288:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144295:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144301:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ec00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572483.144306:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144315:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144336:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a36aabb00) 00010000:00010000:0.0:1788572483.144339:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572483.144345:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144352:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164ec00/0x265cfe11109bf639 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144374:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144380:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144386:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144390:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572483.144394:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144400:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144407:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a36aabb00) 00010000:00010000:0.0:1788572483.144410:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572483.144413:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572483.144418:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf671 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572483.201960:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572483.452668:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572483.452690:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584448768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572483.452763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572483.452811:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584448768 00000100:00100000:2.0:1788572483.452818:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584448768 00000100:00100000:2.0:1788572483.452863:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6433 00000100:00100000:2.0:1788572483.452873:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584448768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572483.452896:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572483.452941:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584448768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572483.452948:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6433 00000100:00100000:2.0:1788572483.453012:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584448768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572483.453896:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584448896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572483.453933:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572483.453976:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584448896 00000100:00100000:2.0:1788572483.453981:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584448896 00000100:00100000:2.0:1788572483.454011:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6434 00000100:00100000:2.0:1788572483.454018:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584448896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572483.454033:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572483.454082:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584448896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572483.454087:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6434 00000100:00100000:2.0:1788572483.454132:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584448896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572484.227379:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572484.264183:0:200211:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:2.0:1788572485.244619:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572485.433350:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572485.433754:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569570432 00000100:00100000:2.0:1788572485.433765:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569570432 00000100:00080000:1.0:1788572485.433825:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572485.433839:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1282 00000100:00100000:2.0:1788572485.433851:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164968:x1875444569570432:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572485.433870:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572485.433892:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb629 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.433957:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf68d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.433972:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf68d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.433984:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf68d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572485.434027:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572485.434031:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:2.0:1788572485.434052:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf68d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.434088:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb629 expref: 9 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.434107:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf68d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb629 expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.434116:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:2.0:1788572485.434119:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572485.434123:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14b600, rc 0) 00010000:00000080:2.0:1788572485.434131:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5906a00e00 x1875444569570432/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:185/0 lens 576/688 e 0 to 0 dl 1788572535 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788572485.434212:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164968:x1875444569570432:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 363us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572485.434221:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1282 00000100:00100000:0.0:1788572485.454807:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572485.454871:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569570560 00000100:00100000:1.0:1788572485.454884:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569570560 00000100:00100000:1.0:1788572485.454947:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1283 00000100:00100000:1.0:1788572485.454959:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164968:x1875444569570560:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:1.0:1788572485.455003:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00010000:00000080:1.0:1788572485.455026:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27423800 x1875444569570560/t0(0) o41->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:185/0 lens 224/368 e 0 to 0 dl 1788572535 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572485.455103:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164968:x1875444569570560:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 146us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572485.455111:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1283 00000100:00100000:1.0:1788572485.463220:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572485.463759:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569570688 00000100:00100000:3.0:1788572485.463771:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569570688 00000100:00100000:3.0:1788572485.463853:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1284 00000100:00100000:3.0:1788572485.463866:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164968:x1875444569570688:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572485.463906:0:188049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00000100:00080000:1.0:1788572485.463978:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572485.463987:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164968:x1875444569570688:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 124us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572485.463996:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1284 00000100:00100000:1.0:1788572485.475186:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572485.475396:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569570816 00000100:00100000:3.0:1788572485.475407:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569570816 00000100:00080000:1.0:1788572485.475471:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572485.475514:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6435 00000100:00100000:3.0:1788572485.475527:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164968:x1875444569570816:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572485.475560:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572485.475641:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164968:x1875444569570816:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 109us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572485.475649:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6435 00000100:00100000:2.0:1788572485.480541:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572485.480716:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569570944 00000100:00100000:3.0:1788572485.480727:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569570944 00000100:00100000:3.0:1788572485.480809:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6436 00000100:00100000:3.0:1788572485.480821:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164968:x1875444569570944:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572485.480852:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572485.480929:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:164968:x1875444569570944:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 111us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572485.480936:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6436 00000100:00080000:2.0:1788572485.482726:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572485.564437:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572485.564703:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569571200 00000100:00100000:3.0:1788572485.564714:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569571200 00000100:00100000:3.0:1788572485.564779:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1285 00000100:00100000:3.0:1788572485.564791:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:164975:x1875444569571200:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00010000:3.0:1788572485.564848:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572485.564874:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf68d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb629 expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.564896:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:3.0:1788572485.564901:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572485.564973:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.564987:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.564999:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565015:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565022:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565028:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565419:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565433:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565439:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565446:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565452:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcea00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572485.565457:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565464:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565473:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:3.0:1788572485.565476:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572485.565507:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565514:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcea00/0x265cfe11109bf694 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572485.565526:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dee5e868 reply state 00000000aa2039e2 transno 347892351012 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565536:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572485.565541:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590d91ea00) 00010000:00010000:3.0:1788572485.565544:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572485.565546:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1788572485.565567:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5906a00000 x1875444569571200/t347892351012(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:185/0 lens 528/448 e 0 to 0 dl 1788572535 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572485.565643:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164975:x1875444569571200:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 854us (1216us total) trans 347892351012 rc 0/0 00000100:00100000:3.0:1788572485.565650:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1285 00000100:00100000:3.0:1788572485.593602:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572485.593786:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569571328 00000100:00100000:1.0:1788572485.593802:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569571328 00000100:00100000:1.0:1788572485.593886:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1286 00000100:00100000:1.0:1788572485.593900:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:164978:x1875444569571328:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572485.593933:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572485.593962:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf6a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb630 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572485.594053:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf6a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572485.594070:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572485.594097:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572485.594155:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572485.594160:0:196070:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1788572485.594185:0:196070:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572485.594216:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255600/0x265cfe11109bf6a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb630 expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572485.594241:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb630 expref: 10 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572485.594251:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:1.0:1788572485.594254:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572485.594259:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254600, rc 0) 00010000:00000080:1.0:1788572485.594269:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b1180 x1875444569571328/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:185/0 lens 576/688 e 0 to 0 dl 1788572535 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788572485.594440:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164978:x1875444569571328:12345-192.168.202.57@tcp:101:rm.0 Request processed in 541us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572485.594451:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1286 00000100:00100000:3.0:1788572485.607952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572485.608043:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569571456 00000100:00100000:2.0:1788572485.608061:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569571456 00000100:00100000:2.0:1788572485.608165:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1287 00000100:00100000:2.0:1788572485.608177:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:164978:x1875444569571456:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:2.0:1788572485.608199:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572485.608222:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ac00/0x265cfe11109bf6b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb637 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608298:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608314:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608327:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608339:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608348:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608355:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608474:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf6c5 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608529:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf6c5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608538:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf6c5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572485.608585:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x9:0x0]: returning size 0 00000004:00200000:2.0:1788572485.608589:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:2.0:1788572485.608607:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf6c5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608617:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf6c5 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608626:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608633:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608639:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608645:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ba00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572485.608649:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608659:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608671:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:2.0:1788572485.608674:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572485.608678:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608684:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf6b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608697:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608703:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608709:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608714:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14b200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572485.608717:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608723:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608730:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590d91ea00) 00010000:00010000:2.0:1788572485.608733:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572485.608736:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608741:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b200/0x265cfe11109bf6be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608772:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ac00/0x265cfe11109bf6b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb637 expref: 12 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608788:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf6c5 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb637 expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.608795:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x9:0x0].0x0 (ffff8e590b95f700) 00010000:00010000:2.0:1788572485.608797:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572485.608800:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14be00, rc 0) 00010000:00000080:2.0:1788572485.608808:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b0000 x1875444569571456/t0(0) o101->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:185/0 lens 600/584 e 0 to 0 dl 1788572535 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788572485.608883:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164978:x1875444569571456:12345-192.168.202.57@tcp:101:rm.0 Request processed in 708us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572485.608891:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1287 00000100:00100000:2.0:1788572485.616020:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572485.616071:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569571712 00000100:00100000:2.0:1788572485.616097:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569571712 00000100:00100000:2.0:1788572485.616163:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1288 00000100:00100000:2.0:1788572485.616176:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164978:x1875444569571712:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572485.616235:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788572485.616264:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf6c5 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb637 expref: 11 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.616285:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x9:0x0].0x0 (ffff8e590b95f700) 00010000:00010000:2.0:1788572485.616301:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254600/0x265cfe11109bf6a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb630 expref: 10 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.616314:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:2.0:1788572485.616317:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572485.616336:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.616348:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.616359:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.616371:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.616377:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.616383:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.618830:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 3/0,1 mode: --/EX res: [0x200027501:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.618857:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.618868:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619215:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619226:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619234:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619241:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619248:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619253:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619276:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572485.619295:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619300:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619306:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619311:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572485.619315:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619322:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619336:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x9:0x0].0x0 (ffff8e590b95f800) 00010000:00010000:2.0:1788572485.619338:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572485.619343:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 2/0,0 mode: --/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619349:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a800/0x265cfe11109bf6da lrc: 0/0,0 mode: --/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619370:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619376:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619382:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619387:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619391:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14b400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572485.619394:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619399:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619405:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:2.0:1788572485.619407:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572485.619410:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619419:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b400/0x265cfe11109bf6cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572485.619934:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008577dc6d reply state 0000000014388dc3 transno 347892351013 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619954:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.619961:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590d91ea00) 00010000:00010000:2.0:1788572485.619964:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572485.619969:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1788572485.620002:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905f6dc00 x1875444569571712/t347892351013(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:185/0 lens 512/456 e 0 to 0 dl 1788572535 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572485.620104:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164978:x1875444569571712:12345-192.168.202.57@tcp:36:rm.0 Request processed in 3931us (4092us total) trans 347892351013 rc 0/0 00000100:00100000:2.0:1788572485.620113:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1288 00010000:00010000:2.0:1788572485.620158:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572485.620164:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.620171:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14b600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572485.620174:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 2/0,0 mode: PW/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.620182:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.620191:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x9:0x0].0x0 (ffff8e590b95f800) 00010000:00010000:2.0:1788572485.620194:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572485.620197:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 1/0,0 mode: --/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.620202:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14b600/0x265cfe11109bf6e1 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572485.620219:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572485.620221:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572485.620222:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572486.016040:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a9c0 going to sleep for 1 seconds 00010000:00010000:2.0:1788572486.268829:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572487.038577:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a9c0 going to sleep for 1 seconds 00010000:00010000:2.0:1788572487.309851:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572487.548856:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584449024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572487.548936:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572487.549145:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584449152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572487.549185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572487.549257:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584449024 00000100:00100000:0.0:1788572487.549265:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584449024 00000100:00100000:0.0:1788572487.549320:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584449152 00000100:00100000:0.0:1788572487.549324:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584449152 00000100:00100000:0.0:1788572487.549343:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1788572487.549352:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584449024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572487.549390:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00010000:00000080:0.0:1788572487.549406:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27423100 x1875444584449024/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:148/0 lens 224/368 e 0 to 0 dl 1788572498 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572487.549450:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584449024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572487.549461:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1788572487.549510:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1788572487.549518:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584449152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572487.549537:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00010000:00000080:0.0:1788572487.549548:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590cb08700 x1875444584449152/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:148/0 lens 224/368 e 0 to 0 dl 1788572498 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572487.549711:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584449152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572487.549720:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1788572487.549773:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584449152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572487.549813:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584449024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572487.558946:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584449408:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.559035:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572487.559117:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584449408 00000100:00100000:0.0:1788572487.559126:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584449408 00000100:00100000:0.0:1788572487.559193:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1788572487.559204:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584449408:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572487.559230:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27420380 x1875444584449408/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1788572537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572487.559273:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584449408:12345-0@lo:400:kworker.0 Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572487.559281:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00080000:0.0:1788572487.559306:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572487.559348:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584449408:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.559393:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584449536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.559422:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572487.559455:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584449536 00000100:00100000:0.0:1788572487.559460:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584449536 00000100:00100000:0.0:1788572487.559525:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1788572487.559534:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584449536:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572487.559549:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b2d80 x1875444584449536/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1788572537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572487.559750:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572487.559761:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584449280:0@lo:400:kworker.0 00000100:00100000:2.0:1788572487.559800:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572487.559840:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584449280 00000100:00100000:2.0:1788572487.559843:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584449280 00000100:00100000:2.0:1788572487.559876:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788572487.559882:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584449280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572487.559918:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584449280:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572487.559924:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788572487.559963:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584449280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.560000:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584449536:12345-0@lo:400:kworker.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572487.560008:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00080000:0.0:1788572487.560035:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572487.560055:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584449536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.560117:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584449920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.560140:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572487.560168:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584449920 00000100:00100000:0.0:1788572487.560171:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584449920 00000100:00100000:0.0:1788572487.560199:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7862 00000100:00100000:0.0:1788572487.560206:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584449920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.560236:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584449920:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572487.560242:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7862 00000100:00080000:0.0:1788572487.560258:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572487.560273:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584449920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.560303:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584450048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.560323:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572487.560372:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584450432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.560393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572487.560436:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584450560:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.560458:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572487.560510:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584450560 00000100:00100000:0.0:1788572487.560514:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584450560 00000100:00100000:0.0:1788572487.560538:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1788572487.560545:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584450560:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572487.560557:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fea4700 x1875444584450560/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1788572537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572487.560689:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584449664:0@lo:400:kworker.0 00000100:00100000:2.0:1788572487.560716:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572487.560735:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584450176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572487.560752:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572487.560769:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788572487.560775:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584449792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572487.560796:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572487.560812:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584450304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572487.560830:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572487.560944:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584450560:12345-0@lo:400:kworker.0 Request processed in 399us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572487.560951:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1788572487.560965:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584449664 00000100:00100000:0.0:1788572487.560968:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584449664 00000100:00100000:0.0:1788572487.561042:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584450176 00000100:00100000:0.0:1788572487.561046:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584450176 00000100:00100000:0.0:1788572487.561059:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584449792 00000100:00100000:0.0:1788572487.561063:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584449792 00000100:00100000:1.0:1788572487.561148:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584450048 00000100:00100000:1.0:1788572487.561153:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584450048 00000100:00100000:3.0:1788572487.563822:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1788572487.563849:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584449664:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572487.563918:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27420a80 x1875444584449664/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1788572537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572487.564028:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584449664:12345-0@lo:400:kworker.0 Request processed in 181us (3299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572487.564036:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1788572487.564068:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1788572487.564076:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584450176:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572487.564099:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27421f80 x1875444584450176/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1788572537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572487.564127:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584450176:12345-0@lo:400:kworker.0 Request processed in 53us (3373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572487.564133:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1788572487.564199:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584450560:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.565259:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1788572487.565270:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584449792:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572487.565288:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40f33b80 x1875444584449792/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1788572537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572487.565338:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584449792:12345-0@lo:400:kworker.0 Request processed in 70us (4542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572487.565343:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00080000:2.0:1788572487.565684:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572487.565691:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572487.565694:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572487.565746:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584449792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572487.565762:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584449664:0@lo:400:kworker.0 00000100:00100000:2.0:1788572487.565774:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584450176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.566570:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584450432 00000100:00100000:0.0:1788572487.566579:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584450432 00000100:00100000:0.0:1788572487.566653:0:177556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584450304 00000100:00100000:0.0:1788572487.566656:0:177556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584450304 00000100:00100000:0.0:1788572487.566685:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7863 00000100:00100000:0.0:1788572487.566692:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584450432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.566763:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584450432:12345-0@lo:400:kworker.0 Request processed in 72us (6368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572487.566770:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7863 00000100:00100000:0.0:1788572487.566788:0:177556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7864 00000100:00100000:0.0:1788572487.566794:0:177556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584450304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.566827:0:177556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584450304:12345-0@lo:400:kworker.0 Request processed in 34us (5995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572487.566833:0:177556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7864 00000100:00100000:0.0:1788572487.566876:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584450432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572487.566905:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584450304:0@lo:400:kworker.0 00000100:00080000:2.0:1788572487.567166:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572487.567171:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572487.567293:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7865 00000100:00100000:1.0:1788572487.567302:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584450048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572487.567347:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584450048:12345-0@lo:400:kworker.0 Request processed in 46us (7022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572487.567353:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7865 00000100:00100000:3.0:1788572487.568462:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584450048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.053935:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572488.054010:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572488.054057:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572488.054083:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572488.054136:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569572224 00000100:00100000:1.0:1788572488.054151:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569572224 00000100:00100000:1.0:1788572488.054235:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7866 00000100:00100000:1.0:1788572488.054246:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569572224:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572488.054328:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569572224:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 84us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572488.054336:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7866 00000100:00080000:1.0:1788572488.054359:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572488.056345:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569571840 00000100:00100000:2.0:1788572488.056359:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569571840 00000100:00100000:2.0:1788572488.056417:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 148 00000100:00100000:2.0:1788572488.056428:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569571840:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572488.056517:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569571840:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 90us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572488.056524:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 148 00000100:00100000:0.0:1788572488.059094:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572488.061209:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569572352 00000100:00100000:1.0:1788572488.061227:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569572352 00000100:00100000:1.0:1788572488.061328:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7867 00000100:00100000:1.0:1788572488.061343:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569572352:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572488.061446:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569572352:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 106us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572488.061455:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7867 00000100:00100000:0.0:1788572488.061810:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a9c0 going to sleep for 1 seconds 00000100:00080000:0.0:1788572488.061828:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572488.062999:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584450688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572488.063077:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572488.063230:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584450688 00000100:00100000:1.0:1788572488.063239:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584450688 00000100:00100000:1.0:1788572488.063296:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6437 00000100:00100000:1.0:1788572488.063306:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584450688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572488.063335:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572488.063385:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584450688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572488.063391:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6437 00000100:00100000:1.0:1788572488.063436:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584450688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572488.066428:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569571968 00000100:00100000:3.0:1788572488.066448:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569571968 00000100:00100000:3.0:1788572488.066553:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569572096 00000100:00100000:3.0:1788572488.066557:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569572096 00000100:00100000:3.0:1788572488.066591:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 507 00000100:00100000:3.0:1788572488.066602:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2400:x1875444569571968:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572488.066637:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fea4000 x1875444569571968/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:188/0 lens 224/224 e 0 to 0 dl 1788572538 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572488.066705:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2400:x1875444569571968:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 106us (12782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572488.066713:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 507 00000100:00100000:3.0:1788572488.066732:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 508 00000100:00100000:3.0:1788572488.066740:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569572096:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572488.066752:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fea4a80 x1875444569572096/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:188/0 lens 224/224 e 0 to 0 dl 1788572538 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572488.066774:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569572096:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 37us (12691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572488.066781:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 508 00000100:00080000:1.0:1788572488.066860:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572488.066865:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572488.072336:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584450816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572488.072428:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.072610:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584450816 00000100:00100000:2.0:1788572488.072619:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584450816 00000100:00100000:2.0:1788572488.072679:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6438 00000100:00100000:2.0:1788572488.072689:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584450816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572488.072719:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572488.079230:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584450816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6531us (6791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572488.079249:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6438 00000100:00100000:1.0:1788572488.079417:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584450816:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572488.317005:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572488.572796:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572488.572824:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584450944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572488.572901:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.572949:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584450944 00000100:00100000:2.0:1788572488.572958:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584450944 00000100:00100000:2.0:1788572488.573011:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6439 00000100:00100000:2.0:1788572488.573021:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584450944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572488.573048:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572488.573113:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584450944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572488.573121:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6439 00000100:00100000:2.0:1788572488.573171:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584450944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572488.573353:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572488.573363:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584451072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572488.573394:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.574651:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584451072 00000100:00100000:2.0:1788572488.574662:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584451072 00000100:00100000:2.0:1788572488.574744:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6440 00000100:00100000:2.0:1788572488.574754:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584451072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572488.574772:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572488.574873:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584451072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572488.574881:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6440 00000100:00100000:1.0:1788572488.586360:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584451072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572489.084798:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a9c0 going to sleep for 1 seconds 00010000:00010000:2.0:1788572489.342757:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788572490.113119:0:198967:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572474/real 1788572474] req@ffff8e5a3f99df80 x1875444584444288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 1 dl 1788572490 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572490.113152:0:198967:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572490.113157:0:198967:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572490.113163:0:198967:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1788572490.113178:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a9c0 going to sleep for 0 seconds 00000100:00080000:2.0:1788572490.113286:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572490.113290:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572490.113292:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572490.113298:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9199 00000100:00080000:2.0:1788572490.113306:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572490.113325:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f31500 x1875444584452352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572490.113378:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584451584:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.113442:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572490.113471:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584452096:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.113520:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572490.113538:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584452736:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.113558:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572490.113583:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572490.113589:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584451456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.113611:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572490.114404:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584452352:0@lo:38:kworker.0 00000100:00100000:3.0:1788572490.114451:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572490.114509:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584452352 00000100:00100000:3.0:1788572490.114518:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584452352 00000100:00100000:3.0:1788572490.114568:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:3.0:1788572490.114577:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3640:x1875444584452352:12345-0@lo:38:kworker.0 00010000:02000400:3.0:1788572490.114605:0:188054:0:(ldlm_lib.c:1363:target_handle_connect()) lustre-MDT0000: Received new MDS connection from 0@lo, keep former export from same NID 00000100:00100000:2.0:1788572490.116746:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584451968:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.116831:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572490.116877:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584452608:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.116901:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572490.116952:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584451584 00000100:00100000:2.0:1788572490.116959:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584451584 00000100:00100000:2.0:1788572490.117023:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584452736 00000100:00100000:2.0:1788572490.117027:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584452736 00000100:00100000:2.0:1788572490.117048:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584451456 00000100:00100000:2.0:1788572490.117050:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584451456 00000100:00100000:2.0:1788572490.117068:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1788572490.117076:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584451584:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572490.117111:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104ea00 x1875444584451584/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1788572540 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572490.117153:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584451584:12345-0@lo:400:kworker.0 Request processed in 77us (3711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572490.117160:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1788572490.117181:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1788572490.117188:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584452736:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572490.117199:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104ca80 x1875444584452736/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1788572540 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572490.117225:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584452736:12345-0@lo:400:kworker.0 Request processed in 39us (3667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572490.117231:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1788572490.117244:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1788572490.117250:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584451456:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572490.117260:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104f480 x1875444584451456/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1788572540 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572490.117286:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584451456:12345-0@lo:400:kworker.0 Request processed in 37us (3674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572490.117292:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1788572490.117315:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584452096 00000100:00100000:2.0:1788572490.117319:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584452096 00000100:00100000:2.0:1788572490.117348:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584451968 00000100:00100000:2.0:1788572490.117351:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584451968 00000100:00100000:2.0:1788572490.117368:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584452608 00000100:00100000:2.0:1788572490.117371:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584452608 00000100:00100000:2.0:1788572490.117391:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7868 00000100:00100000:2.0:1788572490.117397:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584452096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.117425:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584452096:12345-0@lo:400:kworker.0 Request processed in 29us (3905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572490.117432:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7868 00000100:00100000:2.0:1788572490.117444:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7869 00000100:00100000:2.0:1788572490.117449:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584451968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.117475:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584451968:12345-0@lo:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572490.117502:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7869 00000100:00100000:2.0:1788572490.117513:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7870 00000100:00100000:2.0:1788572490.117519:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584452608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.117544:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584452608:12345-0@lo:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572490.117549:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7870 00000100:00100000:2.0:1788572490.117616:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584451456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.117627:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584451968:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.117635:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584452608:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.117645:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584451584:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.117656:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584452096:0@lo:400:kworker.0 00000100:00100000:2.0:1788572490.117666:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584452736:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.118230:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584451200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.118276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572490.118314:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584451712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.118340:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572490.118360:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584452224:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.118380:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572490.118404:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572490.118410:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584451328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.118432:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572490.118448:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584451840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.118471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572490.118509:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584452480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.118533:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572490.118563:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584451840 00000100:00100000:0.0:1788572490.118567:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584451840 00000100:00100000:0.0:1788572490.118598:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1788572490.118605:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584451840:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572490.118624:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cdf480 x1875444584451840/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:151/0 lens 224/224 e 0 to 0 dl 1788572501 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572490.118658:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584451840:12345-0@lo:400:kworker.0 Request processed in 54us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572490.118664:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1788572490.118685:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584451712 00000100:00100000:0.0:1788572490.118689:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584451712 00000100:00100000:0.0:1788572490.118708:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584452224 00000100:00100000:0.0:1788572490.118710:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584452224 00000100:00100000:0.0:1788572490.118721:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584451328 00000100:00100000:0.0:1788572490.118725:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584451328 00000100:00100000:0.0:1788572490.118738:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1788572490.118743:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584451712:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572490.118754:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fea7800 x1875444584451712/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1788572540 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572490.118781:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584451712:12345-0@lo:400:kworker.0 Request processed in 38us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572490.118787:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1788572490.118799:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1788572490.118805:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584452224:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572490.118818:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a84a300 x1875444584452224/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1788572540 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572490.118841:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584452224:12345-0@lo:400:kworker.0 Request processed in 38us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572490.118846:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1788572490.118856:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1788572490.118862:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584451328:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572490.118872:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a849f80 x1875444584451328/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1788572540 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572490.118896:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584451328:12345-0@lo:400:kworker.0 Request processed in 34us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572490.118902:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1788572490.118919:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584451200 00000100:00100000:0.0:1788572490.118923:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584451200 00000100:00100000:0.0:1788572490.118948:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788572490.118955:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584451200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.118984:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584451200:12345-0@lo:400:kworker.0 Request processed in 30us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572490.118990:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788572490.119018:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584452480 00000100:00100000:0.0:1788572490.119022:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584452480 00000100:00100000:0.0:1788572490.119049:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7871 00000100:00100000:0.0:1788572490.119055:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584452480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.119101:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584452480:12345-0@lo:400:kworker.0 Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572490.119107:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7871 00000100:00100000:0.0:1788572490.119141:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584451328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.119152:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584451840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.119161:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584452480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.119169:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584451200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.119179:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584451712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572490.119187:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584452224:0@lo:400:kworker.0 00000100:00080000:0.0:1788572490.124555:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572490.124569:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572490.124573:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572490.124576:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788572490.129755:0:188054:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t347892350997 exp ffff8e5a372df800 cur 9243 last 1788572446 00000004:00100000:3.0:1788572490.129807:0:188054:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli 0@lo does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572490.129825:0:188054:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f312000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788572490.129835:0:188054:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f312000 : changing import state from RECOVER to FULL 00010000:00000080:3.0:1788572490.129858:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590cb08380 x1875444584452352/t0(0) o38->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788572510 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572490.129948:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3640:x1875444584452352:12345-0@lo:38:kworker.0 Request processed in 15371us (15496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572490.129960:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00080000:0.0:1788572490.131402:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 81 00000100:00080000:0.0:1788572490.131424:0:3640:0:(import.c:1341:ptlrpc_connect_interpret()) reconnected to lustre-MDT0000_UUID@0@lo after partition 00000100:00080000:0.0:1788572490.131427:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788572490.131432:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788572490.131452:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1788572490.131459:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000063855879): req@ffff8e5a3f99df80 x1875444584444288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 1 dl 1788572490 ref 2 fl Rpc:XQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572490.131502:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584452352:0@lo:38:kworker.0 00000100:00100000:1.0:1788572490.132572:0:198967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572490.132606:0:198967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a3fb4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572490.132631:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584444288 00000100:00100000:1.0:1788572490.132650:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584444288 00000100:00100000:1.0:1788572490.132702:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1788572490.132712:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:198967:x1875444584444288:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:1.0:1788572490.132751:0:189111:0:(tgt_handler.c:3154:tgt_check_resent()) @@@ reconstruct resent RPC req@ffff8e5a4132b800 x1875444584444288/t347892351009(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:151/0 lens 2520/4320 e 0 to 0 dl 1788572501 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:1.0:1788572490.132767:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a3162e208 index 0: rc = 0 00000020:00080000:1.0:1788572490.132772:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a3162e208 index 1: rc = 0 00000020:00080000:1.0:1788572490.132775:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a3162e208 index 2: rc = 0 00000020:00080000:1.0:1788572490.132781:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a3162e208 index 3: rc = 0 00000020:00080000:1.0:1788572490.132786:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a3162e208 index 4: rc = 0 00000020:00080000:1.0:1788572490.132789:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a3162e208 index 5: rc = 0 00000020:00080000:1.0:1788572490.132791:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a3162e208 index 6: rc = 0 00000020:00080000:1.0:1788572490.132794:0:189111:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8e5a3162e208 index 7: rc = 0 00010000:00000080:1.0:1788572490.132802:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4132b800 x1875444584444288/t347892351009(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:151/0 lens 2520/4320 e 0 to 0 dl 1788572501 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572490.132853:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:198967:x1875444584444288:12345-0@lo:1000:osp_up0-1.0 Request processed in 143us (283us total) trans 347892351009 rc 0/0 00000100:00100000:1.0:1788572490.132859:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1788572490.133290:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584452864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572490.133326:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572490.133363:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584452864 00000100:00100000:0.0:1788572490.133368:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584452864 00000100:00100000:0.0:1788572490.133402:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1788572490.133409:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584452864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572490.133438:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00010000:00000080:0.0:1788572490.133450:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cded80 x1875444584452864/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:151/0 lens 224/368 e 0 to 0 dl 1788572501 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572490.133494:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584452864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572490.133501:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1788572490.133535:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584452864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572490.138812:0:198967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198967:1875444584444288:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1788572490.143941:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572490.143965:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572490.143980:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572490.144001:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009aa2605 reply state 000000002fe36f64 transno 25769803846 ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572490.144012:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572490.144019:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b95f800) 00010000:00010000:2.0:1788572490.144022:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572490.144026:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788572490.144031:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x2b:0x0]: returning size 4096 00000004:00080000:2.0:1788572490.144041:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x7:0x0] 00010000:00010000:2.0:1788572490.144778:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572490.144792:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572490.145374:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572490.145415:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788572490.145423:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x7:0x0] 00010000:00010000:2.0:1788572490.145429:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf62b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572490.145438:0:188833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf62b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572490.145454:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572490.145461:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 2/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572490.145468:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164ee00 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:0.0:1788572490.145473:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1788572490.145500:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99e300 x1875444569567616/t25769803846(0) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:160/0 lens 560/448 e 1 to 0 dl 1788572510 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000004:00010000:0.0:1788572490.145504:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572490.145546:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572490.145562:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00080000:2.0:1788572490.145573:0:188833:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1788572490.145580:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 1/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572490.145585:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:164868:x1875444569567616:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 15386062us (15386273us total) trans 25769803846 rc 0/0 00010000:00010000:0.0:1788572490.145588:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164ee00/0x265cfe11109bf616 lrc: 0/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf61d expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572490.145594:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1275 00010000:00010000:0.0:1788572490.145608:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572490.145610:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572490.145612:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572490.145621:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572490.145638:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584452992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572490.145693:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572490.146697:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572490.146711:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572490.146717:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572490.146724:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14b800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572490.146728:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572490.146736:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572490.146756:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b95f800) 00010000:00010000:1.0:1788572490.146759:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572490.146763:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572490.146769:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b800/0x265cfe11109bf6e8 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572490.146804:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584452992 00000100:00100000:1.0:1788572490.146812:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584452992 00000100:00100000:1.0:1788572490.147001:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4679 00000100:00100000:1.0:1788572490.147011:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584452992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572490.147024:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572490.147040:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254800/0x265cfe11109bf61d lrc: 0/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf616 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572490.147262:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b478c00) 00010000:00010000:1.0:1788572490.147267:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572490.147329:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3641:x1875444584452992:12345-0@lo:103:ldlm_bl.0 Request processed in 319us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572490.147336:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4679 00000100:00100000:0.0:1788572490.147533:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584452992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572490.156193:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572490.159958:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569572608 00000100:00100000:0.0:1788572490.159975:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569572608 00000100:00080000:1.0:1788572490.160068:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572490.160070:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 64 00000100:00100000:0.0:1788572490.160089:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:164868:x1875444569572608:12345-192.168.202.57@tcp:35:lfs.0 00010000:00000080:0.0:1788572490.160293:0:188052:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41329180 x1875444569572608/t347892351014(0) o35->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:151/0 lens 392/456 e 0 to 0 dl 1788572501 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788572490.160381:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:164868:x1875444569572608:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 302us (4198us total) trans 347892351014 rc 0/0 00000100:00100000:0.0:1788572490.160392:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 64 00010000:00010000:2.0:1788572490.365824:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788572491.132936:0:196576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351014 is committed 00010000:00010000:0.0:1788572491.133107:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133122:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133130:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133136:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572491.133142:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133150:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133169:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590d91ea00) 00010000:00010000:0.0:1788572491.133172:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572491.133176:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133183:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce000/0x265cfe11109bf69b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133203:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133209:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133218:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133224:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572491.133227:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133233:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133240:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e590d91ea00) 00010000:00010000:0.0:1788572491.133242:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572491.133245:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572491.133251:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a000/0x265cfe11109bf6d3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572491.398787:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572492.415679:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572492.669008:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584453120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572492.669111:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572492.669213:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584453120 00000100:00100000:0.0:1788572492.669223:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584453120 00000100:00100000:0.0:1788572492.669278:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1788572492.669287:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584453120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572492.669321:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00010000:00000080:0.0:1788572492.669337:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104e300 x1875444584453120/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:153/0 lens 224/368 e 0 to 0 dl 1788572503 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572492.669390:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584453120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572492.669397:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1788572492.670808:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584453120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572493.163927:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572493.163977:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572493.164015:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572493.164036:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572493.164092:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572493.164221:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569572864 00000100:00100000:2.0:1788572493.164232:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569572864 00000100:00100000:2.0:1788572493.164304:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569572992 00000100:00100000:2.0:1788572493.164308:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569572992 00000100:00100000:2.0:1788572493.164339:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 515 00000100:00100000:2.0:1788572493.164349:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569572864:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:2.0:1788572493.164393:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590cb09180 x1875444569572864/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:154/0 lens 224/224 e 0 to 0 dl 1788572504 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572493.164456:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569572864:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 108us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572493.164464:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 515 00000100:00100000:2.0:1788572493.164509:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 516 00000100:00100000:2.0:1788572493.164528:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569572992:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:2.0:1788572493.164544:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590cb0a680 x1875444569572992/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:168/0 lens 224/224 e 0 to 0 dl 1788572518 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572493.164567:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569572992:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 53us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572493.164573:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 516 00000100:00100000:2.0:1788572493.164594:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569573120 00000100:00100000:2.0:1788572493.164597:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569573120 00000100:00100000:2.0:1788572493.164623:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569573248 00000100:00100000:2.0:1788572493.164626:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569573248 00000100:00100000:2.0:1788572493.164646:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7872 00000100:00100000:2.0:1788572493.164652:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569573120:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572493.164676:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569573120:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 24us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572493.164683:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7872 00000100:00100000:2.0:1788572493.164694:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7873 00000100:00100000:2.0:1788572493.164700:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569573248:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572493.164724:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569573248:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572493.164730:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7873 00000100:00100000:2.0:1788572493.164873:0:196581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569572736 00000100:00100000:2.0:1788572493.164876:0:196581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569572736 00000100:00100000:2.0:1788572493.164903:0:196581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 150 00000100:00100000:2.0:1788572493.164910:0:196581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569572736:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572493.164935:0:196581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569572736:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572493.164941:0:196581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 150 00000100:00080000:3.0:1788572493.167452:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572493.167463:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572493.167466:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572493.167469:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572493.181918:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572493.181942:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584453248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572493.182022:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572493.182395:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584453376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572493.182428:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572493.182500:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584453248 00000100:00100000:2.0:1788572493.182508:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584453248 00000100:00100000:3.0:1788572493.183738:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584453376 00000100:00100000:3.0:1788572493.183749:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584453376 00000100:00100000:3.0:1788572493.183779:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6441 00000100:00100000:3.0:1788572493.183789:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584453248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572493.183883:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572493.183955:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584453248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 166us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572493.183962:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6441 00000100:00100000:3.0:1788572493.183981:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6442 00000100:00100000:3.0:1788572493.183988:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584453376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572493.184017:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572493.184054:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584453376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1624us total) trans 0 rc 0/0 00000100:00080000:1.0:1788572493.184538:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572493.184543:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572493.184893:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584453376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572493.184935:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584453248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572493.189297:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6442 00010000:00010000:2.0:1788572493.436913:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572493.638219:0:200607:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00000100:00100000:1.0:1788572493.699060:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584453504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572493.699143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.699193:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572493.699201:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584453632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572493.699227:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.699256:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584453504 00000100:00100000:1.0:1788572493.699264:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584453504 00000100:00100000:1.0:1788572493.699319:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584453632 00000100:00100000:1.0:1788572493.699322:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584453632 00000100:00100000:1.0:1788572493.699339:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6443 00000100:00100000:1.0:1788572493.699347:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584453504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572493.699371:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572493.699412:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584453504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.699419:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6443 00000100:00100000:1.0:1788572493.699434:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6444 00000100:00100000:1.0:1788572493.699440:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584453632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572493.699450:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572493.699496:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584453632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.699502:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6444 00000100:00080000:1.0:1788572493.699522:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572493.699526:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572493.699560:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584453632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572493.699592:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584453504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572494.475995:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572495.228815:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584453760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.228903:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.228956:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584454272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.228983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229005:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584454784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229026:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229044:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584455296:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229076:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229102:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572495.229108:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584454144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229129:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229147:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584454656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229170:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229189:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584455168:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229206:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229234:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584453888:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229268:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229286:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584454400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229308:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229324:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584454912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229356:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584455424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572495.229376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229394:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572495.229399:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584454016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229419:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229437:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584454528:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229458:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229474:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584455040:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.229516:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.229549:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584454272 00000100:00100000:1.0:1788572495.229558:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584454272 00000100:00100000:1.0:1788572495.229606:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584454784 00000100:00100000:1.0:1788572495.229609:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584454784 00000100:00100000:1.0:1788572495.229703:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584455296 00000100:00100000:1.0:1788572495.229707:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584455296 00000100:00100000:1.0:1788572495.229718:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584454144 00000100:00100000:1.0:1788572495.229720:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584454144 00000100:00100000:1.0:1788572495.229731:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584453888 00000100:00100000:1.0:1788572495.229734:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584453888 00000100:00100000:1.0:1788572495.229745:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584454016 00000100:00100000:1.0:1788572495.229748:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584454016 00000100:00100000:1.0:1788572495.229763:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1788572495.229771:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584454272:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572495.229795:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41329c00 x1875444584454272/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:156/0 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572495.229838:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584454272:12345-0@lo:400:kworker.0 Request processed in 67us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.229845:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1788572495.229860:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1788572495.229866:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584454784:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572495.229876:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4132ad80 x1875444584454784/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:156/0 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572495.229900:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584454784:12345-0@lo:400:kworker.0 Request processed in 34us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.229908:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1788572495.229918:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1788572495.229923:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584455296:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572495.229932:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4132a680 x1875444584455296/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:156/0 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572495.229954:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584455296:12345-0@lo:400:kworker.0 Request processed in 31us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.229959:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1788572495.229969:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1788572495.229974:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584454144:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572495.229984:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41329500 x1875444584454144/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:156/0 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572495.230006:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584454144:12345-0@lo:400:kworker.0 Request processed in 32us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230011:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1788572495.230021:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1788572495.230026:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584453888:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572495.230036:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41328000 x1875444584453888/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:156/0 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572495.230077:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584453888:12345-0@lo:400:kworker.0 Request processed in 50us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230083:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1788572495.230094:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1788572495.230100:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584454016:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572495.230110:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590d8afb80 x1875444584454016/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:156/0 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572495.230133:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584454016:12345-0@lo:400:kworker.0 Request processed in 34us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230139:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1788572495.230165:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584454656 00000100:00100000:1.0:1788572495.230168:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584454656 00000100:00100000:1.0:1788572495.230192:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584455168 00000100:00100000:1.0:1788572495.230195:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584455168 00000100:00100000:1.0:1788572495.230210:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584454528 00000100:00100000:1.0:1788572495.230212:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584454528 00000100:00100000:1.0:1788572495.230228:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584455040 00000100:00100000:1.0:1788572495.230231:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584455040 00000100:00100000:1.0:1788572495.230248:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7874 00000100:00100000:1.0:1788572495.230254:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584454656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230285:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584454656:12345-0@lo:400:kworker.0 Request processed in 31us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230291:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7874 00000100:00100000:1.0:1788572495.230301:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7875 00000100:00100000:1.0:1788572495.230305:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584455168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230331:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584455168:12345-0@lo:400:kworker.0 Request processed in 26us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230336:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7875 00000100:00100000:1.0:1788572495.230345:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7876 00000100:00100000:1.0:1788572495.230350:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584454528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230373:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584454528:12345-0@lo:400:kworker.0 Request processed in 23us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230381:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7876 00000100:00100000:1.0:1788572495.230390:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7877 00000100:00100000:1.0:1788572495.230395:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584455040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230418:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584455040:12345-0@lo:400:kworker.0 Request processed in 24us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230423:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7877 00000100:00100000:1.0:1788572495.230445:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584454400 00000100:00100000:1.0:1788572495.230448:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584454400 00000100:00100000:1.0:1788572495.230464:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584454912 00000100:00100000:1.0:1788572495.230466:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584454912 00000100:00100000:1.0:1788572495.230475:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584455424 00000100:00100000:1.0:1788572495.230500:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584455424 00000100:00100000:1.0:1788572495.230512:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1788572495.230518:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584454400:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572495.230531:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590d8ac700 x1875444584454400/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:156/0 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572495.230557:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584454400:12345-0@lo:400:kworker.0 Request processed in 39us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230563:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1788572495.230573:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1788572495.230578:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584454912:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572495.230593:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590d8adf80 x1875444584454912/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:156/0 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572495.230632:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584454912:12345-0@lo:400:kworker.0 Request processed in 38us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230638:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1788572495.230650:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1788572495.230656:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3641:x1875444584455424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572495.230682:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00010000:00000080:1.0:1788572495.230692:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590d8aea00 x1875444584455424/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:156/0 lens 224/368 e 0 to 0 dl 1788572506 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572495.230716:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3641:x1875444584455424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.230721:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00080000:1.0:1788572495.230755:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572495.230759:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572495.230762:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572495.230763:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572495.230806:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584454016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230817:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584454528:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230827:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584455040:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230836:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584453888:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230844:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584454400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230854:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584454912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230867:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584455424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572495.230908:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584454144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230919:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584454656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230929:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584455168:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230942:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584454272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230953:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584454784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572495.230963:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584455296:0@lo:400:kworker.0 00000100:00100000:2.0:1788572495.231393:0:196582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584453760 00000100:00100000:2.0:1788572495.231399:0:196582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584453760 00000100:00100000:2.0:1788572495.231444:0:196582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788572495.231451:0:196582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a420c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584453760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572495.231520:0:196582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a420c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584453760:12345-0@lo:400:kworker.0 Request processed in 70us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572495.231526:0:196582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788572495.236276:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584453760:0@lo:400:kworker.0 00010000:00010000:1.0:1788572495.496001:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788572496.201574:0:200704:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788572496.201651:0:200704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572496.201665:0:200704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572496.201677:0:200704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572496.201684:0:200704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572496.201699:0:200704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788572496.201704:0:200704:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788572496.201738:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572496.201743:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788572496.201749:0:200704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788572496.201774:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e59019dd000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788572496.201848:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572496.201857:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.201864:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01671400 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:1.0:1788572496.201878:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.201989:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572496.201998:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572496.202005:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788572496.202008:0:82817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788572496.202010:0:82817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788572496.202039:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.202045:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572496.202091:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.202104:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a01671400/0x265cfe11109be0de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be0e5 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.202116:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572496.202117:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572496.202119:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572496.202127:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572496.202145:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584455680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572496.202213:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572496.202275:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584455680 00000100:00100000:1.0:1788572496.202281:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584455680 00000100:00100000:1.0:1788572496.202331:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4680 00000100:00100000:1.0:1788572496.202340:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584455680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572496.202353:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572496.202368:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01671800/0x265cfe11109be0e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be0de expref: 24 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.202380:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572496.202414:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3641:x1875444584455680:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572496.202422:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4680 00000100:00100000:1.0:1788572496.202458:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584455680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572496.202673:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584455552:0@lo:39:umount.0 00000100:00100000:0.0:1788572496.202709:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572496.202770:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584455552 00000100:00100000:1.0:1788572496.202775:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584455552 00000100:00100000:1.0:1788572496.202813:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1788572496.202821:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584455552:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572496.202846:0:188050:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be1ef 00000100:00080000:1.0:1788572496.202854:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d0800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1788572496.203073:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36a4fb80 x1875444584455552/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1788572521 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572496.203124:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875444584455552:12345-0@lo:39:umount.0 Request processed in 305us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572496.203130:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000020:00000080:1.0:1788572496.203137:0:188050:0:(genops.c:885:class_export_put()) final put ffff8e5a071d4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788572496.203160:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a071d4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572496.203222:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a071d0800 for lustre-MDT0000 00000100:00080000:2.0:1788572496.203322:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019dd000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788572496.203343:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584455552:0@lo:39:umount.0 00000100:00080000:1.0:1788572496.203398:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572496.203401:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788572496.203406:0:200704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788572496.204333:0:200704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.204348:0:200704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.204355:0:200704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.204362:0:200704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.204740:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572496.204748:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.204756:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcee00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572496.204760:0:10395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.204769:0:10395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572496.204776:0:10395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572496.204782:0:10395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572496.204784:0:10395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788572496.204812:0:10395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.204818:0:10395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572496.204856:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.204865:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572496.204985:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584455808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572496.205046:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572496.205114:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584455808 00000100:00100000:2.0:1788572496.205120:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584455808 00000100:00100000:2.0:1788572496.205164:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4681 00000100:00100000:2.0:1788572496.205172:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3643:x1875444584455808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572496.205184:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572496.205198:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1ffce000/0x265cfe11109be00c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be005 expref: 23 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572496.205213:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572496.205245:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3643:x1875444584455808:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572496.205253:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4681 00000100:00100000:2.0:1788572496.205285:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584455808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572496.205377:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572496.205381:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572496.209203:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572496.209237:0:200704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572496.209249:0:200704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcee00/0x265cfe11109be005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be00c expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.209281:0:200704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.209289:0:200704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.209295:0:200704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.209301:0:200704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.209358:0:200704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572496.209366:0:200704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.209372:0:200704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.209378:0:200704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.209384:0:200704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.209588:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572496.209596:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.209603:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce200 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572496.209606:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.209615:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572496.209621:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572496.209626:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788572496.209629:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788572496.209632:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788572496.209670:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.209676:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788572496.209729:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584455936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572496.209795:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572496.209864:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.209885:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce200/0x265cfe11109bed6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bed72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572496.209968:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584455936 00000100:00100000:2.0:1788572496.209976:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584455936 00000100:00100000:2.0:1788572496.210024:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4682 00000100:00100000:2.0:1788572496.210033:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3644:x1875444584455936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572496.210047:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572496.210072:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11255800/0x265cfe11109bed72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bed6b expref: 22 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572496.210095:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572496.210146:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572496.210149:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.210154:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a01670600 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572496.210157:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.210163:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572496.210169:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572496.210173:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788572496.210175:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788572496.210189:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.210194:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572496.210212:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.210220:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572496.210221:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572496.210223:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572496.210237:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584456064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572496.210265:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572496.210300:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584456064 00000100:00100000:3.0:1788572496.210304:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584456064 00000100:00100000:3.0:1788572496.210335:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4683 00000100:00100000:3.0:1788572496.210342:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3641:x1875444584456064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572496.210349:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572496.210358:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe0600/0x265cfe11109be0d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be0d0 expref: 22 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.210367:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572496.210394:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3641:x1875444584456064:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572496.210401:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4683 00000100:00100000:3.0:1788572496.210442:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584456064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572496.211014:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572496.211038:0:200704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572496.211045:0:200704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a01670600/0x265cfe11109be0d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109be0d7 expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572496.211074:0:200704:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788572496.211084:0:200704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.211093:0:200704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.211101:0:200704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.211107:0:200704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.211129:0:200704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788572496.211133:0:200704:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788572496.211136:0:200704:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788572496.211178:0:200704:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788572496.211183:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788572496.211187:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788572496.211193:0:200704:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1788572496.211680:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572496.211687:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.211695:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfc00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:3.0:1788572496.211699:0:82817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.211708:0:82817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572496.211715:0:82817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572496.211722:0:82817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788572496.211724:0:82817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788572496.211726:0:82817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788572496.211752:0:82817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.211757:0:82817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572496.211774:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.211782:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffcfc00/0x265cfe11109bdff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bdffe expref: -99 pid: 196575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.211793:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572496.211795:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572496.211796:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572496.211809:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584456192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572496.211857:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572496.212075:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584456192 00000100:00100000:3.0:1788572496.212082:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584456192 00000100:00100000:3.0:1788572496.212127:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4684 00000100:00100000:3.0:1788572496.212135:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3642:x1875444584456192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572496.212146:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572496.212160:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1800/0x265cfe11109bdffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bdff7 expref: 21 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.212173:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572496.212204:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:3642:x1875444584456192:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572496.212211:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4684 00000100:00100000:3.0:1788572496.212247:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584456192:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1788572496.213726:0:200704:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1788572496.213965:0:200704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788572496.213973:0:200704:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a1d701800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572496.213981:0:200704:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a372df800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 2) 0 0 0 0: 0000000000000000 347892351009 stale:0 00000020:00080000:1.0:1788572496.213985:0:200704:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a3191b000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572496.213989:0:200704:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a0efd5800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572496.213996:0:200704:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5a0f02a000 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 192.168.202.57@tcp 6 (0 0 1) 0 0 0 0: 0000000000000000 347892351014 stale:0 00000020:00080000:1.0:1788572496.214002:0:200704:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8e5a413fcd40) has exports, disconnecting them 00000020:00080000:1.0:1788572496.214008:0:200704:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a1d701800), last request at 1788572446 00000020:00000080:1.0:1788572496.214015:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bed48 00000100:00080000:1.0:1788572496.214023:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e5a08d27000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788572496.214052:0:200704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a1d701800): rc 0 00000020:00000080:1.0:1788572496.214067:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a1d701800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788572496.214079:0:200704:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a372df800), last request at 1788572446 00000020:00000080:1.0:1788572496.214082:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109becd1 00000020:00010000:1.0:1788572496.214085:0:200704:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a372df800: total 1 00000100:00080000:1.0:1788572496.214088:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f312000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788572496.214103:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1d701800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572496.214140:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a08d27000 for lustre-MDT0000 00000020:00010000:1.0:1788572496.214154:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a372df800: total 0 00010000:00010000:1.0:1788572496.214183:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a372df800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788572496.214215:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00031a00/0x265cfe11109bf62b lrc: 0/0,0 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf624 expref: 6 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.214241:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf400/0x265cfe11109bef0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bef08 expref: 5 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572496.214257:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a372df800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788572496.215520:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572496.215688:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3644:x1875444584455936:12345-0@lo:103:ldlm_bl.0 Request processed in 5651us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572496.215701:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4682 00000100:00100000:0.0:1788572496.215807:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584455936:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788572496.216624:0:200704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a372df800): rc 0 00000020:00080000:2.0:1788572496.216631:0:200704:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a3191b000), last request at 1788572495 00000020:00000080:2.0:1788572496.216638:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be1e8 00000100:00080000:2.0:1788572496.216647:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e5a10fc6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788572496.216705:0:200704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a3191b000): rc 0 00000020:00000080:2.0:1788572496.216708:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a3191b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788572496.216721:0:200704:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5a0efd5800), last request at 1788572495 00000020:00000080:2.0:1788572496.216729:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be1da 00000100:00080000:2.0:1788572496.216738:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd0000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788572496.220572:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3191b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788572496.220653:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a10fc6000 for lustre-MDT0000 00010000:00010000:3.0:1788572496.220716:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788572496.220841:0:200704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a0efd5800): rc 0 00000020:00000080:2.0:1788572496.220846:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a0efd5800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1788572496.221024:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788572496.221051:0:200704:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.57@tcp (ffff8e5a0f02a000), last request at 1788572493 00000020:00000080:2.0:1788572496.221084:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be04b 00000020:00010000:2.0:1788572496.221100:0:200704:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a0f02a000: total 1 00000100:00080000:2.0:1788572496.221106:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e5a109d5800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788572496.221128:0:200704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e5a0f02a000): rc 0 00000004:00000080:2.0:1788572496.221135:0:200704:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaac781da3ae0 00000100:00080000:2.0:1788572496.221158:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788572496.221163:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:3.0:1788572496.222092:0:82817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a0f02a000: total 1 00010000:00010000:3.0:1788572496.222197:0:82817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a0f02a000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788572496.222238:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11254c00/0x265cfe11109bf5c9 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb5f8 expref: 2 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572496.222265:0:82817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a0f02a000, canceled 1 locks, left on hash table 0. 00000100:00080000:2.0:1788572496.225659:0:200704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788572496.225699:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788572496.229279:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584456320:0@lo:39:umount.0 00000100:00100000:2.0:1788572496.229376:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788572496.230015:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efd5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788572496.230153:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0efd0000 for lustre-MDT0000 00000100:00080000:2.0:1788572496.230463:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788572496.230468:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 3 00000004:00080000:2.0:1788572496.233015:0:200704:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788572496.233100:0:200704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788572496.233136:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd4800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788572496.233164:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788572496.233169:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975677 gen 3 00000004:00080000:2.0:1788572496.233183:0:200704:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572496.233267:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584456448:0@lo:9:umount.0 00000100:00100000:2.0:1788572496.233346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572496.233402:0:200704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788572496.233414:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e59051d8800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788572496.233429:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584456576:0@lo:9:umount.0 00000100:00100000:2.0:1788572496.233452:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788572496.233530:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e5a413fcd40) has no exports 00000020:00080000:2.0:1788572496.233851:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e5a413fcd40) has no exports 00000100:00100000:0.0:1788572496.235197:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584456448 00000100:00100000:0.0:1788572496.235211:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584456448 00000100:00100000:0.0:1788572496.235262:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584456576 00000100:00100000:0.0:1788572496.235265:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584456576 00000100:00100000:0.0:1788572496.235287:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22719 00000100:00100000:0.0:1788572496.235296:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584456448:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788572496.235323:0:8704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be0a6 00000100:00080000:0.0:1788572496.235332:0:8704:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572496.235381:0:8704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705689 00000100:00100000:0.0:1788572496.235569:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3640:x1875444584456448:12345-0@lo:9:umount.0 Request processed in 274us (2222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572496.235578:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22719 00000100:00100000:0.0:1788572496.235595:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22720 00000100:00100000:0.0:1788572496.235602:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875444584456576:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788572496.235614:0:8704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be0bb 00000100:00080000:0.0:1788572496.235620:0:8704:0:(import.c:65:import_set_state_nolock()) ffff8e59051df800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572496.235643:0:8704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975698 00000100:00100000:0.0:1788572496.235719:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3640:x1875444584456576:12345-0@lo:9:umount.0 Request processed in 117us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572496.235726:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22720 00000100:00080000:0.0:1788572496.235765:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59051d8800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788572496.235772:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788572496.235774:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572496.235778:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584456576:0@lo:9:umount.0 00000100:00080000:0.0:1788572496.235790:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efd4800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788572496.235797:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788572496.235799:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572496.235801:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584456448:0@lo:9:umount.0 00010000:00010000:0.0:1788572496.235827:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572496.235832:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572496.244072:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584456320 00000100:00100000:0.0:1788572496.244087:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584456320 00000100:00100000:0.0:1788572496.244156:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1788572496.244165:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584456320:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788572496.244200:0:189111:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109becae 00000100:00080000:0.0:1788572496.244222:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e590b9ac000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572496.244244:0:189111:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803846 00010000:00000080:0.0:1788572496.244358:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590542e300 x1875444584456320/t25769803847(0) o39->lustre-MDT0000-mdtlov_UUID@0@lo:157/0 lens 224/224 e 0 to 0 dl 1788572507 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572496.244442:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1875444584456320:12345-0@lo:39:umount.0 Request processed in 278us (15066us total) trans 25769803847 rc 0/0 00000100:00100000:0.0:1788572496.244451:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00010000:00010000:0.0:1788572496.244495:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572496.244533:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59059d0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572496.244543:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584456320:0@lo:39:umount.0 00000020:00000080:1.0:1788572496.275310:0:6505:0:(genops.c:885:class_export_put()) final put ffff8e5a372df800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1788572496.275359:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572496.275362:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572496.275365:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788572496.276250:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a372df800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572496.276302:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f312000 for lustre-MDT0000 00000020:00000080:3.0:1788572496.290345:0:82817:0:(genops.c:885:class_export_put()) final put ffff8e5a0f02a000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00010000:00010000:3.0:1788572496.294010:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572496.294016:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572496.294020:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572496.297697:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f02a000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-MDT0000 00000020:00000080:1.0:1788572496.297833:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a109d5800 for lustre-MDT0000 00000020:00000080:2.0:1788572496.326364:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be067 00000020:00000080:2.0:1788572496.326384:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5903355800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788572496.326467:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788572496.326758:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5903355800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788572496.326816:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572496.326829:0:200704:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788572496.326834:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8e5a40148000) has no exports 00000020:00000080:0.0:1788572496.327468:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be060 00000020:00000080:0.0:1788572496.327701:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e590cac0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572496.327883:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cac0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572496.327942:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572496.327953:0:200704:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788572496.327957:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a3f9d3000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788572496.327959:0:200704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f9d3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788572496.327964:0:200704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788572496.328117:0:200704:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e590686ec00 - data ffff8e5a35a1e5e8/ffff8e59047b9400 00000020:01000000:1.0:1788572496.328256:0:200704:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e59031fa960 - data ffff8e5a0f5d4a20/ffff8e5901b6a800 00000100:00080000:2.0:1788572496.380621:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788572496.380629:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788572496.380645:0:200704:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e590542ea00 x1875444584456320/t25769803847(25769803847) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572506 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572496.380672:0:200704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788572496.382305:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572496.382312:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 4 00000004:00080000:1.0:1788572496.382326:0:200704:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572496.382328:0:200704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788572496.382799:0:196594:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788572496.382804:0:196594:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x144:0x0] index 1 count 1 00000040:00080000:0.0:1788572496.382814:0:196594:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 81 count 2 00000100:00080000:1.0:1788572496.383443:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572496.383447:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975677 gen 4 00000004:00080000:1.0:1788572496.383464:0:200704:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572496.383466:0:200704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788572496.384051:0:196596:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788572496.384065:0:196596:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x146:0x0] index 1 count 1 00000040:00080000:0.0:1788572496.384074:0:196596:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 81 count 2 00000020:00000080:1.0:1788572496.385539:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be01a 00000020:00000080:1.0:1788572496.385551:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5901977000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572496.386193:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be02f 00000020:00000080:1.0:1788572496.386199:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5902a86000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572496.386204:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788572496.386210:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572496.386221:0:200704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572496.386225:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8e590218b380) has no exports 00000004:01000000:1.0:1788572496.386379:0:200704:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788572496.386388:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be0b4 00000020:00000080:1.0:1788572496.386392:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e590b8c9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572496.386396:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788572496.386399:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572496.386405:0:200704:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572496.386408:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 19 (ffff8e5a372019c0) has no exports 00000020:00000080:1.0:1788572496.386413:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be0ad 00000020:00000080:1.0:1788572496.386416:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a1f1aa800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788572496.386777:0:200704:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788572496.386782:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572496.386786:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975677 gen 5 00000004:00080000:1.0:1788572496.386791:0:200704:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572496.386793:0:200704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572496.386820:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572496.386828:0:200704:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572496.386832:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be098 00000020:00000080:1.0:1788572496.386837:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a3711f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572496.386840:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788572496.386843:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572496.386847:0:200704:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572496.386849:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8e590415cd40) has no exports 00000020:00000080:1.0:1788572496.386852:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be08a 00000020:00000080:1.0:1788572496.386855:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a0efd1000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788572496.387178:0:200704:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788572496.387182:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572496.387183:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 5 00000004:00080000:1.0:1788572496.387187:0:200704:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572496.387188:0:200704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572496.387214:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572496.387219:0:200704:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788572496.387229:0:200704:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788572496.387234:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be07c 00000020:00000080:1.0:1788572496.387238:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5901972000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572496.387242:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788572496.387246:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572496.387250:0:200704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572496.387252:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8e5a109f99c0) has no exports 00000020:00000080:1.0:1788572496.387256:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be075 00000020:00000080:1.0:1788572496.387258:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a10fc3000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572496.388033:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5901977000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572496.388045:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5902a86000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788572496.388051:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b8c9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788572496.388071:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1f1aa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572496.388077:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59051d8800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788572496.388084:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5a3711d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572496.388086:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3711d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788572496.388089:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572496.388181:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3711f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572496.388186:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efd1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572496.388192:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0efd4800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572496.388199:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5901971800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572496.388200:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5901971800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788572496.388205:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572496.388239:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5901972000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788572496.388245:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a10fc3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788572496.390990:0:200704:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788572496.391000:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788572496.391004:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788572496.391012:0:200704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788572496.391091:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572496.391107:0:200704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572496.391139:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572496.391143:0:200704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572496.391148:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a36c39800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572496.391152:0:200704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36c39800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788572496.391159:0:200704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572496.391271:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be036 00000020:00000080:0.0:1788572496.391279:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5902a83000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788572496.391284:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788572496.391288:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572496.391294:0:200704:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788572496.391298:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8e5a413fb380) has no exports 00000020:00000080:0.0:1788572496.391321:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572496.391326:0:200704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788572496.391331:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be03d 00000020:00000080:0.0:1788572496.391334:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5902a82000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788572496.391342:0:200704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a0f05c800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788572496.391345:0:200704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a0f05c800 3 00000020:01000004:0.0:1788572496.391348:0:200704:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5a0f05c800 from lustre-MDT0000 00000020:00000080:0.0:1788572496.391366:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572496.391370:0:200704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788572496.391372:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5901975000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788572496.391374:0:200704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5901975000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788572496.391381:0:200704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788572496.391414:0:200704:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788572496.391418:0:200704:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788572496.391421:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788572496.391424:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572496.391426:0:200704:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788572496.391432:0:200704:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e590cc71800 e87131b0-4a60-4def-a26d-6e23dcfe5daa 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572496.391441:0:200704:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e5a10ff8800 f79285ed-4685-45a8-8731-5e2522a143f3 192.168.202.57@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572496.391446:0:200704:0:(genops.c:1553:class_disconnect_exports()) OBD device 4 (ffff8e5a37203380) has exports, disconnecting them 00000020:00080000:0.0:1788572496.391449:0:200704:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e590cc71800), last request at 1788572369 00000020:00000080:0.0:1788572496.391471:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdfe9 00000020:00010000:0.0:1788572496.391475:0:200704:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e590cc71800: total 2 00000100:00080000:0.0:1788572496.391510:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e590cc73800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572496.391522:0:200704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e590cc71800): rc 0 00000020:00080000:0.0:1788572496.391527:0:200704:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.57@tcp (ffff8e5a10ff8800), last request at 1788572367 00000020:00010000:0.0:1788572496.391572:0:6506:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e590cc71800: total 2 00010000:00010000:0.0:1788572496.391576:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572496.391603:0:6506:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e590cc71800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788572496.391635:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1ffcfa00/0x265cfe11109be1be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be1b7 expref: 14 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391653:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe0000/0x265cfe11109be186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be17f expref: 13 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391666:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a4117f000/0x265cfe11109bec68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bec61 expref: 12 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391681:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5000/0x265cfe11109be116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be10f expref: 11 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391693:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a4117f400/0x265cfe11109bed25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bed1e expref: 10 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391708:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1ffcf400/0x265cfe11109be194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be18d expref: 9 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391718:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dce400/0x265cfe11109bec76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bec6f expref: 8 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391727:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01671a00/0x265cfe11109be124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be11d expref: 7 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391738:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dcec00/0x265cfe11109bed33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bed2c expref: 6 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391749:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a01670200/0x265cfe11109be1a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be19b expref: 5 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391760:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb5800/0x265cfe11109be132 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be12b expref: 4 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391771:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1ffcec00/0x265cfe11109be1b0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109be1a9 expref: 3 pid: 196583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391783:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11254000/0x265cfe11109bed64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bed5d expref: 2 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.391794:0:6506:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e590cc71800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788572496.391813:0:6506:0:(genops.c:885:class_export_put()) final put ffff8e590cc71800/e87131b0-4a60-4def-a26d-6e23dcfe5daa 00010000:00010000:0.0:1788572496.391818:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572496.391820:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572496.391822:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572496.391836:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdfc6 00000020:00010000:0.0:1788572496.391840:0:200704:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a10ff8800: total 3 00000100:00080000:0.0:1788572496.391844:0:200704:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ffe000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572496.391854:0:200704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e5a10ff8800): rc 0 00000020:00080000:0.0:1788572496.391859:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8e5a37203380) has no exports 00000020:00010000:0.0:1788572496.391865:0:10395:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a10ff8800: total 3 00000020:00000080:2.0:1788572496.392124:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59059d0800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788572496.392135:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5901973000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572496.392138:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5901973000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788572496.392143:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572496.392198:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5902a83000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788572496.392201:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5a09ee2800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788572496.392203:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a09ee2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788572496.392206:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788572496.392230:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5902a82000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788572496.392234:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc71800/e87131b0-4a60-4def-a26d-6e23dcfe5daa for MGS 00000020:00000080:2.0:1788572496.392265:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590cc73800 for MGS 00010000:00010000:0.0:1788572496.392321:0:10395:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a10ff8800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788572496.392341:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dce800/0x265cfe11109bed56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb4fc expref: 5 pid: 196587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.392356:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe0a00/0x265cfe11109bdfdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb39e expref: 4 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.392368:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905bb4e00/0x265cfe11109bdfd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb397 expref: 3 pid: 196581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.392379:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5905fe1000/0x265cfe11109bdfe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb3a5 expref: 2 pid: 196582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572496.392390:0:10395:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a10ff8800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788572496.392403:0:10395:0:(genops.c:885:class_export_put()) final put ffff8e5a10ff8800/f79285ed-4685-45a8-8731-5e2522a143f3 00010000:00010000:0.0:1788572496.392454:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572496.392456:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572496.392458:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572496.393397:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a10ff8800/f79285ed-4685-45a8-8731-5e2522a143f3 for MGS 00000100:00100000:2.0:1788572496.393441:0:196581:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e5a0137fc00:196581] 0 exiting: rc = 1 00000100:00100000:2.0:1788572496.393560:0:196587:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8e5a27051000:196587] 3 exiting: rc = 0 00000100:00100000:2.0:1788572496.393622:0:196582:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e5a0137e000:196582] 1 exiting: rc = 0 00000020:00000080:2.0:1788572496.393664:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a10ffe000 for MGS 00000100:00100000:1.0:1788572496.394414:0:196583:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e590339e800:196583] 2 exiting: rc = 0 00000100:00100000:0.0:1788572496.394585:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394593:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394599:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394605:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394609:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394614:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394620:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394625:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394631:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394638:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394643:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394651:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394658:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394667:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394673:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394680:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394685:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394690:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394696:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394701:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394707:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394712:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394718:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394723:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394728:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394734:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394739:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394745:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394750:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394755:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394760:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394765:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394772:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394777:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394782:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394787:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394791:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394797:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394802:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394807:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394813:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394818:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394824:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394829:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394835:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394840:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394845:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394851:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394857:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394863:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394893:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394901:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394906:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394912:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394918:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394923:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394928:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394934:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394941:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394947:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394954:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394959:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394964:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572496.394970:0:200704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788572496.396767:0:200704:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a0457d240 - data ffff8e5a35a4f510/ffff8e5a0ef27c00 00000020:01000000:0.0:1788572496.396915:0:200704:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a244d6f60 - data ffff8e5a08ae3e58/ffff8e5a370eb800 00000020:00000080:0.0:1788572496.397333:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdfbf 00000020:00000080:0.0:1788572496.397342:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e590cc77800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788572496.397572:0:200704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a0f05c800 from MGS, refs=2 00000020:01000004:0.0:1788572496.397576:0:200704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a0f05c800 2 00000020:01000004:0.0:1788572496.397579:0:200704:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5a0f05c800 from MGS 00000020:00000080:0.0:1788572496.397599:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572496.397608:0:200704:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788572496.397611:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e590cc70800/MGS 00000020:00000080:0.0:1788572496.397614:0:200704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc70800/MGS for MGS 00000020:01000000:0.0:1788572496.397621:0:200704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788572496.397700:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788572496.397704:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572496.397712:0:200704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788572496.397719:0:200704:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e59019d8000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572496.397724:0:200704:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8e5a109f8000) has exports, disconnecting them 00000020:00080000:0.0:1788572496.397729:0:200704:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e59019d8000), last request at 1788572370 00000020:00000080:0.0:1788572496.397733:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109be0f3 00000020:00080000:0.0:1788572496.397744:0:200704:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e59019d8000): rc 0 00000020:00000080:0.0:1788572496.397747:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e59019d8000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788572496.398034:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc77800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788572496.398988:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59019d8000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788572496.411573:0:200704:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788572496.411583:0:200704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572496.411589:0:200704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788572496.411596:0:200704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572496.411624:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59019dd000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788572496.411810:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572496.411823:0:200704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788572496.411828:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a36e24800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788572496.411832:0:200704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36e24800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788572496.411841:0:200704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788572496.411934:0:200704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a0f05c800 1 00000020:00000080:2.0:1788572496.411940:0:200704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bdfb1 00000020:00000080:2.0:1788572496.411947:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e590cc73000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788572496.411954:0:200704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788572496.411962:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590cc73000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788572496.411970:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572496.411974:0:200704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788572496.411977:0:200704:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8e5a401499c0) has no exports 00010000:00010000:0.0:1788572496.510970:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572496.562292:0:200704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572496.562306:0:200704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788572496.562312:0:200704:0:(genops.c:885:class_export_put()) final put ffff8e5a0f05f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788572496.562317:0:200704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f05f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788572496.562327:0:200704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788572496.562446:0:200704:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e5a0f05e800 00000020:02000400:2.0:1788572496.565282:0:200704:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788572497.533986:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572498.287809:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572498.287855:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:3.0:1788572498.287881:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569573376 offset 0 length 224: 4 00000100:00100000:3.0:1788572498.287902:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572498.287929:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572498.287969:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569573760 00000100:00100000:3.0:1788572498.287983:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569573760 00000100:00100000:3.0:1788572498.288073:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569573888 00000100:00100000:3.0:1788572498.288078:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569573888 00000100:00100000:3.0:1788572498.288119:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7878 00000100:00100000:3.0:1788572498.288135:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569573760:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572498.288232:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569573760:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 103us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572498.288240:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7878 00000100:00100000:3.0:1788572498.288264:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7879 00000100:00100000:3.0:1788572498.288271:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569573888:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572498.288296:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569573888:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 26us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572498.288302:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7879 00000100:00100000:1.0:1788572498.288639:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569573504 00000100:00100000:1.0:1788572498.288645:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569573504 00000100:00100000:1.0:1788572498.288681:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569573632 00000100:00100000:1.0:1788572498.288685:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569573632 00000100:00100000:1.0:1788572498.288719:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 523 00000100:00100000:1.0:1788572498.288727:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569573632:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572498.288747:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31c81f80 x1875444569573632/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:173/0 lens 224/224 e 0 to 0 dl 1788572523 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572498.288785:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569573632:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 60us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572498.288792:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 523 00000100:00100000:1.0:1788572498.288807:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1290 00000100:00100000:1.0:1788572498.288812:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1875444569573504:12345-192.168.202.57@tcp:400:kworker.0 00000020:00080000:1.0:1788572498.288818:0:188049:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.57@tcp 00000100:00100000:1.0:1788572498.288844:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1875444569573504:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (1051us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572498.288849:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1290 00000100:00080000:1.0:1788572498.288872:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572498.288878:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572498.288881:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572498.301032:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572498.301075:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584456704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572498.301176:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572498.301253:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584456704 00000100:00100000:1.0:1788572498.301264:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584456704 00000100:00100000:1.0:1788572498.301354:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6445 00000100:00100000:1.0:1788572498.301366:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584456704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572498.301413:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572498.301472:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584456704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572498.301497:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6445 00000100:00080000:0.0:1788572498.301621:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572498.301670:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584456704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572498.301841:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572498.301852:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584456832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572498.301888:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572498.302138:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584456832 00000100:00100000:2.0:1788572498.302144:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584456832 00000100:00100000:2.0:1788572498.302198:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6446 00000100:00100000:2.0:1788572498.302206:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584456832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572498.302231:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572498.302273:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584456832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572498.302280:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6446 00000100:00100000:1.0:1788572498.302353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584456832:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572498.302582:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572498.305992:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572498.306129:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569574016 00000100:00100000:2.0:1788572498.306143:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569574016 00000100:00100000:2.0:1788572498.306206:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1291 00000100:00100000:2.0:1788572498.306217:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569574016:12345-192.168.202.57@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1788572498.306252:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572498.306346:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569574016:12345-192.168.202.57@tcp:38:ptlrpcd_01_01.0 Request processed in 128us (370us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572498.306354:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1291 00010000:00010000:3.0:1788572498.557250:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572499.580864:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572500.350454:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572500.350528:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584456960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572500.350662:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572500.351160:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584456960 00000100:00100000:1.0:1788572500.351172:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584456960 00000100:00100000:1.0:1788572500.351244:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1788572500.351255:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a72450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875444584456960:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788572500.351265:0:188054:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572500.351340:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a72450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875444584456960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (678us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572500.351349:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1788572500.353390:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584457216:0@lo:400:kworker.0 00000100:00100000:0.0:1788572500.353529:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572500.353570:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584457728:0@lo:400:kworker.0 00000100:00100000:0.0:1788572500.353601:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572500.354386:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788572500.354400:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584457344:0@lo:400:kworker.0 00000100:00100000:0.0:1788572500.354449:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572500.354516:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584457856:0@lo:400:kworker.0 00000100:00100000:0.0:1788572500.354545:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572500.354593:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584457216 00000100:00100000:0.0:1788572500.354610:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584457216 00000100:00100000:1.0:1788572500.354910:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584457344 00000100:00100000:1.0:1788572500.354916:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584457344 00000100:00100000:1.0:1788572500.354984:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1788572500.354996:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584457344:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572500.355029:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffa7100 x1875444584457344/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:175/0 lens 224/224 e 0 to 0 dl 1788572525 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572500.355099:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584457344:12345-0@lo:400:kworker.0 Request processed in 105us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572500.355107:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1788572500.355166:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584457344:0@lo:400:kworker.0 00000100:00080000:1.0:1788572500.355215:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572500.355720:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584457472:0@lo:400:kworker.0 00000100:00100000:3.0:1788572500.355784:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572500.355816:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584457984:0@lo:400:kworker.0 00000100:00100000:3.0:1788572500.355840:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572500.355869:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572500.355876:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584457088:0@lo:400:kworker.0 00000400:00000100:3.0:1788572500.355911:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584457088 offset 0 length 224: 4 00000100:00100000:3.0:1788572500.355938:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584457600:0@lo:400:kworker.0 00000100:00100000:3.0:1788572500.355961:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572500.355995:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584457472 00000100:00100000:3.0:1788572500.356000:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584457472 00000100:00100000:3.0:1788572500.356031:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584457984 00000100:00100000:3.0:1788572500.356034:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584457984 00000100:00100000:3.0:1788572500.356062:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584457600 00000100:00100000:3.0:1788572500.356065:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584457600 00000100:00100000:3.0:1788572500.356097:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1788572500.356105:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584457600:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572500.356125:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31c82d80 x1875444584457600/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:175/0 lens 224/224 e 0 to 0 dl 1788572525 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572500.356163:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584457600:12345-0@lo:400:kworker.0 Request processed in 59us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572500.356170:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1788572500.356188:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1788572500.356193:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875444584457472:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788572500.356199:0:188833:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788572500.356223:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875444584457472:12345-0@lo:400:kworker.0 Request processed in 29us (439us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572500.356774:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584457728 00000100:00100000:2.0:1788572500.356782:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584457728 00000100:00100000:2.0:1788572500.356824:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584457856 00000100:00100000:2.0:1788572500.356828:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584457856 00000100:00100000:2.0:1788572500.356854:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7880 00000100:00100000:2.0:1788572500.356862:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584457728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572500.356935:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584457728:12345-0@lo:400:kworker.0 Request processed in 74us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572500.356943:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7880 00000100:00100000:2.0:1788572500.356957:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7881 00000100:00100000:2.0:1788572500.356964:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584457856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572500.356997:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584457856:12345-0@lo:400:kworker.0 Request processed in 34us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572500.357007:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7881 00000100:02020000:2.0:1788572500.357071:0:3642:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788572500.357078:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572500.357084:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572500.357088:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572500.357096:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572500.357102:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9243 00000100:00080000:2.0:1788572500.357109:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572500.357144:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590542ed80 x1875444584458112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572500.357990:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:0.0:1788572500.357998:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875444584457984:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788572500.358006:0:188049:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788572500.358074:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875444584457984:12345-0@lo:400:kworker.0 Request processed in 75us (2232us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788572500.358081:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:0.0:1788572500.358098:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1788572500.358102:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875444584457216:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788572500.358107:0:188049:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788572500.358126:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875444584457216:12345-0@lo:400:kworker.0 Request processed in 23us (4599us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788572500.358132:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00080000:0.0:1788572500.358216:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572500.358221:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572500.358224:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572500.358258:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584457600:0@lo:400:kworker.0 00000100:00080000:0.0:1788572500.358272:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788572500.358276:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788572500.358280:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788572500.358285:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572500.358289:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9128 00000100:00080000:0.0:1788572500.358295:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572500.359074:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584457856:0@lo:400:kworker.0 00000100:00080000:1.0:1788572500.359090:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572500.359094:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572500.359098:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572500.359102:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572500.359105:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9128 00000100:00080000:1.0:1788572500.359110:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572500.359135:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590d8ac700 x1875444584458240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572500.359151:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584457216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572500.359166:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584457728:0@lo:400:kworker.0 00000100:00100000:3.0:1788572500.359473:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1788572500.359602:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584458112:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788572500.359672:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572500.359706:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584458240:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788572500.359727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572500.359881:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584458112 00000100:00100000:2.0:1788572500.359889:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584458112 00000100:00100000:2.0:1788572500.359924:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1788572500.359931:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584458112:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788572500.359955:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572500.359994:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584458112:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 62us (321us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572500.360000:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00080000:2.0:1788572500.360029:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572500.360034:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572500.360052:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584458112:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788572500.360071:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584458240 00000100:00100000:2.0:1788572500.360074:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584458240 00000100:00100000:2.0:1788572500.360095:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1788572500.360099:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584458240:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788572500.360108:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572500.360133:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584458240:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 33us (405us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572500.360139:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00080000:2.0:1788572500.360157:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572500.360160:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572500.360163:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584458240:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788572500.360882:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a2462dc00 x1875444584458368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572500.360928:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584457472:0@lo:400:kworker.0 00000100:00080000:0.0:1788572500.360951:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788572500.360954:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788572500.360958:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788572500.360964:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572500.360968:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9199 00000100:00080000:0.0:1788572500.360975:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572500.360994:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a2462e300 x1875444584458496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572500.361004:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584457984:0@lo:400:kworker.0 00000100:00100000:1.0:1788572500.361156:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584458368:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788572500.361214:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572500.361250:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584458496:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788572500.361273:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572500.361325:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584458368 00000100:00100000:1.0:1788572500.361330:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584458368 00000100:00100000:1.0:1788572500.361361:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584458496 00000100:00100000:1.0:1788572500.361363:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584458496 00000100:00100000:1.0:1788572500.361382:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1788572500.361388:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584458368:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788572500.361404:0:198183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572500.361445:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584458368:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 55us (231us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572500.361452:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1788572500.361467:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1788572500.361472:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584458496:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788572500.361504:0:198183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572500.361529:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584458496:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 56us (255us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572500.361536:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00080000:1.0:1788572500.361559:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572500.361563:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572500.361566:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584458368:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788572500.361573:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572500.361576:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572500.361578:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584458496:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1788572500.605381:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572501.628796:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788572501.886280:0:198961:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788572501.886318:0:198961:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf62b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572501.886340:0:198961:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf62b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572501.886402:0:198961:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 2/0,0 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf62b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572501.886410:0:198961:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572501.886450:0:198961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a3164f800/0x265cfe11109bf624 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf62b expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572501.886515:0:198961:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803847 is committed 00000020:00000080:3.0:1788572501.886520:0:198961:0:(genops.c:885:class_export_put()) final put ffff8e5a1d702800/lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1788572501.886732:0:3642:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8e5a31c83800 x1875444584458624/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788572501.887205:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1d702800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788572501.887297:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590b9ac000 for lustre-MDT0001 00000001:00100000:2.0:1788572501.891892:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572501.891907:0:194757:0:(genops.c:885:class_export_put()) final put ffff8e5a0efd2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572501.892023:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efd2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788572501.892100:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0efd7000 for lustre-OST0000 00000001:00100000:1.0:1788572501.894026:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572501.894048:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e59051de800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572501.894130:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59051de800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788572501.894193:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59051df800 for lustre-OST0001 00010000:00010000:2.0:1788572502.654692:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788572503.404069:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569574144 offset 0 length 224: 4 00000100:00100000:3.0:1788572503.404132:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572503.404174:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572503.404207:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572503.404242:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569574400 00000100:00100000:3.0:1788572503.404251:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572503.404257:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569574400 00000100:00100000:3.0:1788572503.404302:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569574272 00000100:00100000:3.0:1788572503.404306:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569574272 00000100:00100000:0.0:1788572503.404424:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569574528 00000100:00100000:0.0:1788572503.404430:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569574528 00000100:00100000:0.0:1788572503.404541:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569574656 00000100:00100000:0.0:1788572503.404545:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569574656 00000100:00100000:0.0:1788572503.404578:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7882 00000100:00100000:0.0:1788572503.404592:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569574528:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572503.404698:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569574528:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 109us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572503.404706:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7882 00000100:00100000:0.0:1788572503.404733:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7883 00000100:00100000:0.0:1788572503.404740:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569574656:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572503.404771:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569574656:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 32us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572503.404778:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7883 00000100:00080000:0.0:1788572503.404802:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572503.404807:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572503.404810:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572503.404883:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 526 00000100:00100000:3.0:1788572503.404893:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569574400:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572503.404912:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31c80380 x1875444569574400/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:164/0 lens 224/224 e 0 to 0 dl 1788572514 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572503.404939:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569574400:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 48us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572503.404945:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 526 00000100:00100000:3.0:1788572503.406403:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1298 00000100:00100000:3.0:1788572503.406417:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569574272:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:3.0:1788572503.406448:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572503.406553:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569574272:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 136us (2300us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572503.406562:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1298 00000100:00100000:1.0:1788572503.420738:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584458752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572503.420854:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572503.421126:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584458880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572503.421168:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572503.421308:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584458752 00000100:00100000:0.0:1788572503.421320:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584458752 00000100:00100000:0.0:1788572503.421413:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584458880 00000100:00100000:0.0:1788572503.421417:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584458880 00000100:00100000:0.0:1788572503.421439:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6447 00000100:00100000:0.0:1788572503.421450:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584458752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572503.421514:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572503.421556:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6448 00000100:00100000:2.0:1788572503.421566:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584458880:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572503.421570:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584458752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572503.421578:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6447 00002000:00000024:2.0:1788572503.421598:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00080000:3.0:1788572503.421704:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572503.421709:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572503.421816:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584458752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572503.421883:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584458880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 319us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572503.421894:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6448 00000100:00100000:0.0:1788572503.422309:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584458880:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572503.680509:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572504.700888:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572505.469403:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584459008:0@lo:400:kworker.0 00000400:00000100:0.0:1788572505.469523:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584459008 offset 0 length 224: 4 00000100:00080000:3.0:1788572505.469637:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572505.469643:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572505.469648:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572505.469656:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9253 00000100:00080000:3.0:1788572505.469663:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572505.469672:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572505.469702:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c81180 x1875444584459136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572505.469789:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584459264:0@lo:400:kworker.0 00000100:00100000:2.0:1788572505.469838:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572505.469960:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584459264 00000100:00100000:2.0:1788572505.469970:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584459264 00000100:00100000:2.0:1788572505.470049:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1788572505.470061:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584459264:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572505.470090:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590542df80 x1875444584459264/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:166/0 lens 224/224 e 0 to 0 dl 1788572516 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572505.470135:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584459264:12345-0@lo:400:kworker.0 Request processed in 76us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572505.470143:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1788572505.470197:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584459264:0@lo:400:kworker.0 00000100:00080000:2.0:1788572505.470230:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572505.470646:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572505.470652:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572505.470655:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572505.470661:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9253 00000100:00080000:3.0:1788572505.470665:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572505.470670:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572505.470695:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb08700 x1875444584459392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572505.470997:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584459136:0@lo:38:kworker.0 00000100:00100000:1.0:1788572505.471122:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572505.471164:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584459392:0@lo:38:kworker.0 00000100:00100000:1.0:1788572505.471191:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572505.471351:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584459136 00000100:00100000:2.0:1788572505.471358:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584459136 00000100:00100000:2.0:1788572505.471397:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584459392 00000100:00100000:2.0:1788572505.471400:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584459392 00000100:00100000:1.0:1788572505.475720:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1788572505.475740:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584459136:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788572505.476123:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:2.0:1788572505.476131:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584459392:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572505.476166:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572505.476296:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584459392:12345-0@lo:38:kworker.0 Request processed in 163us (5102us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572505.476304:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00010000:00020000:1.0:1788572505.476693:0:198183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572505.477514:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584459136:12345-0@lo:38:kworker.0 Request processed in 1005us (5620us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572505.477531:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00080000:1.0:1788572505.477613:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572505.477619:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572505.477624:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584459136:0@lo:38:kworker.0 00000100:00080000:1.0:1788572505.477638:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572505.477642:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572505.477645:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584459392:0@lo:38:kworker.0 00000100:00100000:0.0:1788572505.478938:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584459520:0@lo:400:kworker.0 00000100:00100000:0.0:1788572505.479054:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572505.479177:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584459520 00000100:00100000:2.0:1788572505.479187:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584459520 00000100:00100000:2.0:1788572505.479277:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1788572505.479288:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584459520:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572505.479322:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a2462d180 x1875444584459520/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:166/0 lens 224/224 e 0 to 0 dl 1788572516 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572505.479402:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572505.480160:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572505.480168:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572505.480173:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572505.480180:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9253 00000100:00080000:3.0:1788572505.480187:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572505.480193:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572505.480236:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb0b800 x1875444584459648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572505.480320:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584459776:0@lo:400:kworker.0 00000100:00100000:1.0:1788572505.480380:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572505.481111:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584459648:0@lo:38:kworker.0 00000100:00100000:1.0:1788572505.481162:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572505.481210:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584459648 00000100:00100000:1.0:1788572505.481217:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584459648 00000100:00100000:1.0:1788572505.481255:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1788572505.481263:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584459648:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572505.481289:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572505.481328:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584459648:12345-0@lo:38:kworker.0 Request processed in 65us (165us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572505.481335:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00080000:1.0:1788572505.481381:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572505.481385:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572505.481389:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584459648:0@lo:38:kworker.0 00000100:00100000:1.0:1788572505.481602:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584459776 00000100:00100000:1.0:1788572505.481607:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584459776 00000100:00100000:1.0:1788572505.481653:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7884 00000100:00100000:1.0:1788572505.481660:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584459776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572505.481709:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584459776:12345-0@lo:400:kworker.0 Request processed in 50us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572505.481716:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7884 00000100:00080000:1.0:1788572505.481733:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572505.481925:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584459776:0@lo:400:kworker.0 00000100:00100000:2.0:1788572505.483068:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584459520:12345-0@lo:400:kworker.0 Request processed in 3773us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572505.483083:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00080000:3.0:1788572505.485003:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572505.485011:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572505.485016:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572505.485037:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9253 00000100:00080000:3.0:1788572505.485045:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572505.485054:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572505.485090:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb0b800 x1875444584460032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572505.485101:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572505.485123:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584459904:0@lo:400:kworker.0 00000100:00100000:2.0:1788572505.485216:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572505.485287:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584460032:0@lo:38:kworker.0 00000100:00100000:1.0:1788572505.485331:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572505.485422:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584459904 00000100:00100000:3.0:1788572505.485431:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584459904 00000100:00100000:3.0:1788572505.485528:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7885 00000100:00100000:3.0:1788572505.485542:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584459904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572505.485605:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584459904:12345-0@lo:400:kworker.0 Request processed in 68us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572505.485614:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7885 00000100:00080000:1.0:1788572505.485685:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572505.486292:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584459520:0@lo:400:kworker.0 00000100:00100000:2.0:1788572505.486537:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584460032 00000100:00100000:2.0:1788572505.486546:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584460032 00000100:00100000:2.0:1788572505.486595:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1788572505.486602:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584460032:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572505.486631:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572505.486711:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584460032:12345-0@lo:38:kworker.0 Request processed in 107us (1379us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572505.486718:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00080000:1.0:1788572505.486941:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572505.486949:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572505.486952:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584460032:0@lo:38:kworker.0 00000100:00100000:2.0:1788572505.487041:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584459904:0@lo:400:kworker.0 00010000:00010000:0.0:1788572505.727572:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572506.748824:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572507.772816:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572508.525959:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572508.526080:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569574912 00000100:00100000:2.0:1788572508.526096:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569574912 00000100:00100000:2.0:1788572508.526179:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1302 00000100:00100000:2.0:1788572508.526191:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569574912:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572508.526225:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572508.526338:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569574912:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 146us (392us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572508.526348:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1302 00000100:00100000:1.0:1788572508.541114:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584460160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572508.541269:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572508.541525:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584460160 00000100:00100000:0.0:1788572508.541538:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584460160 00000100:00100000:0.0:1788572508.541619:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6449 00000100:00100000:0.0:1788572508.541631:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584460160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572508.541685:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572508.541754:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584460160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572508.541763:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6449 00000100:00100000:3.0:1788572508.541915:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584460160:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788572508.542254:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572508.549534:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572508.549575:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584460288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572508.549699:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572508.549835:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584460288 00000100:00100000:2.0:1788572508.549849:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584460288 00000100:00100000:2.0:1788572508.549958:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6450 00000100:00100000:2.0:1788572508.549972:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584460288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572508.550028:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572508.550102:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584460288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572508.550109:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6450 00000100:00100000:2.0:1788572508.550187:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584460288:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572508.551337:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572508.558716:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572508.558775:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572508.558808:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000400:00000100:2.0:1788572508.558845:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569574784 offset 0 length 224: 4 00000100:00100000:0.0:1788572508.559104:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569575168 00000100:00100000:0.0:1788572508.559120:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569575168 00000100:00100000:0.0:1788572508.559234:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569575296 00000100:00100000:0.0:1788572508.559238:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569575296 00000100:00100000:0.0:1788572508.559269:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22721 00000100:00100000:0.0:1788572508.559284:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2396:x1875444569575168:12345-192.168.202.57@tcp:9:kworker.0 00000020:00000080:0.0:1788572508.559350:0:177557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109beec9 00000100:00080000:0.0:1788572508.559364:0:177557:0:(import.c:65:import_set_state_nolock()) ffff8e5a109be000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572508.559437:0:177557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705689 00000100:00100000:0.0:1788572508.559708:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+2:2396:x1875444569575168:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 426us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572508.559716:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22721 00000100:00100000:0.0:1788572508.559739:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22722 00000100:00100000:0.0:1788572508.559746:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2396:x1875444569575296:12345-192.168.202.57@tcp:9:kworker.0 00000020:00000080:0.0:1788572508.559760:0:177557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109beed0 00000100:00080000:0.0:1788572508.559766:0:177557:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f316800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572508.559793:0:177557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975698 00000100:00080000:2.0:1788572508.560074:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572508.560080:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572508.560118:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572508.560132:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572508.560990:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569575040 00000100:00100000:1.0:1788572508.561016:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569575040 00000100:00100000:1.0:1788572508.561113:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 529 00000100:00100000:1.0:1788572508.561125:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569575040:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572508.561168:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590542ca80 x1875444569575040/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:169/0 lens 224/224 e 0 to 0 dl 1788572519 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572508.561292:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+2:2396:x1875444569575296:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 1542us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572508.561307:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22722 00000100:00080000:2.0:1788572508.561405:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572508.567124:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569575040:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 5976us (8398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572508.567155:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 529 00010000:00010000:0.0:1788572508.799876:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572509.821845:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572510.589705:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572510.589717:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572510.589723:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572510.589734:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9258 00000100:00080000:3.0:1788572510.589742:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572510.589751:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572510.589784:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb0aa00 x1875444584460544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572510.589820:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572510.589825:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572510.589827:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572510.589831:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9258 00000100:00080000:3.0:1788572510.589834:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572510.589839:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572510.589851:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb08380 x1875444584460800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572510.589873:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572510.589876:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572510.589878:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572510.589882:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9258 00000100:00080000:3.0:1788572510.589885:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572510.589889:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572510.589902:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5905c83800 x1875444584461056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572510.589926:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572510.589929:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788572510.589931:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572510.589935:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9258 00000100:00080000:3.0:1788572510.589938:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572510.589943:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572510.589955:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a37103b80 x1875444584461440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572510.590013:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584461184:0@lo:400:kworker.0 00000100:00100000:3.0:1788572510.590123:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572510.590340:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572510.590349:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584460416:0@lo:400:kworker.0 00000400:00000100:3.0:1788572510.590377:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584460416 offset 0 length 224: 4 00000100:00100000:3.0:1788572510.590402:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584461312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572510.590426:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572510.590459:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584460544:0@lo:38:kworker.0 00000100:00100000:3.0:1788572510.590518:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572510.590539:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584460800:0@lo:38:kworker.0 00000100:00100000:3.0:1788572510.590561:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572510.590580:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584461056:0@lo:38:kworker.0 00000100:00100000:3.0:1788572510.590604:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572510.590625:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a37103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584461440:0@lo:38:kworker.0 00000100:00100000:3.0:1788572510.590646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572510.590681:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584460672:0@lo:400:kworker.0 00000100:00100000:3.0:1788572510.590721:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572510.590744:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572510.590750:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584460928:0@lo:400:kworker.0 00000100:00100000:3.0:1788572510.590773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572510.590805:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584461184 00000100:00100000:3.0:1788572510.590815:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584461184 00000100:00100000:3.0:1788572510.590881:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584461312 00000100:00100000:3.0:1788572510.590885:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584461312 00000100:00100000:3.0:1788572510.590911:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7886 00000100:00100000:3.0:1788572510.590925:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584461184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572510.590990:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584461184:12345-0@lo:400:kworker.0 Request processed in 70us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572510.591009:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7886 00000100:00100000:3.0:1788572510.591032:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7887 00000100:00100000:3.0:1788572510.591039:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584461312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572510.591070:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584461312:12345-0@lo:400:kworker.0 Request processed in 32us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572510.591075:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7887 00000100:00100000:3.0:1788572510.591100:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584460544 00000100:00100000:3.0:1788572510.591105:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584460544 00000100:00100000:3.0:1788572510.591125:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584460800 00000100:00100000:3.0:1788572510.591127:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584460800 00000100:00100000:3.0:1788572510.591134:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584461440 00000100:00100000:3.0:1788572510.591136:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584461440 00000100:00100000:3.0:1788572510.591143:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584460672 00000100:00100000:3.0:1788572510.591145:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584460672 00000100:00100000:3.0:1788572510.591164:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584460928 00000100:00100000:3.0:1788572510.591166:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584460928 00000100:00100000:3.0:1788572510.591181:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1788572510.592684:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584460672:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572510.592904:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a37100380 x1875444584460672/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1788572521 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572510.593419:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584460672:12345-0@lo:400:kworker.0 Request processed in 2228us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572510.593433:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1788572510.593476:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1788572510.593522:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584460928:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572510.593539:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a37100e00 x1875444584460928/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1788572521 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572510.593589:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584460928:12345-0@lo:400:kworker.0 Request processed in 73us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572510.593597:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1788572510.593612:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1788572510.593617:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584460544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572510.593642:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572510.593684:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584460544:12345-0@lo:38:kworker.0 Request processed in 65us (3165us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572510.593691:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1788572510.593716:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1788572510.593721:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584460800:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572510.593731:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572510.593759:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584460800:12345-0@lo:38:kworker.0 Request processed in 36us (3197us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572510.593766:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1788572510.593778:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1788572510.593783:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584461440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572510.593793:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572510.593819:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584461440:12345-0@lo:38:kworker.0 Request processed in 35us (3172us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572510.593825:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1788572510.593857:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584461056 00000100:00100000:3.0:1788572510.593866:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584461056 00000100:00100000:3.0:1788572510.593904:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1788572510.593909:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584461056:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572510.593919:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572510.593948:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584461056:12345-0@lo:38:kworker.0 Request processed in 38us (3344us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572510.593954:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00080000:3.0:1788572510.593987:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572510.593993:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572510.593996:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572510.594075:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584461312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572510.594093:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584461184:0@lo:400:kworker.0 00000100:00080000:2.0:1788572510.595525:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572510.595539:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572510.595545:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584460544:0@lo:38:kworker.0 00000100:00080000:2.0:1788572510.595572:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572510.595577:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572510.595582:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584460800:0@lo:38:kworker.0 00000100:00080000:2.0:1788572510.595597:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572510.595601:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572510.595605:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584461056:0@lo:38:kworker.0 00000100:00080000:2.0:1788572510.595619:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572510.595623:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572510.595626:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a37103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584461440:0@lo:38:kworker.0 00000100:00100000:0.0:1788572510.602782:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584460672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572510.602834:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584460928:0@lo:400:kworker.0 00010000:00010000:1.0:1788572510.846133:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572511.873024:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572512.900024:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788572513.608378:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.57@tcp portal 26 match 1875444569575424 offset 0 length 520: 4 00000100:00100000:0.0:1788572513.608426:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572513.608470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572513.608620:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569575680 00000100:00100000:1.0:1788572513.608631:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569575680 00000100:00100000:1.0:1788572513.608701:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569575552 00000100:00100000:1.0:1788572513.608705:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569575552 00000100:00100000:1.0:1788572513.608723:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 532 00000100:00100000:1.0:1788572513.608733:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569575680:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:1.0:1788572513.608777:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a2462ce00 x1875444569575680/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:174/0 lens 224/224 e 0 to 0 dl 1788572524 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572513.608832:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569575680:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 101us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572513.608840:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 532 00000100:00100000:1.0:1788572513.608860:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1306 00000100:00100000:1.0:1788572513.608864:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569575552:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:1.0:1788572513.608885:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572513.608912:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569575552:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 46us (442us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572513.608919:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1306 00000100:00080000:2.0:1788572513.609169:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572513.661789:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584461568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572513.661866:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572513.662021:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584461568 00000100:00100000:2.0:1788572513.662029:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584461568 00000100:00100000:2.0:1788572513.662100:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6451 00000100:00100000:2.0:1788572513.662111:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584461568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572513.662141:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572513.662204:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584461568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572513.662222:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6451 00000100:00100000:2.0:1788572513.662276:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584461568:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572513.662831:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572513.684198:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572513.684231:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584461696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572513.684302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572513.684346:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584461696 00000100:00100000:0.0:1788572513.684353:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584461696 00000100:00100000:0.0:1788572513.684418:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6452 00000100:00100000:0.0:1788572513.684429:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584461696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572513.684458:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572513.684522:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584461696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572513.684529:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6452 00000100:00100000:0.0:1788572513.688641:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a2462e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584461696:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788572513.688680:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788572513.921458:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788572514.181553:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:2.0:1788572514.181565:0:194757:0:(genops.c:885:class_export_put()) final put ffff8e5a109bf800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:3.0:1788572514.188451:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a109bf800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-OST0000 00000020:00000080:3.0:1788572514.188522:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a109be000 for lustre-OST0000 00000001:00100000:2.0:1788572514.200315:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:2.0:1788572514.200327:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5a0f315800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:3.0:1788572514.200644:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f315800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-OST0001 00000020:00000080:3.0:1788572514.200703:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f316800 for lustre-OST0001 00010000:00010000:2.0:1788572514.946703:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572515.712440:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572515.712448:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572515.712452:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572515.712461:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9263 00000100:00080000:2.0:1788572515.712468:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788572515.712475:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572515.712512:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590542dc00 x1875444584461952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572515.712539:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572515.712542:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572515.712544:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572515.712547:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9263 00000100:00080000:2.0:1788572515.712550:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788572515.712554:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572515.712563:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590542f480 x1875444584462208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572515.712585:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572515.712589:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572515.712590:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572515.712594:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9263 00000100:00080000:2.0:1788572515.712597:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788572515.712601:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572515.712613:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590cb08380 x1875444584462464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572515.712632:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572515.712636:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572515.712637:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572515.712640:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9263 00000100:00080000:2.0:1788572515.712643:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788572515.712646:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572515.712654:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36b91880 x1875444584462848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572515.712752:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584461824:0@lo:400:kworker.0 00000400:00000100:1.0:1788572515.712805:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584461824 offset 0 length 224: 4 00000100:00100000:2.0:1788572515.729764:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584462080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572515.729839:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572515.729935:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584462080 00000100:00100000:3.0:1788572515.729943:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584462080 00000100:00100000:3.0:1788572515.730014:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1788572515.730025:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584462080:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572515.730049:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b91c00 x1875444584462080/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:176/0 lens 224/224 e 0 to 0 dl 1788572526 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572515.730090:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584462080:12345-0@lo:400:kworker.0 Request processed in 69us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572515.730097:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00080000:3.0:1788572515.730120:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572515.730785:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584462720:0@lo:400:kworker.0 00000100:00100000:1.0:1788572515.730826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572515.734179:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584462720 00000100:00100000:3.0:1788572515.734194:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584462720 00000100:00100000:3.0:1788572515.734269:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7888 00000100:00100000:3.0:1788572515.734281:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584462720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572515.734365:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584462720:12345-0@lo:400:kworker.0 Request processed in 87us (3538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572515.734372:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7888 00000100:00080000:3.0:1788572515.734401:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572515.734440:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584462720:0@lo:400:kworker.0 00000100:00100000:0.0:1788572515.734634:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584462592:0@lo:400:kworker.0 00000100:00100000:0.0:1788572515.734671:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572515.734696:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572515.734702:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584462336:0@lo:400:kworker.0 00000100:00100000:0.0:1788572515.734729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572515.734752:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584462336 00000100:00100000:0.0:1788572515.734756:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584462336 00000100:00100000:0.0:1788572515.734789:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1788572515.734796:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584462336:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572515.734810:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cb8380 x1875444584462336/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:176/0 lens 224/224 e 0 to 0 dl 1788572526 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572515.734838:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584462336:12345-0@lo:400:kworker.0 Request processed in 43us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572515.734844:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1788572515.734874:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584462336:0@lo:400:kworker.0 00000100:00100000:3.0:1788572515.735144:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584462592 00000100:00100000:3.0:1788572515.735148:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584462592 00000100:00100000:3.0:1788572515.735175:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7889 00000100:00100000:3.0:1788572515.735182:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584462592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572515.735219:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584462592:12345-0@lo:400:kworker.0 Request processed in 37us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572515.735225:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7889 00000100:00080000:3.0:1788572515.735239:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572515.735242:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572515.739210:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584461952:0@lo:38:kworker.0 00000100:00100000:3.0:1788572515.739292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572515.739331:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584462208:0@lo:38:kworker.0 00000100:00100000:3.0:1788572515.739354:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572515.739373:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584462464:0@lo:38:kworker.0 00000100:00100000:3.0:1788572515.739397:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572515.739417:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584462848:0@lo:38:kworker.0 00000100:00100000:3.0:1788572515.739439:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572515.739493:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584461952 00000100:00100000:3.0:1788572515.739502:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584461952 00000100:00100000:3.0:1788572515.739534:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584462208 00000100:00100000:3.0:1788572515.739537:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584462208 00000100:00100000:3.0:1788572515.739550:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584462848 00000100:00100000:3.0:1788572515.739552:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584462848 00000100:00100000:3.0:1788572515.739569:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1788572515.739576:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584461952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572515.739596:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572515.739637:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584461952:12345-0@lo:38:kworker.0 Request processed in 60us (345us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572515.739644:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1788572515.739660:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1788572515.739663:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584462208:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572515.739673:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572515.739693:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584462208:12345-0@lo:38:kworker.0 Request processed in 28us (339us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572515.739699:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1788572515.739709:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1788572515.739713:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584462848:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572515.739722:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572515.739742:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584462848:12345-0@lo:38:kworker.0 Request processed in 27us (301us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572515.739747:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00080000:3.0:1788572515.739879:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572515.739884:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572515.739887:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584461952:0@lo:38:kworker.0 00000100:00080000:3.0:1788572515.739896:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572515.739899:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572515.739902:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584462208:0@lo:38:kworker.0 00000100:00080000:3.0:1788572515.739910:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572515.739913:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572515.739916:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584462848:0@lo:38:kworker.0 00000100:00100000:2.0:1788572515.740019:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584462080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572515.740047:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584462464 00000100:00100000:2.0:1788572515.740050:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584462464 00000100:00100000:2.0:1788572515.740072:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1788572515.740077:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584462464:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572515.740088:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572515.740119:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584462464:12345-0@lo:38:kworker.0 Request processed in 41us (721us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572515.740126:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00080000:2.0:1788572515.740152:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572515.740156:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572515.740159:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584462464:0@lo:38:kworker.0 00000100:00100000:0.0:1788572515.742546:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584462592:0@lo:400:kworker.0 00010000:00010000:1.0:1788572515.964661:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788572516.738196:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572500/real 1788572500] req@ffff8e5a36a4ea00 x1875444584457088/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572516 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572516.738233:0:3641:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8e5a36a4ea00 x1875444584457088/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572516 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572516.738244:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788572516.738247:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788572516.738250:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.157@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788572516.738252:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788572516.738257:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a36a4ea00 x1875444584457088/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572516 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572516.738266:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5a31c82680 x1875444584459008/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572521 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572516.738275:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e590cb0b480 x1875444584460416/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572526 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572516.738300:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e590542ea00 x1875444584461824/t0(0) o400->MGC192.168.202.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572531 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788572516.738309:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788572516.738311:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788572516.738312:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788572516.738314:0:3641:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788572516.738345:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584459008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572516.738351:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584457088:0@lo:400:kworker.0 00000100:00080000:1.0:1788572516.738381:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572516.738385:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788572516.738388:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572516.738393:0:105698:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 9122 00000100:00080000:1.0:1788572516.738401:0:105698:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572516.738431:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c82680 x1875444584462976/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572516.738447:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572516.738450:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572516.738452:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572516.738455:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9268 00000100:00080000:1.0:1788572516.738470:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572516.738474:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572516.738519:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36a4ea00 x1875444584463104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572516.738541:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572516.738544:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572516.738547:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572516.738550:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9268 00000100:00080000:1.0:1788572516.738552:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572516.738556:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572516.738565:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36a4ca80 x1875444584463360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572516.738585:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572516.738588:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572516.738589:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572516.738593:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9268 00000100:00080000:1.0:1788572516.738595:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572516.738597:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572516.738609:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729f480 x1875444584463616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572516.738629:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572516.738632:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572516.738633:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572516.738636:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9268 00000100:00080000:1.0:1788572516.738638:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572516.738642:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572516.738651:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729d880 x1875444584464000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572516.738678:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584463744:0@lo:400:kworker.0 00000100:00100000:1.0:1788572516.738742:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572516.738777:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572516.738782:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584463488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572516.738808:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572516.738838:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584463744 00000100:00100000:1.0:1788572516.738845:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584463744 00000100:00100000:1.0:1788572516.738891:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7890 00000100:00100000:1.0:1788572516.738900:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584463744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572516.738950:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584463744:12345-0@lo:400:kworker.0 Request processed in 50us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572516.738956:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7890 00000100:00100000:1.0:1788572516.738991:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584463488 00000100:00100000:1.0:1788572516.738995:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584463488 00000100:00100000:1.0:1788572516.739028:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1788572516.739034:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584463488:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572516.739047:0:188049:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729ed80 x1875444584463488/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:177/0 lens 224/224 e 0 to 0 dl 1788572527 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572516.739074:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584463488:12345-0@lo:400:kworker.0 Request processed in 41us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572516.739079:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1788572516.739114:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584463488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572516.739123:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584463744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572516.739530:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584463872:0@lo:400:kworker.0 00000100:00100000:2.0:1788572516.739565:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572516.739595:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584461824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572516.739604:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584460416:0@lo:400:kworker.0 00000100:00100000:2.0:1788572516.739625:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572516.739631:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584463232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572516.739653:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572516.739680:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584462976:0@lo:250:kworker.0 00000400:00000100:2.0:1788572516.739697:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875444584462976 offset 0 length 520: 4 00000100:00100000:2.0:1788572516.739716:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584463104:0@lo:38:kworker.0 00000100:00100000:2.0:1788572516.739733:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572516.739750:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584463360:0@lo:38:kworker.0 00000100:00100000:2.0:1788572516.739770:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572516.739787:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584463616:0@lo:38:kworker.0 00000100:00100000:2.0:1788572516.739808:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572516.739837:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584464000:0@lo:38:kworker.0 00000100:00100000:2.0:1788572516.739858:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572516.739889:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584463232 00000100:00100000:2.0:1788572516.739894:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584463232 00000100:00100000:2.0:1788572516.739922:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584463104 00000100:00100000:2.0:1788572516.739924:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584463104 00000100:00100000:2.0:1788572516.739934:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584463360 00000100:00100000:2.0:1788572516.739936:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584463360 00000100:00100000:2.0:1788572516.739943:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584464000 00000100:00100000:2.0:1788572516.739945:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584464000 00000100:00100000:2.0:1788572516.739952:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1788572516.739959:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584463232:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572516.739985:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36b90000 x1875444584463232/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:177/0 lens 224/224 e 0 to 0 dl 1788572527 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572516.740020:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584463232:12345-0@lo:400:kworker.0 Request processed in 61us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572516.740026:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1788572516.740039:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1788572516.740043:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584463104:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572516.740060:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572516.740090:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584463104:12345-0@lo:38:kworker.0 Request processed in 45us (356us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572516.740096:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1788572516.740107:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1788572516.740110:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584463360:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572516.740118:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572516.740139:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584463360:12345-0@lo:38:kworker.0 Request processed in 27us (368us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572516.740145:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1788572516.740155:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1788572516.740158:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584464000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572516.740166:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572516.740188:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584464000:12345-0@lo:38:kworker.0 Request processed in 28us (329us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572516.740193:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1788572516.740215:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584463616 00000100:00100000:2.0:1788572516.740218:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584463616 00000100:00100000:2.0:1788572516.740239:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1788572516.740244:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584463616:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572516.740253:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572516.740277:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584463616:12345-0@lo:38:kworker.0 Request processed in 31us (467us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572516.740282:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1788572516.740319:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584463232:0@lo:400:kworker.0 00000100:00080000:2.0:1788572516.740342:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572516.740347:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572516.740350:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584463104:0@lo:38:kworker.0 00000100:00080000:2.0:1788572516.740357:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572516.740360:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572516.740362:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584463360:0@lo:38:kworker.0 00000100:00080000:2.0:1788572516.740368:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572516.740371:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572516.740373:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584463616:0@lo:38:kworker.0 00000100:00080000:2.0:1788572516.740379:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572516.740381:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572516.740383:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584464000:0@lo:38:kworker.0 00000100:00100000:1.0:1788572516.744058:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584463872 00000100:00100000:1.0:1788572516.744071:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584463872 00000100:00100000:1.0:1788572516.744130:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7891 00000100:00100000:1.0:1788572516.744140:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584463872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572516.744233:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584463872:12345-0@lo:400:kworker.0 Request processed in 95us (4666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572516.744241:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7891 00000100:00100000:1.0:1788572516.751906:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584463872:0@lo:400:kworker.0 00010000:00010000:2.0:1788572516.993996:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572518.012655:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572518.767668:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572518.767702:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572518.767739:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569575936 00000100:00100000:3.0:1788572518.767748:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569575936 00000100:00100000:3.0:1788572518.767804:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569575808 00000100:00100000:3.0:1788572518.767807:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569575808 00000100:00100000:3.0:1788572518.767827:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 537 00000100:00100000:3.0:1788572518.767839:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569575936:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:3.0:1788572518.767867:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a37102a00 x1875444569575936/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:179/0 lens 224/224 e 0 to 0 dl 1788572529 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572518.767928:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569575936:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572518.767935:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 537 00000100:00100000:3.0:1788572518.767956:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1313 00000100:00100000:3.0:1788572518.767961:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569575808:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:3.0:1788572518.769161:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572518.769230:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569575808:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 1265us (1525us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572518.769239:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1313 00000100:00080000:3.0:1788572518.769279:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572518.781936:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584464128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572518.782235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572518.783096:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584464128 00000100:00100000:1.0:1788572518.783105:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584464128 00000100:00100000:1.0:1788572518.783167:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6453 00000100:00100000:1.0:1788572518.783178:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584464128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572518.783212:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00000100:00080000:3.0:1788572518.783640:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572518.784423:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584464128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1244us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572518.784432:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6453 00000100:00100000:0.0:1788572518.786823:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584464128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572518.787643:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584464256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572518.787731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572518.787797:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584464256 00000100:00100000:2.0:1788572518.787806:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584464256 00000100:00100000:2.0:1788572518.787871:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6454 00000100:00100000:2.0:1788572518.787883:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584464256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572518.787914:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572518.787958:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584464256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572518.787977:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6454 00000100:00100000:2.0:1788572518.788029:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584464256:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572518.789131:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572519.046896:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572520.064846:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788572520.473368:0:201324:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788572520.473377:0:201324:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788572520.473379:0:201324:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788572520.473519:0:201324:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e5a41346800 00000020:01000004:0.0:1788572520.473536:0:201324:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788572520.473551:0:201324:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788572520.473566:0:201324:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e5a413fcd40) 00000020:00000080:0.0:1788572520.473585:0:201324:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788572520.685107:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788572520.690970:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788572520.724705:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.732127:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.733678:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.734852:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.738798:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.739227:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.739706:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.740414:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.740932:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.741162:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.741366:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.741709:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.742267:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.743596:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.746325:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.746869:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.747191:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.747446:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.747891:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.748105:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.748315:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.750202:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.752911:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.754254:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.754751:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.754981:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788572520.755189:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788572520.755450:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788572520.763970:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788572520.764261:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788572520.764785:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788572520.765395:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788572520.766198:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788572520.766448:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788572520.767359:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788572520.767934:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788572520.768154:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788572520.768734:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788572520.768931:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788572520.769731:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788572520.771014:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788572520.771530:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788572520.772712:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788572520.773836:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788572520.778929:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788572520.783761:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788572520.784268:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788572520.784507:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788572520.788627:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788572520.790459:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788572520.791545:0:201324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788572520.792086:0:201324:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788572520.792303:0:201324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788572520.792311:0:201324:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788572520.792323:0:201324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bf6f6 00000020:01000004:1.0:1788572520.792330:0:201324:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788572520.792342:0:201324:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788572520.792347:0:201324:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a41346800 from MGS 00000020:01000004:1.0:1788572520.792351:0:201324:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788572520.792360:0:201324:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e59028a0000) 00000020:00000080:1.0:1788572520.792371:0:201324:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:1.0:1788572520.792431:0:201324:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a41346800 from MGS, refs=2 00080000:01000000:1.0:1788572520.792436:0:201324:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788572520.792441:0:201324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bf704 00010000:00010000:1.0:1788572520.792613:0:201324:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788572520.802015:0:201324:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788572520.806683:0:201329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788572520.806750:0:201324:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788572520.806801:0:201324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788572520.807435:0:201324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788572520.807719:0:201324:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572520.807875:0:201324:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788572520.807881:0:201324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788572520.810287:0:201324:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788572520.810300:0:201324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788572520.811675:0:201324:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788572520.811685:0:201324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788572520.812346:0:201324:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788572520.812370:0:201324:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788572520.812372:0:201324:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.157@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788572520.812376:0:201324:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.157@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788572520.812382:0:201324:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 262, was 0): CONNECTING 00000100:00100000:1.0:1788572520.812387:0:201324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:1.0:1788572521.084943:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572521.853302:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572521.853309:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788572521.853312:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572521.853316:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572521.853320:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572521.853327:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9269 00000100:00080000:1.0:1788572521.853345:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572521.853355:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572521.853395:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729ca80 x1875444584464384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572521.853442:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572521.853446:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572521.853448:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572521.853451:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9269 00000100:00080000:1.0:1788572521.853454:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572521.853458:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572521.853470:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729d880 x1875444584464640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572521.853518:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572521.853521:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572521.853523:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572521.853527:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9269 00000100:00080000:1.0:1788572521.853530:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572521.853534:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572521.853549:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36a4ca80 x1875444584464896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572521.853604:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572521.853608:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572521.853610:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572521.853613:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9269 00000100:00080000:1.0:1788572521.853616:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572521.853621:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572521.853633:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36a4c700 x1875444584465280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572521.853675:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584465152:0@lo:400:kworker.0 00000100:00100000:1.0:1788572521.853774:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572521.853814:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584464384:0@lo:38:kworker.0 00000100:00100000:1.0:1788572521.853867:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572521.853882:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584464512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572521.853914:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572521.854094:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584464768:0@lo:400:kworker.0 00000100:00100000:1.0:1788572521.854137:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584465152 00000100:00100000:1.0:1788572521.854147:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584465152 00000100:00100000:1.0:1788572521.854215:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7892 00000100:00100000:1.0:1788572521.854226:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584465152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572521.854448:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584464384 00000100:00100000:2.0:1788572521.854453:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584464384 00000100:00100000:2.0:1788572521.854513:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:2.0:1788572521.854520:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a37103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584464384:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572521.854543:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572521.858297:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572521.858410:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572521.858432:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584465024:0@lo:400:kworker.0 00000100:00100000:0.0:1788572521.858474:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572521.858558:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584465024 00000100:00100000:0.0:1788572521.858566:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584465024 00000100:00100000:0.0:1788572521.858762:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7893 00000100:00100000:0.0:1788572521.858774:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584465024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572521.858832:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584465024:12345-0@lo:400:kworker.0 Request processed in 61us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572521.858838:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7893 00000100:00100000:0.0:1788572521.858904:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584465024:0@lo:400:kworker.0 00000100:00100000:0.0:1788572521.859976:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584464768 00000100:00100000:0.0:1788572521.859987:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584464768 00000100:00100000:0.0:1788572521.860034:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1788572521.860045:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584464768:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572521.860067:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cbaa00 x1875444584464768/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:182/0 lens 224/224 e 0 to 0 dl 1788572532 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572521.860127:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584464768:12345-0@lo:400:kworker.0 Request processed in 85us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572521.860133:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00080000:0.0:1788572521.860161:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572521.860166:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572521.860170:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572521.860184:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572521.860237:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584464768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572521.860269:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584464512 00000100:00100000:0.0:1788572521.860273:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584464512 00000100:00100000:0.0:1788572521.860303:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1788572521.860309:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584464512:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572521.860322:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cba680 x1875444584464512/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:182/0 lens 224/224 e 0 to 0 dl 1788572532 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572521.862042:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584464512:12345-0@lo:400:kworker.0 Request processed in 1725us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572521.862055:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00080000:0.0:1788572521.862103:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572521.862141:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584464512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572521.862809:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584465152:12345-0@lo:400:kworker.0 Request processed in 8581us (9038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572521.862820:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7892 00000100:00100000:0.0:1788572521.862908:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584465152:0@lo:400:kworker.0 00000100:00100000:2.0:1788572521.863471:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a37103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584464384:12345-0@lo:38:kworker.0 Request processed in 8949us (9558us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572521.863507:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00080000:3.0:1788572521.863968:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572521.863982:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572521.863987:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584464384:0@lo:38:kworker.0 00000100:00100000:3.0:1788572521.864002:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584464640:0@lo:38:kworker.0 00000100:00100000:3.0:1788572521.864071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572521.864896:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584464896:0@lo:38:kworker.0 00000100:00100000:3.0:1788572521.864944:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572521.864991:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584465280:0@lo:38:kworker.0 00000100:00100000:3.0:1788572521.865020:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572521.865223:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584464640 00000100:00100000:0.0:1788572521.865233:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584464640 00000100:00100000:0.0:1788572521.865284:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584465280 00000100:00100000:0.0:1788572521.865288:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584465280 00000100:00100000:0.0:1788572521.865313:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:0.0:1788572521.865323:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584464640:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572521.865353:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572521.865411:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584464640:12345-0@lo:38:kworker.0 Request processed in 87us (1339us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572521.865418:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:0.0:1788572521.865439:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1788572521.865444:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584465280:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572521.865454:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572521.865503:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584465280:12345-0@lo:38:kworker.0 Request processed in 33us (457us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572521.865510:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00080000:3.0:1788572521.865862:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572521.865869:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572521.865873:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584464640:0@lo:38:kworker.0 00000100:00080000:3.0:1788572521.865886:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572521.865890:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572521.865893:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584465280:0@lo:38:kworker.0 00000100:00100000:2.0:1788572521.866164:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584464896 00000100:00100000:2.0:1788572521.866179:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584464896 00000100:00100000:2.0:1788572521.866244:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1788572521.866252:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584464896:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572521.866274:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572521.866372:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584464896:12345-0@lo:38:kworker.0 Request processed in 119us (1426us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572521.866379:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00080000:0.0:1788572521.868753:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572521.868770:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572521.868777:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584464896:0@lo:38:kworker.0 00010000:00010000:2.0:1788572522.111946:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572523.132674:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572523.884076:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572523.884135:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572523.884189:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572523.884268:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569576320 00000100:00100000:0.0:1788572523.884279:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569576320 00000100:00100000:2.0:1788572523.884307:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569576064 00000100:00100000:2.0:1788572523.884314:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569576064 00000100:00100000:0.0:1788572523.884354:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569576192 00000100:00100000:2.0:1788572523.884356:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 0 00000100:00100000:0.0:1788572523.884358:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569576192 00000100:00100000:2.0:1788572523.884366:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2396:x1875444569576064:12345-192.168.202.57@tcp:250:kworker.0 00000100:00100000:0.0:1788572523.884381:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 540 00000100:00100000:0.0:1788572523.884394:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569576320:12345-192.168.202.57@tcp:400:kworker.0 00010000:00080000:2.0:1788572523.884410:0:201330:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f79285ed-4685-45a8-8731-5e2522a143f3@192.168.202.57@tcp t0 exp 0000000000000000 cur 9276 last 0 00010000:00000080:0.0:1788572523.884423:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590542dc00 x1875444569576320/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:184/0 lens 224/224 e 0 to 0 dl 1788572534 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1788572523.884440:0:201330:0:(genops.c:1385:class_connect()) connect: client f79285ed-4685-45a8-8731-5e2522a143f3, cookie 0x265cfe11109bf70b 00000100:00100000:0.0:1788572523.884528:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569576320:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 138us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572523.884532:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1317 00000100:00100000:0.0:1788572523.884538:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 540 00000100:00100000:1.0:1788572523.884539:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569576192:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:1.0:1788572523.884554:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572523.884582:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569576192:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 42us (393us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572523.884588:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1317 00000100:00080000:3.0:1788572523.884763:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572523.884808:0:201330:0:(import.c:65:import_set_state_nolock()) ffff8e590cc75800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572523.884856:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+5:2396:x1875444569576064:12345-192.168.202.57@tcp:250:kworker.0 Request processed in 489us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572523.884864:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 0 00000100:00100000:0.0:1788572523.902706:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584465408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572523.902784:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572523.903060:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584465408 00000100:00100000:1.0:1788572523.903069:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584465408 00000100:00100000:1.0:1788572523.903122:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6455 00000100:00100000:1.0:1788572523.903132:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584465408:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572523.903141:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584465536:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572523.903167:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572523.903172:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572523.903212:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584465408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572523.903220:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6455 00000100:00100000:1.0:1788572523.903234:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584465536 00000100:00100000:1.0:1788572523.903237:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584465536 00000100:00100000:0.0:1788572523.903242:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584465408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572523.903254:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6456 00000100:00100000:1.0:1788572523.903259:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584465536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572523.903276:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572523.903312:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584465536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572523.903319:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6456 00000100:00100000:0.0:1788572523.903663:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584465536:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572523.903788:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572523.903793:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572524.158246:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572524.971704:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572524.971810:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569576448 00000100:00100000:2.0:1788572524.971824:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569576448 00000100:00100000:2.0:1788572524.971888:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1 00000100:00100000:2.0:1788572524.971898:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+5:160932:x1875444569576448:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572524.971917:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572524.971956:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb63e expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572524.971993:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb63e expref: 6 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572524.972006:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb63e expref: 6 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572524.972016:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14aa00, rc 0) 00000100:00100000:2.0:1788572524.972082:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+6:160932:x1875444569576448:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 185us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.972090:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1 00000100:00100000:3.0:1788572524.977560:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572524.988620:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569576576 00000100:00100000:2.0:1788572524.988639:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569576576 00000100:00100000:2.0:1788572524.988717:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2 00000100:00100000:2.0:1788572524.988728:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+6:160932:x1875444569576576:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788572524.988817:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+6:160932:x1875444569576576:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 Request processed in 89us (11267us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572524.988825:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2 00000100:00100000:0.0:1788572525.014393:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572525.014762:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569576704 00000100:00100000:3.0:1788572525.014772:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569576704 00000100:00100000:3.0:1788572525.014837:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 3 00000100:00100000:3.0:1788572525.014849:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+6:160932:x1875444569576704:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572525.014871:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572525.014897:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dce200/0x265cfe11109bf719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb645 expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572525.014927:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dce200/0x265cfe11109bf719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb645 expref: 7 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572525.014955:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dce200/0x265cfe11109bf719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb645 expref: 7 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572525.014966:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce200, rc 0) 00000100:00100000:3.0:1788572525.015030:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+7:160932:x1875444569576704:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 183us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572525.015038:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 3 00000100:00100000:0.0:1788572525.026588:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572525.026815:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569576832 00000100:00100000:2.0:1788572525.026826:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569576832 00000100:00100000:2.0:1788572525.026885:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4 00000100:00100000:2.0:1788572525.026896:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+7:160932:x1875444569576832:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788572525.044891:0:201334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788572525.045096:0:201332:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 339 20000000:01000000:2.0:1788572525.061856:0:201335:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788572525.061871:0:201335:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788572525.061875:0:201335:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788572525.061878:0:201335:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788572525.066628:0:201335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788572525.067376:0:201332:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788572525.067546:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+8:160932:x1875444569576832:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 40641us (40958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572525.067564:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4 00000100:00100000:0.0:1788572525.077310:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572525.077545:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569576960 00000100:00100000:3.0:1788572525.077559:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569576960 00000100:00100000:3.0:1788572525.077633:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5 00000100:00100000:3.0:1788572525.077645:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+8:160932:x1875444569576960:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572525.077841:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+8:160932:x1875444569576960:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 Request processed in 197us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572525.077850:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5 00000100:00100000:0.0:1788572525.100926:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572525.101581:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569577088 00000100:00100000:3.0:1788572525.101597:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569577088 00000100:00100000:3.0:1788572525.101681:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6 00000100:00100000:3.0:1788572525.101694:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+8:160932:x1875444569577088:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572525.101718:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572525.101751:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcf000/0x265cfe11109bf720 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb64c expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572525.101789:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcf000/0x265cfe11109bf720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb64c expref: 9 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572525.101802:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dcf000/0x265cfe11109bf720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb64c expref: 9 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572525.101819:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf000, rc 0) 00000100:00100000:3.0:1788572525.101906:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569577088:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 214us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572525.101914:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6 00000100:00100000:0.0:1788572525.112452:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572525.118304:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569577216 00000100:00100000:3.0:1788572525.118330:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569577216 00000100:00100000:0.0:1788572525.118686:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7 00000100:00100000:0.0:1788572525.118701:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569577216:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572525.119006:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569577216:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 307us (6585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572525.119015:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7 00000100:00100000:0.0:1788572525.124176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572525.124541:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569577344 00000100:00100000:2.0:1788572525.124557:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569577344 00000100:00100000:2.0:1788572525.124627:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8 00000100:00100000:2.0:1788572525.124650:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569577344:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572525.124869:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569577344:12345-192.168.202.57@tcp:503:ll_cfg_requeue.0 Request processed in 221us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572525.124878:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8 00000100:00100000:1.0:1788572525.131935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572525.132469:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569577472 00000100:00100000:3.0:1788572525.132537:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569577472 00000100:00100000:3.0:1788572525.132618:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9 00000100:00100000:3.0:1788572525.132632:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569577472:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572525.132656:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572525.132686:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcea00/0x265cfe11109bf727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb653 expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572525.132726:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcea00/0x265cfe11109bf727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb653 expref: 10 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572525.132742:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dcea00/0x265cfe11109bf727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb653 expref: 10 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572525.132925:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcea00, rc 0) 00000100:00100000:0.0:1788572525.135159:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569577472:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 2494us (3205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572525.135185:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9 00000100:00100000:1.0:1788572525.141448:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572525.142234:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569577600 00000100:00100000:0.0:1788572525.142249:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569577600 00000100:00100000:0.0:1788572525.142326:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10 00000100:00100000:0.0:1788572525.142338:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569577600:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572525.143097:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569577600:12345-192.168.202.57@tcp:501:ll_cfg_requeue.0 Request processed in 754us (1655us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572525.143108:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10 00010000:00010000:3.0:1788572525.180892:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572526.204723:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572526.974649:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572526.974662:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788572526.974666:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572526.974670:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572526.974676:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572526.974686:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9274 00000100:00080000:0.0:1788572526.974693:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572526.974702:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572526.974755:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cba300 x1875444584465664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572526.974830:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572526.974835:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572526.974838:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572526.974842:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9274 00000100:00080000:0.0:1788572526.974852:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572526.974858:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572526.974872:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cb9880 x1875444584465920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572526.974900:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572526.974905:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1788572526.974906:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584465792:0@lo:400:kworker.0 00000100:00080000:0.0:1788572526.974907:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572526.974914:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9274 00000100:00080000:0.0:1788572526.974917:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572526.974921:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572526.974946:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cb9f80 x1875444584466176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572526.974980:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572526.974983:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572526.974985:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572526.974989:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9274 00000100:00080000:0.0:1788572526.974992:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572526.974996:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572526.975007:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cb8000 x1875444584466560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572526.975039:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584466432:0@lo:400:kworker.0 00000100:00100000:3.0:1788572526.975042:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572526.975135:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584466304:0@lo:400:kworker.0 00000100:00100000:3.0:1788572526.975272:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584466048:0@lo:400:kworker.0 00000100:00100000:2.0:1788572526.975434:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572516/real 1788572516] req@ffff8e5a31c82680 x1875444584462976/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572526 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572526.975463:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e5a31c82680 x1875444584462976/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572526 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572526.975492:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584465664:0@lo:38:kworker.0 00000100:00100000:0.0:1788572526.975734:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572526.975814:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584466432 00000100:00100000:0.0:1788572526.975825:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584466432 00000100:00100000:0.0:1788572526.975910:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7894 00000100:00100000:0.0:1788572526.975926:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584466432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572526.976011:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584466432:12345-0@lo:400:kworker.0 Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572526.976021:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7894 00000100:00100000:0.0:1788572526.976080:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584466432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572526.976137:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584465792 00000100:00100000:0.0:1788572526.976142:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584465792 00000100:00100000:0.0:1788572526.976623:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1788572526.976637:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584465792:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572526.976655:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905c83800 x1875444584465792/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1788572537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572526.976718:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584465792:12345-0@lo:400:kworker.0 Request processed in 87us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572526.976724:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1788572526.976779:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584465792:0@lo:400:kworker.0 00000100:00080000:0.0:1788572526.976825:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572526.976831:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572526.977456:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572526.977624:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584466304 00000100:00100000:0.0:1788572526.977633:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584466304 00000100:00100000:0.0:1788572526.977689:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7895 00000100:00100000:0.0:1788572526.977698:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584466304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572526.977755:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584466304:12345-0@lo:400:kworker.0 Request processed in 60us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572526.977762:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7895 00000100:00080000:1.0:1788572526.977991:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572526.978030:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584466304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572526.980141:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572526.980303:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584465664 00000100:00100000:0.0:1788572526.980323:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584465664 00000100:00100000:0.0:1788572526.980470:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:0.0:1788572526.980499:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584465664:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572526.980531:0:198183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572526.981645:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572526.981701:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584465920:0@lo:38:kworker.0 00000100:00100000:2.0:1788572526.981954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572526.982310:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584465664:12345-0@lo:38:kworker.0 Request processed in 1825us (2176us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572526.982323:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1788572526.986609:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584466176:0@lo:38:kworker.0 00000100:00100000:2.0:1788572526.986698:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572526.986724:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584466560:0@lo:38:kworker.0 00000100:00100000:2.0:1788572526.986750:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572526.986819:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584466048 00000100:00100000:1.0:1788572526.986830:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584466048 00000100:00100000:0.0:1788572526.986839:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584465920 00000100:00100000:0.0:1788572526.986854:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584465920 00000100:00100000:0.0:1788572526.986905:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1788572526.986918:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584466048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572526.986923:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1788572526.986940:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584465920:12345-0@lo:38:kworker.0 00010000:00000080:0.0:1788572526.986966:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5905c83b80 x1875444584466048/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1788572537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:1.0:1788572526.986969:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572526.987029:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584466048:12345-0@lo:400:kworker.0 Request processed in 114us (5393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572526.987036:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00080000:0.0:1788572526.987111:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572526.987135:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584466176 00000100:00100000:0.0:1788572526.987138:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584466176 00000100:00100000:0.0:1788572526.987171:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1788572526.987176:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584466176:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572526.987187:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572526.987356:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584465920:12345-0@lo:38:kworker.0 Request processed in 422us (5401us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572526.987364:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1788572526.987748:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584466176:12345-0@lo:38:kworker.0 Request processed in 569us (1048us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572526.987757:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1788572526.988379:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584466048:0@lo:400:kworker.0 00000100:00080000:2.0:1788572526.988437:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572526.988463:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788572526.988494:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584462976:0@lo:250:kworker.0 00000100:00080000:2.0:1788572526.988533:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572526.988539:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572526.988542:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584465664:0@lo:38:kworker.0 00000100:00080000:2.0:1788572526.988556:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572526.988559:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572526.988563:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584465920:0@lo:38:kworker.0 00000100:00080000:2.0:1788572526.988575:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572526.988579:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572526.988582:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584466176:0@lo:38:kworker.0 00000100:00080000:0.0:1788572526.988662:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572526.988669:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788572526.988673:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572526.988679:0:177620:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 9269 00000100:00080000:0.0:1788572526.988685:0:177620:0:(import.c:630:import_select_connection()) MGC192.168.202.157@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572526.988692:0:177620:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 10000000:01000000:3.0:1788572526.988731:0:201324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:0.0:1788572526.988737:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3729ca80 x1875444584466688/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788572526.988755:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109be1b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.988952:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109be1b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.988962:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788572526.988984:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.988999:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1e00/0x265cfe11109be1a9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109be1b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00020000:2.0:1788572526.989676:0:3640:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8e5a3729ca80 x1875444584466688/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572526.990223:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109be116 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990240:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109be116 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990246:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572526.990254:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990263:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce800/0x265cfe11109be10f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109be116 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990280:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109be124 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990289:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109be124 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990294:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572526.990299:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990303:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4600/0x265cfe11109be11d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109be124 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990311:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109be186 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990318:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109be186 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990324:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572526.990327:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990331:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905bb4200/0x265cfe11109be17f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109be186 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990340:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109be194 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990346:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109be194 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990351:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572526.990355:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990358:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a01671600/0x265cfe11109be18d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109be194 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990368:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990374:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990384:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572526.990387:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990391:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5905fe1200/0x265cfe11109be1b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109be1be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990400:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bec76 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990407:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bec76 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990412:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572526.990415:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990419:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11255400/0x265cfe11109bec6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bec76 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990430:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bed33 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990436:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bed33 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990441:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572526.990445:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990448:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf200/0x265cfe11109bed2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bed33 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990462:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bed64 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990475:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bed64 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990614:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572526.990618:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990623:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bed5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bed64 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990637:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bec68 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990644:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bec68 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990649:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572526.990652:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990655:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11254200/0x265cfe11109bec61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bec68 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990670:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109be132 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990677:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109be132 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990681:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572526.990684:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990688:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a01671000/0x265cfe11109be12b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109be132 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990702:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109be1a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990708:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109be1a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990713:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572526.990716:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990719:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a1ffce600/0x265cfe11109be19b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109be1a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572526.990728:0:201324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x265cfe11109bed25 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572526.990733:0:201324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x265cfe11109bed25 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572526.990738:0:201324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572526.990741:0:201324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788572526.990744:0:201324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfc00/0x265cfe11109bed1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x265cfe11109bed25 expref: -99 pid: 198960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572526.992472:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584466560 00000100:00100000:1.0:1788572526.993086:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584466560 00000100:00100000:1.0:1788572526.993293:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1788572526.993304:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584466560:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572526.993407:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572526.994053:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584466560:12345-0@lo:38:kworker.0 Request processed in 745us (7297us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572526.994064:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00080000:3.0:1788572527.039361:0:201324:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5a1f1aa000 already not connected (conn 263, was 0): CONNECTING 00000100:00080000:3.0:1788572527.039377:0:201324:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1788572527.040405:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572527.040437:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1788572527.040456:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:0:1875444584466688:0@lo:250:kworker.0 00000100:00080000:1.0:1788572527.040993:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) e87131b0-4a60-4def-a26d-6e23dcfe5daa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572527.041000:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788572527.041004:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572527.041087:0:177620:0:(import.c:545:import_select_connection()) MGC192.168.202.157@tcp: connect to NID 0@lo last attempt 9279 00000100:00080000:1.0:1788572527.041095:0:177620:0:(import.c:630:import_select_connection()) MGC192.168.202.157@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572527.041104:0:177620:0:(import.c:665:import_select_connection()) MGC192.168.202.157@tcp: import ffff8e5a1f1aa000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572527.041228:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3f99ea00 x1875444584466816/t0(0) o250->MGC192.168.202.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572527.041255:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572527.041259:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572527.041261:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572527.041265:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9279 00000100:00080000:1.0:1788572527.041269:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572527.041273:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572527.041292:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3f99c700 x1875444584466944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572527.041341:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572527.041346:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572527.041348:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572527.041352:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9279 00000100:00080000:1.0:1788572527.041355:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572527.041360:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572527.041374:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a3f99c380 x1875444584467200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572527.041405:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572527.041409:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572527.041411:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572527.041416:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9279 00000100:00080000:1.0:1788572527.041419:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572527.041423:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572527.041442:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a411b0e00 x1875444584467456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572527.041468:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572527.041472:0:177620:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788572527.041528:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584467328:0@lo:400:kworker.0 00000100:00100000:1.0:1788572527.041622:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.041675:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572527.041681:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584467584:0@lo:400:kworker.0 00000100:00100000:1.0:1788572527.041712:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.041755:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584467584 00000100:00100000:1.0:1788572527.041765:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584467584 00000100:00080000:3.0:1788572527.041968:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572527.041975:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572527.041979:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584466560:0@lo:38:kworker.0 00000100:00100000:3.0:1788572527.042006:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584466816:0@lo:250:kworker.0 00000100:00100000:3.0:1788572527.042231:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572527.042263:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584466944:0@lo:38:kworker.0 00000100:00100000:3.0:1788572527.042290:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572527.042305:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584467200:0@lo:38:kworker.0 00000100:00100000:3.0:1788572527.042329:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572527.042342:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584467456:0@lo:38:kworker.0 00000100:00100000:3.0:1788572527.042367:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572527.042396:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584467456 00000100:00100000:3.0:1788572527.042401:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584467456 00000100:00100000:2.0:1788572527.042420:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584467712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572527.042445:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1788572527.042456:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584467456:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788572527.042462:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1788572527.042507:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572527.042520:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572527.042528:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584467072:0@lo:400:kworker.0 00000100:00100000:3.0:1788572527.042560:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584467456:12345-0@lo:38:kworker.0 Request processed in 103us (190us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572527.042565:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572527.042574:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1788572527.042606:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584467712 00000100:00100000:2.0:1788572527.042611:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584467712 00000100:00080000:3.0:1788572527.042632:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572527.042638:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572527.042642:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584467456:0@lo:38:kworker.0 00000100:00100000:2.0:1788572527.042653:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7896 00000100:00100000:2.0:1788572527.042662:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584467712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572527.042712:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4101a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584467712:12345-0@lo:400:kworker.0 Request processed in 52us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572527.042719:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7896 00000100:00100000:3.0:1788572527.042738:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584467712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572527.044665:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584467328 00000100:00100000:0.0:1788572527.044683:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584467328 00000100:00100000:2.0:1788572527.044743:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584466944 00000100:00100000:2.0:1788572527.044750:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584466944 00000100:00100000:0.0:1788572527.044759:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584467200 00000100:00100000:0.0:1788572527.044823:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584467200 00000100:00100000:1.0:1788572527.044942:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7897 00000100:00100000:1.0:1788572527.044955:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584467584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572527.045079:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584467584:12345-0@lo:400:kworker.0 Request processed in 127us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.045086:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7897 00000100:00100000:1.0:1788572527.045158:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584467584:0@lo:400:kworker.0 00000100:00100000:2.0:1788572527.045236:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584467072 00000100:00100000:2.0:1788572527.045242:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584467072 00000100:00100000:3.0:1788572527.045663:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1788572527.045680:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584467328:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572527.045701:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4132b800 x1875444584467328/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:188/0 lens 224/224 e 0 to 0 dl 1788572538 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572527.045759:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584467328:12345-0@lo:400:kworker.0 Request processed in 85us (4137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572527.045778:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1788572527.045801:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1788572527.045807:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584467072:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572527.045818:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41019c00 x1875444584467072/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:188/0 lens 224/224 e 0 to 0 dl 1788572538 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572527.045852:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584467072:12345-0@lo:400:kworker.0 Request processed in 46us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572527.045858:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1788572527.045871:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1788572527.045875:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584466944:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572527.045914:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572527.045960:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584466944:12345-0@lo:38:kworker.0 Request processed in 82us (3669us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572527.045966:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1788572527.045980:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:3.0:1788572527.045985:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584467200:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572527.045996:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572527.046037:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584467200:12345-0@lo:38:kworker.0 Request processed in 50us (3706us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572527.046042:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:1.0:1788572527.055711:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584467328:0@lo:400:kworker.0 00000100:00100000:2.0:1788572527.055994:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584466816 00000100:00100000:2.0:1788572527.056005:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584466816 00000100:00100000:2.0:1788572527.056056:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572527.056068:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3640:x1875444584466816:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1788572527.056106:0:201332:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e87131b0-4a60-4def-a26d-6e23dcfe5daa@0@lo t0 exp 0000000000000000 cur 9280 last 0 00000020:00000080:2.0:1788572527.056148:0:201332:0:(genops.c:1385:class_connect()) connect: client e87131b0-4a60-4def-a26d-6e23dcfe5daa, cookie 0x265cfe11109bf72e 00000100:00080000:2.0:1788572527.056363:0:201332:0:(import.c:65:import_set_state_nolock()) ffff8e5a090c9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572527.056469:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+5:3640:x1875444584466816:12345-0@lo:250:kworker.0 Request processed in 401us (14237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572527.056477:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572527.057726:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584467072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572527.058067:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.157@tcp: committing for last_committed 0 gen 82 00000100:00080000:2.0:1788572527.058080:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.157@tcp: connect to target with instance 0 00000100:00080000:2.0:1788572527.058090:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.157@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788572527.058097:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788572527.058101:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a1f1aa000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788572527.058105:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788572527.058215:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788572527.058231:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3640:1875444584466816:0@lo:250:kworker.0 00000100:00080000:2.0:1788572527.058251:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572527.058257:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572527.058260:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584466944:0@lo:38:kworker.0 00000100:00080000:2.0:1788572527.058276:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572527.058280:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572527.058283:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584467200:0@lo:38:kworker.0 00000020:01000000:0.0:1788572527.058305:0:177620:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.202.157@tcp 10000000:01000000:0.0:1788572527.058333:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788572527.058338:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788572527.058339:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788572527.058341:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572527.058343:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00080000:2.0:1788572527.058343:0:201324:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1788572527.058347:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572527.058349:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572527.058351:0:177620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572527.058353:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572527.058355:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:2.0:1788572527.058359:0:201324:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:0.0:1788572527.058401:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000020:01000004:2.0:1788572527.058403:0:201324:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788572527.058409:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 10000000:01000000:2.0:1788572527.058410:0:201324:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000004:0.0:1788572527.058413:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788572527.058416:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572527.058417:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572527.058418:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572527.058419:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572527.058420:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572527.058421:0:177620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572527.058423:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572527.058424:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788572527.058456:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788572527.058462:0:177620:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788572527.058464:0:177620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788572527.058465:0:177620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788572527.058466:0:177620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572527.058467:0:177620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572527.058469:0:177620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572527.058470:0:177620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572527.058472:0:177620:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572527.058473:0:177620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572527.058474:0:177620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788572527.058512:0:177620:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788572527.058539:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572527.058553:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584467840:0@lo:253:kworker.0 00000100:00100000:0.0:1788572527.058629:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.058686:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584467840 00000100:00100000:0.0:1788572527.058694:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584467840 00000100:00100000:0.0:1788572527.058744:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572527.058754:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+5:3643:x1875444584467840:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788572527.058800:0:201331:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788572527.058818:0:201331:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000040:01000000:2.0:1788572527.059049:0:201324:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.157@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788572527.059081:0:201324:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.157@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788572527.059085:0:201324:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788572527.059087:0:201324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572527.059088:0:201324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572527.059089:0:201324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572527.059090:0:201324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572527.059092:0:201324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572527.059093:0:201324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572527.059095:0:201324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572527.059096:0:201324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572527.059098:0:201324:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572527.059101:0:201324:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788572527.059103:0:201324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788572527.059104:0:201324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572527.059106:0:201324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572527.059107:0:201324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572527.059108:0:201324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572527.059109:0:201324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572527.059110:0:201324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572527.059111:0:201324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572527.059112:0:201324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572527.059113:0:201324:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788572527.059129:0:201324:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788572527.059140:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468224:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788572527.059192:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.059616:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906580300 going to sleep for 11 seconds 00000100:00100000:2.0:1788572527.059658:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584468096:0@lo:253:kworker.0 00000100:00100000:2.0:1788572527.059701:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.060448:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584467968:0@lo:253:kworker.0 00000100:00100000:1.0:1788572527.060598:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:3.0:1788572527.069921:0:201331:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788572527.069951:0:201331:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788572527.070396:0:201334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788572527.070403:0:201334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788572527.070436:0:201334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.070468:0:201334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb63e expref: 9 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.070514:0:201334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.070570:0:201334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb63e expref: 9 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.070589:0:201334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb63e expref: 9 pid: 201332 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572527.070606:0:201334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584468352:192.168.202.57@tcp:104: 00000100:00100000:3.0:1788572527.070724:0:201334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b83d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572527.071604:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+5:3643:x1875444584467840:12345-0@lo:253:kworker.0 Request processed in 12843us (12969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572527.071619:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000004:1.0:1788572527.079703:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788572527.079712:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788572527.079714:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572527.079716:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572527.079717:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572527.079721:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572527.079723:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788572527.079725:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572527.079726:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788572527.079734:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584467840:0@lo:253:kworker.0 00000100:00100000:0.0:1788572527.079793:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584468224 00000100:00100000:0.0:1788572527.079805:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584468224 00000100:00100000:0.0:1788572527.079891:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584468096 00000100:00100000:0.0:1788572527.079895:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584468096 00000100:00100000:0.0:1788572527.079907:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584467968 00000100:00100000:0.0:1788572527.079910:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584467968 00000100:00100000:0.0:1788572527.079924:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572527.079944:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:201324:x1875444584468224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788572527.080025:0:201330:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788572527.080028:0:201330:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788572527.080032:0:201330:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788572527.080041:0:201330:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788572527.080764:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:201324:x1875444584468224:12345-0@lo:253:mount.lustre.0 Request processed in 826us (21566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.080971:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468224:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572527.080988:0:201324:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788572527.080991:0:201324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572527.080993:0:201324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572527.080995:0:201324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572527.080996:0:201324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572527.080998:0:201324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572527.080999:0:201324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572527.081000:0:201324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572527.081002:0:201324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572527.081004:0:201324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572527.081005:0:201324:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788572527.081044:0:201324:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a41346800 from lustre-MDT0000 10000000:01000000:0.0:1788572527.081086:0:201324:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788572527.081090:0:201324:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788572527.081102:0:201324:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5a41346800 10000000:01000000:0.0:1788572527.081107:0:201324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788572527.081114:0:201324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e5a41346800 10000000:01000000:0.0:1788572527.081118:0:201324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788572527.081122:0:201324:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a41346800 from 1 10000000:01000000:0.0:1788572527.081125:0:201324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788572527.081175:0:201324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e200/0x265cfe11109bf73c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.081189:0:201324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e200/0x265cfe11109bf73c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.081201:0:201324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e200/0x265cfe11109bf73c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572527.081228:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572527.081280:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.081311:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590d7c4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788572527.081525:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788572527.081575:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584468480 00000100:00100000:1.0:1788572527.081580:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584468480 00000100:00100000:1.0:1788572527.081608:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788572527.081617:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:3642:x1875444584468096:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788572527.081645:0:201330:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788572527.081664:0:201330:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788572527.082006:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788572527.082019:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:3641:x1875444584467968:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788572527.082040:0:201332:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1788572527.088073:0:201334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584468352:192.168.202.57@tcp:104: 00010000:00010000:3.0:1788572527.088122:0:201334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788572527.091283:0:201330:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572527.091297:0:201330:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788572527.091404:0:201332:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788572527.091806:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572527.092722:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:3642:x1875444584468096:12345-0@lo:253:kworker.0 Request processed in 11096us (33011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572527.092737:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:0.0:1788572527.092779:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788572527.092784:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788572527.092786:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572527.092787:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572527.092788:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572527.092790:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572527.092791:0:3642:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572527.092794:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572527.092795:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788572527.092800:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584468096:0@lo:253:kworker.0 00000100:00100000:2.0:1788572527.092823:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788572527.092839:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+6:201324:x1875444584468480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572527.092860:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572527.092896:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590d14b400/0x265cfe11109bf743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf73c expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.092930:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590d14b400/0x265cfe11109bf743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf73c expref: 7 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.092956:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590d14b400/0x265cfe11109bf743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf73c expref: 7 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.092967:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14b400, rc 0) 00000100:00100000:2.0:1788572527.093015:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:201324:x1875444584468480:12345-0@lo:101:mount.lustre.0 Request processed in 182us (11734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572527.093021:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788572527.093260:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572527.093281:0:201324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e200/0x265cfe11109bf73c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf743 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.093293:0:201324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e200/0x265cfe11109bf73c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf743 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572527.093313:0:201324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788572527.093333:0:201324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e200/0x265cfe11109bf73c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf743 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.093341:0:201324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e200/0x265cfe11109bf73c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf743 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572527.093351:0:201324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788572527.093358:0:201324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572527.093364:0:201324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e5a41346800 10000000:01000000:0.0:1788572527.093368:0:201324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788572527.093372:0:201324:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788572527.093375:0:201324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788572527.093409:0:201324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164ee00/0x265cfe11109bf74a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.093417:0:201324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a3164ee00/0x265cfe11109bf74a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.093427:0:201324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a3164ee00/0x265cfe11109bf74a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572527.093450:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572527.093546:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.093585:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590d7c4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572527.096048:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584468608 00000100:00100000:2.0:1788572527.096071:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584468608 00000100:00100000:2.0:1788572527.096151:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788572527.096163:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+7:201324:x1875444584468608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572527.096196:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572527.096222:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590d14a800/0x265cfe11109bf751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf74a expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.096260:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590d14a800/0x265cfe11109bf751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf74a expref: 8 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.096276:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590d14a800/0x265cfe11109bf751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf74a expref: 8 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.096287:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14a800, rc 0) 00000100:00100000:2.0:1788572527.096411:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:201324:x1875444584468608:12345-0@lo:101:mount.lustre.0 Request processed in 249us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572527.096418:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788572527.096803:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572527.096830:0:201324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a3164ee00/0x265cfe11109bf74a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf751 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.096842:0:201324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a3164ee00/0x265cfe11109bf74a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf751 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572527.096955:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572527.096999:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.097051:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584468736 00000100:00100000:0.0:1788572527.097056:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584468736 00000100:00100000:0.0:1788572527.097089:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788572527.097096:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:201324:x1875444584468736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572527.097261:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:201324:x1875444584468736:12345-0@lo:501:mount.lustre.0 Request processed in 164us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.097268:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788572527.097314:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590d7c4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572527.097329:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572527.097357:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572527.097413:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.097434:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584468864 00000100:00100000:0.0:1788572527.097438:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584468864 00000100:00100000:0.0:1788572527.097456:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572527.097463:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:201324:x1875444584468864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572527.097647:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590d7c4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788572527.098311:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569577728 00000100:00100000:3.0:1788572527.098319:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569577728 00010000:00010000:3.0:1788572527.098358:0:152004:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb63e expref: 10 pid: 201332 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572527.098398:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12912 00000100:00100000:3.0:1788572527.098406:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a11062050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569577728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572527.098423:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572527.098429:0:152004:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb63e expref: 10 pid: 201332 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098442:0:152004:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb63e expref: 10 pid: 201332 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098463:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590d14aa00/0x265cfe11109bf712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb63e expref: 10 pid: 201332 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098528:0:152004:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098538:0:152004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788572527.098555:0:152004:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028152876s 00010000:00010000:3.0:1788572527.098560:0:152004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098566:0:152004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098573:0:152004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098580:0:152004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098585:0:152004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572527.098590:0:152004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098599:0:152004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098617:0:152004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098630:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572527.098706:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a11062050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f79285ed-4685-45a8-8731-5e2522a143f3+9:2398:x1875444569577728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 299us (6905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572527.098715:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12912 00010000:00010000:3.0:1788572527.098808:0:201334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098818:0:201334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572527.098824:0:201334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf735 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788572527.099720:0:201332:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788572527.099741:0:201332:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788572527.100238:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:3641:x1875444584467968:12345-0@lo:253:kworker.0 Request processed in 18216us (39634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572527.100250:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 20000000:01000000:2.0:1788572527.100409:0:201334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572527.100416:0:201334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572527.100442:0:201334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.100461:0:201334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788572527.100473:0:201334:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028152876s 00000020:01000004:0.0:1788572527.100585:0:3641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788572527.100589:0:3641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572527.100590:0:3641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572527.100591:0:3641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572527.100594:0:3641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572527.100595:0:3641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572527.100597:0:3641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572527.100599:0:3641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572527.100600:0:3641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788572527.100604:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584467968:0@lo:253:kworker.0 00010000:00010000:2.0:1788572527.100974:0:201334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.100986:0:201334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.100994:0:201334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.101004:0:201334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.101026:0:201334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ac00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572527.101033:0:201334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.101042:0:201334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.101058:0:201334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.101067:0:201334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.101074:0:201334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590d14ac00/0x265cfe11109bf758 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572527.102511:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:201324:x1875444584468864:12345-0@lo:503:mount.lustre.0 Request processed in 5035us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.102528:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572527.102741:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3729e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584468864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572527.103952:0:201336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201336:1875444584468992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572527.104254:0:201336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.104309:0:201336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906580540 going to sleep for 11 seconds 00000100:00100000:1.0:1788572527.106608:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584468992 00000100:00100000:1.0:1788572527.106631:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584468992 00000100:00100000:1.0:1788572527.106725:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788572527.106739:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:201336:x1875444584468992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572527.109635:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:201336:x1875444584468992:12345-0@lo:502:llog_process_th.0 Request processed in 2885us (5366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.109655:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788572527.109928:0:201336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201336:1875444584468992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572527.109992:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572527.110007:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572527.110009:0:201336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788572527.110015:0:201336:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788572527.110019:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788572527.110137:0:201336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e59041599c0) 00000020:00000080:2.0:1788572527.110169:0:201336:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1788572527.110178:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788572527.110296:0:201336:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788572527.110305:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bf766 00000020:00000080:2.0:1788572527.110609:0:201336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788572527.110614:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572527.110619:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572527.110620:0:201336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788572527.110623:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572527.110627:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572527.110628:0:201336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788572527.110631:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788572527.110639:0:201336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e590415cd40) 00000020:00000080:2.0:1788572527.110653:0:201336:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1788572527.110657:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788572527.110659:0:201336:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788572527.110662:0:201336:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788572527.110669:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788572527.110721:0:201336:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a41346800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788572527.110735:0:201336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e5a109f8000) 00000020:00000080:2.0:1788572527.110745:0:201336:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1788572527.111987:0:201336:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788572527.112006:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bf77b 00000020:00000080:2.0:1788572527.112288:0:201336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788572527.112297:0:201336:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788572527.112303:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x265cfe11109bf782 00080000:01000000:2.0:1788572527.112310:0:201336:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788572527.112314:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bf789 00010000:00010000:2.0:1788572527.235788:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572527.296882:0:201336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788572527.299172:0:201336:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b idx: 0 lr: 343597383689 srv lr: 347892350976 lx: 0 gen 23 00000001:00080000:2.0:1788572527.299244:0:201336:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 343597383687 srv lr: 347892350976 lx: 0 gen 22 00000001:00000004:2.0:1788572527.299277:0:201336:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 82, last_transno is 347892350976 00000001:00080000:2.0:1788572527.299435:0:201336:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788572527.299562:0:201336:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5901a9fcc0: xid 1875444569530624, transno 347892350987, client gen 23, slot idx 0 00000001:00080000:2.0:1788572527.299574:0:201336:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5901a9f780: xid 1875444569531520, transno 347892350988, client gen 23, slot idx 1 00000001:00080000:2.0:1788572527.299580:0:201336:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5901a9fe40: xid 1875444584387968, transno 347892350984, client gen 22, slot idx 2 00000001:00080000:2.0:1788572527.299584:0:201336:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8e5901a9f0c0: xid 1875444584396032, transno 347892350989, client gen 22, slot idx 3 00000020:00000080:2.0:1788572527.303520:0:201336:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e5a109f99c0) 00000020:00000080:2.0:1788572527.303561:0:201336:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788572527.303684:0:201336:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788572527.303692:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bf7a5 00000020:00000080:0.0:1788572527.308645:0:201336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788572527.329706:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x265cfe11109bf7ac 00000020:00000080:3.0:1788572527.330568:0:201336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788572527.330586:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572527.330593:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.330595:0:201336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788572527.330598:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572527.330601:0:201336:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788572527.330602:0:201336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572527.330603:0:201336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572527.330605:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572527.330606:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.330607:0:201336:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572527.330609:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572527.330613:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.330614:0:201336:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788572527.330618:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788572527.330674:0:201336:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788572527.330687:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572527.330689:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.330690:0:201336:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788572527.330691:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572527.330693:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.330694:0:201336:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788572527.330696:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572527.330701:0:201336:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:00000080:3.0:1788572527.330730:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572527.330749:0:201336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e5901bfcd40) 00000020:00000080:3.0:1788572527.330769:0:201336:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788572527.330773:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572527.330829:0:201336:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788572527.330834:0:201336:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788572527.330839:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bf7ba 00010000:00080000:3.0:1788572527.335407:0:201336:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e590b16f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572527.340405:0:201336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788572527.346237:0:201336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572527.346259:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788572527.346330:0:201336:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788572527.346363:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bf7c1 00000100:00080000:3.0:1788572527.346382:0:201336:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572527.346391:0:201336:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e590b16f800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572527.346446:0:201336:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf5180 x1875444584469120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572527.346561:0:201336:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788572527.346629:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572527.346633:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.346635:0:201336:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788572527.346639:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572527.346642:0:201336:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788572527.346644:0:201336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572527.346645:0:201336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572527.346647:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572527.346650:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.346651:0:201336:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572527.346654:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788572527.346660:0:201336:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788572527.346664:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.346665:0:201336:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788572527.346668:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572527.346672:0:201336:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:3.0:1788572527.346703:0:201336:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788572527.346705:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572527.346722:0:201336:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e5901bf8000) 00000020:00000080:3.0:1788572527.346740:0:201336:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788572527.346745:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572527.347142:0:201336:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788572527.347150:0:201336:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788572527.347160:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bf7cf 00010000:00080000:3.0:1788572527.347203:0:201336:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a3711d000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572527.347475:0:201336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1788572527.347912:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584469120:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788572527.348046:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.348145:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584469120 00000100:00100000:0.0:1788572527.348156:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584469120 00000100:00100000:0.0:1788572527.348201:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1788572527.348209:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584469120:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788572527.348243:0:188054:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9280 last 0 00000020:00000080:0.0:1788572527.348293:0:188054:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bf7d6 00000004:00100000:0.0:1788572527.348312:0:188054:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788572527.348445:0:188054:0:(import.c:65:import_set_state_nolock()) ffff8e5a36e26000 : changing import state from RECOVER to FULL 00010000:00000080:0.0:1788572527.348473:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3729e680 x1875444584469120/t0(0) o38->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788572547 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572527.348561:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584469120:12345-0@lo:38:llog_process_th.0 Request processed in 351us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.348569:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1788572527.348643:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788572527.348654:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 6 00000100:00080000:0.0:1788572527.348663:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788572527.348669:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788572527.348672:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788572527.348680:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584469120:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788572527.349181:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572527.349187:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572527.349191:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572527.349196:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 9279 00000100:00080000:1.0:1788572527.349202:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572527.349207:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572527.349241:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104d180 x1875444584469248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572527.349328:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584469376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572527.349380:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.349429:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584469376 00000100:00100000:1.0:1788572527.349434:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584469376 00000100:00100000:1.0:1788572527.349469:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1788572527.349499:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584469376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572527.349537:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00010000:00000080:1.0:1788572527.349552:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104c700 x1875444584469376/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:188/0 lens 224/368 e 0 to 0 dl 1788572538 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572527.349588:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584469376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.349594:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1788572527.349637:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584469376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572527.350610:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584469248:0@lo:38:kworker.0 00000100:00100000:0.0:1788572527.350682:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.351265:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584469248 00000100:00100000:1.0:1788572527.351275:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584469248 00000100:00100000:1.0:1788572527.351319:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:1.0:1788572527.351328:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584469248:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788572527.351402:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584469248:12345-0@lo:38:kworker.0 Request processed in 74us (720us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788572527.351410:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00080000:0.0:1788572527.351751:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572527.351757:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572527.351761:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584469248:0@lo:38:kworker.0 00000040:01000000:1.0:1788572527.352909:0:201336:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788572527.353062:0:201336:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788572527.353163:0:201336:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 80, last_idx 81 00000040:00080000:1.0:1788572527.354076:0:201336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572527.354115:0:201336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].82, 64 off13440 00000040:00080000:1.0:1788572527.354310:0:201336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x148:0x0].1, 64 off8256 00000040:00080000:0.0:1788572527.355779:0:201342:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 82 synced_idx: 0 lgh_last_idx: 82 00000040:00080000:0.0:1788572527.355788:0:201342:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x144:0x0] at index 81 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788572527.356061:0:201342:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 81, last_idx 82 00000040:00080000:0.0:1788572527.356088:0:201342:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x144:0x0] at index 81 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788572527.356277:0:201342:0:(llog.c:805:llog_process_thread()) index: 82, lh_last_idx: 82 synced_idx: 82 lgh_last_idx: 82 00000040:00080000:0.0:1788572527.356280:0:201342:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x148:0x0] at index 82 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788572527.357414:0:201336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572527.357431:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788572527.357924:0:201336:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788572527.357966:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bf7dd 00000100:00080000:1.0:1788572527.358082:0:201336:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788572527.358092:0:201336:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5a3711d000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572527.358152:0:201336:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104fb80 x1875444584469504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572527.358300:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584469504:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788572527.358421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.358517:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584469504 00000100:00100000:2.0:1788572527.358528:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584469504 00000100:00100000:2.0:1788572527.358582:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22723 00000100:00080000:1.0:1788572527.358612:0:201336:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788572527.358655:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3640:x1875444584469504:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788572527.358690:0:43922:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9280 last 0 00000020:00000080:2.0:1788572527.358725:0:43922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bf7e4 00000020:01000000:1.0:1788572527.358731:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572527.358737:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572527.358739:0:201336:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788572527.358742:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00002000:00100000:2.0:1788572527.358743:0:43922:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e5a109d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000020:01000000:1.0:1788572527.358745:0:201336:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788572527.358747:0:201336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00002000:00080000:2.0:1788572527.358748:0:43922:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000020:01000000:1.0:1788572527.358749:0:201336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572527.358751:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00002000:00100000:2.0:1788572527.358751:0:43922:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:1.0:1788572527.358753:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572527.358754:0:201336:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788572527.358757:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788572527.358762:0:201336:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788572527.358765:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572527.358766:0:201336:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788572527.358768:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788572527.358772:0:201336:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:1.0:1788572527.358797:0:201336:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788572527.358799:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788572527.358815:0:201336:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e59028a19c0) 00000020:00000080:1.0:1788572527.358833:0:201336:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type osp with refcount 2 00000020:00000080:1.0:1788572527.358837:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00002000:00080000:2.0:1788572527.358847:0:43922:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788572527.358893:0:43922:0:(import.c:65:import_set_state_nolock()) ffff8e5a109d7800 : changing import state from RECOVER to FULL 00000004:00080000:1.0:1788572527.358952:0:201336:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788572527.358959:0:201336:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788572527.358965:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x265cfe11109bf7f2 00010000:00080000:1.0:1788572527.359007:0:201336:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a0f05d800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:1.0:1788572527.359268:0:201336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1788572527.359370:0:201336:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788572527.359390:0:201336:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788572527.362275:0:201336:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 80, last_idx 81 00000100:00100000:2.0:1788572527.363696:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584469504:12345-0@lo:8:llog_process_th.0 Request processed in 5030us (5264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572527.363712:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22723 00000040:00080000:1.0:1788572527.364348:0:201336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572527.364391:0:201336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].82, 64 off13440 00000040:00080000:1.0:1788572527.364590:0:201336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14a:0x0].1, 64 off8256 00000100:00100000:0.0:1788572527.364725:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788572527.364809:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:0.0:1788572527.364821:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788572527.364828:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788572527.364832:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3711d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788572527.364857:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788572527.364867:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584469504:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788572527.365057:0:201342:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788572527.365113:0:201342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 9280359632909ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788572527.365120:0:201342:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788572527.366139:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572527.366161:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584469632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572527.366272:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.366336:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584469632 00000100:00100000:1.0:1788572527.366347:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584469632 00000100:00100000:1.0:1788572527.366431:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6457 00000100:00100000:1.0:1788572527.366442:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584469632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572527.366495:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00000100:00080000:0.0:1788572527.366647:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572527.366687:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584469632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.366702:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6457 00000100:00100000:3.0:1788572527.367451:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584469632:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788572527.368120:0:201325:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1788572527.368873:0:201344:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 82 synced_idx: 0 lgh_last_idx: 82 00000040:00080000:1.0:1788572527.368880:0:201344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x146:0x0] at index 81 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788572527.369313:0:201344:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 81, last_idx 82 00000040:00080000:1.0:1788572527.369345:0:201344:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x146:0x0] at index 81 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788572527.369694:0:201344:0:(llog.c:805:llog_process_thread()) index: 82, lh_last_idx: 82 synced_idx: 82 lgh_last_idx: 82 00000040:00080000:1.0:1788572527.369698:0:201344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14a:0x0] at index 82 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788572527.372792:0:201336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572527.372813:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788572527.372893:0:201336:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788572527.372927:0:201336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bf7f9 00000100:00080000:3.0:1788572527.372952:0:201336:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572527.372960:0:201336:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5a0f05d800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572527.373013:0:201336:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1fdf7b80 x1875444584469760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572527.373050:0:201336:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788572527.373103:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584469760:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788572527.373127:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572527.373131:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.373133:0:201336:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788572527.373136:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572527.373140:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.373142:0:201336:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788572527.373144:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788572527.373147:0:201336:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788572527.373149:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572527.373151:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.373152:0:201336:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788572527.373154:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572527.373156:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572527.373157:0:201336:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788572527.373160:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788572527.373202:0:201336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201336:1875444584469888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572527.373220:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572527.373263:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584469760 00000100:00100000:3.0:1788572527.373271:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584469760 00000100:00100000:3.0:1788572527.373307:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22724 00000100:00100000:3.0:1788572527.373316:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3640:x1875444584469760:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788572527.373347:0:43925:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9280 last 0 00000020:00000080:3.0:1788572527.373375:0:43925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x265cfe11109bf800 00002000:00100000:3.0:1788572527.373392:0:43925:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e5a372df800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788572527.373397:0:43925:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788572527.373401:0:43925:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788572527.373533:0:43925:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788572527.373561:0:43925:0:(import.c:65:import_set_state_nolock()) ffff8e5a37119000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572527.373633:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584469760:12345-0@lo:8:llog_process_th.0 Request processed in 316us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572527.373641:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22724 00000100:00100000:3.0:1788572527.373678:0:201336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572527.373701:0:201336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a2467b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788572527.373752:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584469888 00000100:00100000:1.0:1788572527.373757:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584469888 00000100:00100000:1.0:1788572527.373799:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788572527.373807:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:201336:x1875444584469888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572527.373964:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:201336:x1875444584469888:12345-0@lo:502:llog_process_th.0 Request processed in 157us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.373971:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788572527.374048:0:201336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201336:1875444584469888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572527.374086:0:201336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572527.374092:0:201336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572527.374094:0:201336:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788572527.374099:0:201336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1788572527.374123:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788572527.374132:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788572527.374141:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788572527.374147:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788572527.374149:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f05d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788572527.374173:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788572527.374179:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584469760:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1788572527.374238:0:201324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788572527.374274:0:201324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788572527.374297:0:201324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164ee00/0x265cfe11109bf74a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf751 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.374309:0:201324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a3164ee00/0x265cfe11109bf74a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf751 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572527.374319:0:201324:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a41346800 from 1 00000100:00100000:2.0:1788572527.374321:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584470016:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788572527.374322:0:201324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788572527.374353:0:201324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.374362:0:201324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.374372:0:201324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572527.374375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.374386:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572527.374414:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.374426:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584470016 00000100:00100000:2.0:1788572527.374430:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584470016 00000100:00100000:1.0:1788572527.374434:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b8c00 going to sleep for 11 seconds 00000004:00080000:1.0:1788572527.374456:0:201344:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788572527.374467:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6458 00000100:00100000:2.0:1788572527.374474:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584470016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572527.374524:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572527.374563:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584470016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572527.374570:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6458 00000004:00080000:1.0:1788572527.374583:0:201344:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 9280369102480ns, next at 0ns, rc = 0 00000100:00080000:2.0:1788572527.374588:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00080000:00080000:1.0:1788572527.374590:0:201344:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788572527.374615:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584470016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572527.375261:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584470144 00000100:00100000:0.0:1788572527.375270:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584470144 00000100:00100000:0.0:1788572527.375308:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788572527.375317:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+8:201324:x1875444584470144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572527.375329:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572527.375352:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf807 expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.375381:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf807 expref: 9 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.375394:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf807 expref: 9 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.375405:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164fe00, rc 0) 00000100:00100000:0.0:1788572527.375463:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:201324:x1875444584470144:12345-0@lo:101:mount.lustre.0 Request processed in 148us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.375470:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788572527.375655:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572527.375674:0:201324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.375683:0:201324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572527.376442:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470272:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788572527.376545:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.376589:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a062e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572527.376698:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584470272 00000100:00100000:0.0:1788572527.376705:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584470272 00000100:00100000:0.0:1788572527.376751:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788572527.376760:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:201324:x1875444584470272:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788572527.376780:0:201332:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788572527.376801:0:201332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788572527.376804:0:201332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788572527.376807:0:201332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788572527.376810:0:201332:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 342 00000100:00100000:0.0:1788572527.376918:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:201324:x1875444584470272:12345-0@lo:256:mount.lustre.0 Request processed in 159us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.376926:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788572527.377026:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470272:0@lo:256:mount.lustre.0 00000004:00080000:3.0:1788572527.377913:0:201325:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:2.0:1788572527.380261:0:201324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572527.380303:0:201324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.380320:0:201324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572527.380438:0:201324:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a41346800 from 1 10000000:01000000:2.0:1788572527.380443:0:201324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572527.380520:0:201324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14ac00/0x265cfe11109bf815 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.380529:0:201324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590d14ac00/0x265cfe11109bf815 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.380543:0:201324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590d14ac00/0x265cfe11109bf815 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572527.380578:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572527.380675:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.380730:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a062e0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572527.380866:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584470400 00000100:00100000:1.0:1788572527.380876:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584470400 00000100:00100000:1.0:1788572527.380951:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788572527.380964:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+9:201324:x1875444584470400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572527.380991:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572527.381013:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254e00/0x265cfe11109bf81c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf815 expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.381045:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254e00/0x265cfe11109bf81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf815 expref: 10 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.381058:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254e00/0x265cfe11109bf81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf815 expref: 10 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.381068:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254e00, rc 0) 00000100:00100000:1.0:1788572527.381127:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201324:x1875444584470400:12345-0@lo:101:mount.lustre.0 Request processed in 164us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.381134:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788572527.382082:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572527.382106:0:201324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590d14ac00/0x265cfe11109bf815 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf81c expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.382119:0:201324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590d14ac00/0x265cfe11109bf815 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf81c expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572527.382749:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572527.382819:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.382878:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a062e0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572527.386587:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584470528 00000100:00100000:1.0:1788572527.386609:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584470528 00000100:00100000:1.0:1788572527.386706:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572527.386720:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201324:x1875444584470528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572527.386987:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201324:x1875444584470528:12345-0@lo:501:mount.lustre.0 Request processed in 259us (4157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.386996:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788572527.387019:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572527.387095:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572527.387169:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.387225:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a062e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572527.387407:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584470656 00000100:00100000:0.0:1788572527.387413:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584470656 00000100:00100000:0.0:1788572527.387459:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572527.387467:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201324:x1875444584470656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572527.387603:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201324:x1875444584470656:12345-0@lo:503:mount.lustre.0 Request processed in 135us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.387610:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788572527.388284:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584470656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572527.391237:0:201346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201346:1875444584470784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572527.391359:0:201346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.391420:0:201346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572527.391624:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584470784 00000100:00100000:0.0:1788572527.391634:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584470784 00000100:00100000:0.0:1788572527.391696:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788572527.391709:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201346:x1875444584470784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572527.392429:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201346:x1875444584470784:12345-0@lo:502:llog_process_th.0 Request processed in 718us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.392440:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788572527.392876:0:201346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201346:1875444584470784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572527.392922:0:201346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572527.392946:0:201346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572527.392949:0:201346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788572527.392962:0:201346:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a41346800 00000020:00000080:1.0:1788572527.392965:0:201346:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572527.392985:0:201346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572527.392989:0:201346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572527.392990:0:201346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788572527.392992:0:201346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572527.392995:0:201346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572527.392996:0:201346:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788572527.393000:0:201346:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a41346800 00000020:00000080:1.0:1788572527.393002:0:201346:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788572527.393118:0:201346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201346:1875444584470912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572527.393311:0:201346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.393415:0:201346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572527.402475:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584470912 00000100:00100000:3.0:1788572527.402604:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584470912 00000100:00100000:3.0:1788572527.402759:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788572527.402774:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201346:x1875444584470912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572527.403067:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201346:x1875444584470912:12345-0@lo:502:llog_process_th.0 Request processed in 296us (9754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572527.403076:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788572527.403207:0:201346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201346:1875444584470912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572527.403259:0:201346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572527.403271:0:201346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572527.403274:0:201346:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788572527.403280:0:201346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788572527.403395:0:201324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788572527.403424:0:201324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572527.403447:0:201324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14ac00/0x265cfe11109bf815 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf81c expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.403459:0:201324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590d14ac00/0x265cfe11109bf815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf81c expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572527.403572:0:201324:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788572527.403576:0:201324:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5a41346800 10000000:01000000:2.0:1788572527.403579:0:201324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5a41346800 10000000:01000000:2.0:1788572527.403583:0:201324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788572527.403592:0:201324:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a41346800 from 1 10000000:01000000:2.0:1788572527.403594:0:201324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788572527.403637:0:201324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14b200/0x265cfe11109bf823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.403646:0:201324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590d14b200/0x265cfe11109bf823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.403656:0:201324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590d14b200/0x265cfe11109bf823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572527.403683:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584471040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572527.403737:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.411362:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a062e0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572527.415654:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584471040 00000100:00100000:1.0:1788572527.415676:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584471040 00000100:00100000:1.0:1788572527.415755:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788572527.415769:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:201324:x1875444584471040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572527.415795:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572527.415819:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11255600/0x265cfe11109bf82a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf823 expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.415856:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11255600/0x265cfe11109bf82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf823 expref: 11 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.415869:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11255600/0x265cfe11109bf82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf823 expref: 11 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.415879:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255600, rc 0) 00000100:00100000:1.0:1788572527.416011:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201324:x1875444584471040:12345-0@lo:101:mount.lustre.0 Request processed in 245us (12273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.416019:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788572527.416115:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584471040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572527.416141:0:201324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590d14b200/0x265cfe11109bf823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf82a expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572527.416152:0:201324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590d14b200/0x265cfe11109bf823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf82a expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572527.416258:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584471168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572527.416303:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.416341:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572527.416358:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584471168 00000100:00100000:1.0:1788572527.416363:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584471168 00000100:00100000:1.0:1788572527.416383:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788572527.416390:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201324:x1875444584471168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572527.417288:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201324:x1875444584471168:12345-0@lo:501:mount.lustre.0 Request processed in 892us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.417300:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788572527.417361:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584471168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572527.417409:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584471296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572527.417467:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.419627:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572527.419685:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584471296 00000100:00100000:1.0:1788572527.419696:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584471296 00000100:00100000:1.0:1788572527.419749:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788572527.419758:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201324:x1875444584471296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572527.419967:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201324:x1875444584471296:12345-0@lo:503:mount.lustre.0 Request processed in 209us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.419978:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788572527.420053:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584471296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572527.423400:0:201349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201349:1875444584471424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572527.423707:0:201349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.423765:0:201349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572527.423863:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584471424 00000100:00100000:0.0:1788572527.423875:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584471424 00000100:00100000:0.0:1788572527.423956:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788572527.423968:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201349:x1875444584471424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572527.424152:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201349:x1875444584471424:12345-0@lo:502:llog_process_th.0 Request processed in 185us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.424162:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788572527.424322:0:201349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201349:1875444584471424:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788572527.424401:0:201349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788572527.424422:0:201349:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e59028a4d40) 00000020:00000080:1.0:1788572527.424459:0:201349:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788572527.424904:0:201349:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a41346800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788572527.424909:0:201349:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a41346800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788572527.424913:0:201349:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a41346800 4 00010000:00080000:1.0:1788572527.424966:0:201349:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a412c2800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.157@tcp at head 00010000:00010000:0.0:1788572527.430388:0:201349:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1788572527.432358:0:201349:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788572527.432426:0:201349:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788572527.432444:0:201349:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x265cfe11109bf838 00000100:00080000:0.0:1788572527.432459:0:201349:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572527.432467:0:201349:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e5a412c2800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572527.432599:0:201349:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31cb8000 x1875444584471552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572527.432641:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584471552:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788572527.432734:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572527.432807:0:201349:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788572527.433291:0:201349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201349:1875444584471680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572527.433358:0:201349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.433393:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584471680 00000100:00100000:0.0:1788572527.433402:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584471680 00000100:00100000:0.0:1788572527.433450:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788572527.433460:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201349:x1875444584471680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572527.433792:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201349:x1875444584471680:12345-0@lo:502:llog_process_th.0 Request processed in 331us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.433801:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788572527.433872:0:201349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590d7c4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572527.433902:0:201349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201349:1875444584471680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572527.433961:0:201349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201349:1875444584471808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572527.434000:0:201349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.434025:0:201349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a115c9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572527.434633:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584471552 00000100:00100000:0.0:1788572527.434641:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584471552 00000100:00100000:0.0:1788572527.434682:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1788572527.434689:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584471552:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788572527.434758:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584471552:12345-0@lo:38:llog_process_th.0 Request processed in 67us (2024us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572527.434765:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1788572527.434803:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788572527.434811:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a412c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572527.434816:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572527.434819:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584471552:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572527.435625:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584471808 00000100:00100000:3.0:1788572527.435634:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584471808 00000100:00100000:3.0:1788572527.435680:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788572527.435690:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201349:x1875444584471808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572527.435874:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201349:x1875444584471808:12345-0@lo:502:llog_process_th.0 Request processed in 186us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572527.435882:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788572527.436815:0:201349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201349:1875444584471808:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788572527.437031:0:201349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788572527.437135:0:201324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788572527.437163:0:201324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572527.437197:0:201324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14b200/0x265cfe11109bf823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf82a expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572527.437210:0:201324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590d14b200/0x265cfe11109bf823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf82a expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788572527.437309:0:201324:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788572527.437312:0:201324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572527.437314:0:201324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572527.437315:0:201324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572527.437316:0:201324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572527.437318:0:201324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572527.437320:0:201324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572527.437322:0:201324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572527.437324:0:201324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572527.437325:0:201324:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572527.437331:0:201324:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788572527.437334:0:201324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572527.437336:0:201324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572527.437337:0:201324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572527.437339:0:201324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572527.437340:0:201324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572527.437341:0:201324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572527.437342:0:201324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572527.437344:0:201324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572527.437345:0:201324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572527.437346:0:201324:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572527.437374:0:201324:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788572527.437398:0:201324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584471936:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572527.438653:0:201324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.438712:0:201324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a115c9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572527.438749:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584471936 00000100:00100000:0.0:1788572527.438759:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584471936 00000100:00100000:0.0:1788572527.438813:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788572527.438824:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201324:x1875444584471936:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788572527.438862:0:201331:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788572527.438881:0:201331:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788572527.445761:0:201331:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788572527.445786:0:201331:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788572527.446025:0:201334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572527.446032:0:201334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572527.446063:0:201334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.446087:0:201334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf807 expref: 11 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.446098:0:201334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.446156:0:201334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bf807 expref: 11 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.446176:0:201334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109bf807 expref: 11 pid: 201330 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572527.446195:0:201334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584472064:0@lo:104: 00000100:00100000:1.0:1788572527.446789:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:201324:x1875444584471936:12345-0@lo:253:mount.lustre.0 Request processed in 7960us (9305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.446805:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788572527.446994:0:201324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:201324:1875444584471936:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572527.447014:0:201324:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788572527.447019:0:201324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572527.447021:0:201324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572527.447022:0:201324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572527.447023:0:201324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572527.447024:0:201324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572527.447026:0:201324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572527.447027:0:201324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572527.447029:0:201324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572527.447032:0:201324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572527.447034:0:201324:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788572527.447056:0:201324:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788572527.448109:0:201334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.448179:0:201334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a412b8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572527.448216:0:13337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584472064 00000100:00100000:2.0:1788572527.448227:0:13337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584472064 00000100:00100000:2.0:1788572527.448287:0:13337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5405 00000100:00100000:2.0:1788572527.448299:0:13337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:201334:x1875444584472064:12345-0@lo:104: 00010000:00010000:2.0:1788572527.448320:0:13337:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.448383:0:13337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572527.448390:0:13337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:201334:x1875444584472064:12345-0@lo:104: Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572527.448397:0:13337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5405 00000100:00100000:2.0:1788572527.448443:0:201334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41018380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584472064:0@lo:104: 00010000:00010000:2.0:1788572527.448467:0:201334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.449792:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572527.449802:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.449812:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254800 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572527.449818:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.449828:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572527.449836:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572527.449843:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572527.449900:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.449906:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572527.450729:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.450741:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bf80e expref: -99 pid: 201324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.450764:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572527.450766:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572527.450769:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572527.450809:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584472192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572527.450895:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572527.452611:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584472192 00000100:00100000:2.0:1788572527.452629:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584472192 00010000:00010000:2.0:1788572527.452992:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bf807 expref: 11 pid: 201330 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572527.453044:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12913 00000100:00100000:2.0:1788572527.453055:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:3642:x1875444584472192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572527.453078:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572527.453086:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bf807 expref: 11 pid: 201330 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453102:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109bf807 expref: 11 pid: 201330 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453126:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf80e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bf807 expref: 11 pid: 201330 timeout: 9380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453151:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453624:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788572527.453657:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028152876s 00010000:00010000:2.0:1788572527.453663:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453672:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453680:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453687:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453694:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ba00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572527.453698:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453707:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453725:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453739:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572527.453837:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:3642:x1875444584472192:12345-0@lo:103:ldlm_bl.0 Request processed in 783us (2942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572527.453846:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12913 00010000:00010000:2.0:1788572527.453881:0:201334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453891:0:201334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572527.453898:0:201334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590d14ba00/0x265cfe11109bf83f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572527.453966:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584472192:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788572527.473131:0:201324:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 326417522199 00000040:01000000:0.0:1788572527.473824:0:201324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788572527.474284:0:201355:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788572527.475700:0:201324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788572527.477411:0:201356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201356:1875444584472320:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572527.477612:0:201356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572527.477772:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584472320 00000100:00100000:1.0:1788572527.477783:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584472320 00000100:00100000:1.0:1788572527.477841:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1788572527.477953:0:201356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a050f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572527.478003:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201356:x1875444584472320:12345-0@lo:1000:lod0000_rec0001.0 00010000:00000080:1.0:1788572527.478072:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cb8000 x1875444584472320/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:188/0 lens 304/4320 e 0 to 0 dl 1788572538 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572527.478132:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201356:x1875444584472320:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 134us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572527.478141:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1788572527.478271:0:201356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201356:1875444584472320:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788572527.478314:0:201356:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788572527.478348:0:201356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201356:1875444584472448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572527.478382:0:201356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.478406:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584472448 00000100:00100000:0.0:1788572527.478410:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584472448 00000100:00100000:0.0:1788572527.478433:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1788572527.478439:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201356:x1875444584472448:12345-0@lo:1000:lod0000_rec0001.0 00010000:00000080:0.0:1788572527.478571:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cba300 x1875444584472448/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:188/0 lens 336/4320 e 0 to 0 dl 1788572538 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572527.478599:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201356:x1875444584472448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 160us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.478606:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1788572527.478630:0:201356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a050f00 going to sleep for 11 seconds 00000040:01000000:2.0:1788572527.480297:0:201324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788572527.480359:0:201324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788572527.481273:0:201354:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 326417522199 00000020:00080000:3.0:1788572527.481282:0:201354:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 326417522199 00000100:00100000:0.0:1788572527.481337:0:201356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201356:1875444584472448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572527.481519:0:201356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201356:1875444584472576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572527.481607:0:201356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.482880:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584472576 00000100:00100000:0.0:1788572527.482897:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584472576 00000100:00100000:0.0:1788572527.483181:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1788572527.483195:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201356:x1875444584472576:12345-0@lo:1000:lod0000_rec0001.0 00010000:00000080:0.0:1788572527.483282:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cb9180 x1875444584472576/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:188/0 lens 304/4320 e 0 to 0 dl 1788572538 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572527.483354:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201356:x1875444584472576:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 163us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572527.483363:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1788572527.483436:0:201356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a050f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572527.483467:0:201356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201356:1875444584472576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572527.483619:0:201356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201356:1875444584472704:0@lo:1000:lod0000_rec0001.0 00000004:00000080:2.0:1788572527.483954:0:201324:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788572527.483971:0:201324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788572527.484084:0:201324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572527.485048:0:201324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788572527.485603:0:201324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788572527.485652:0:201324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788572527.485792:0:201324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572527.487894:0:201355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1788572527.488618:0:201356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572527.488679:0:201356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a050900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572527.488970:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584472704 00000100:00100000:3.0:1788572527.488982:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584472704 00000100:00100000:3.0:1788572527.489049:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1788572527.489061:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201356:x1875444584472704:12345-0@lo:1000:lod0000_rec0001.0 00010000:00000080:3.0:1788572527.491376:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cb8700 x1875444584472704/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:188/0 lens 336/33016 e 0 to 0 dl 1788572538 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572527.491451:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201356:x1875444584472704:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2392us (2838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572527.491464:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1788572527.491800:0:201356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201356:1875444584472704:0@lo:1000:lod0000_rec0001.0 00000004:00080000:1.0:1788572527.493049:0:201355:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:2.0:1788572527.496093:0:201324:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x85:0x0] (8/32) registered 00000040:00080000:0.0:1788572527.498239:0:201356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788572527.498357:0:201356:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788572527.498363:0:201356:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1788572527.501058:0:201324:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 347892350989 00010000:00080000:2.0:1788572527.502440:0:201357:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 201357 00010000:02000000:2.0:1788572527.502741:0:201357:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1788572527.502747:0:201357:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788572527.502753:0:201357:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1788572527.502922:0:201324:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788572527.502957:0:201324:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.157@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788572527.502986:0:201324:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788572527.503028:0:201324:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788572527.512716:0:201324:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572527.513105:0:201324:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788572528.112320:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572528.116221:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569577856 00000100:00100000:3.0:1788572528.116245:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569577856 00000100:00100000:3.0:1788572528.116343:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 36 00000100:00100000:3.0:1788572528.116356:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569577856:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572528.116380:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572528.116409:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb65a expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.116447:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb65a expref: 10 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.116461:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb65a expref: 10 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.116473:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcfc00, rc 0) 00000100:00100000:3.0:1788572528.116598:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569577856:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 244us (4292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572528.116606:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 36 00000100:00100000:2.0:1788572528.119351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572528.119717:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569577984 00000100:00100000:0.0:1788572528.119731:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569577984 00000100:00100000:0.0:1788572528.119803:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 37 00000100:00100000:0.0:1788572528.119816:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569577984:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788572528.119858:0:201331:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788572528.119889:0:201331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788572528.119894:0:201331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788572528.119897:0:201331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788572528.119899:0:201331:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 343 00000100:00100000:1.0:1788572528.132713:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569577984:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 Request processed in 12884us (13371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.132732:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 37 00000100:00100000:1.0:1788572528.139081:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572528.142077:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569578112 00000100:00100000:0.0:1788572528.142098:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569578112 00000100:00100000:0.0:1788572528.142166:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1325 00000100:00100000:0.0:1788572528.142177:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569578112:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1788572528.142222:0:196070:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '02515dca-bbf0-45e0-bd6e-e76f0c89bd0b' at ffff8e5a10ffe800, cookie 0x265cfe11109bf790 00010000:00080000:0.0:1788572528.142229:0:196070:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp recovering/t347892350990 exp ffff8e5a10ffe800 cur 9281 last 1788572527 00010000:02000400:0.0:1788572528.142242:0:196070:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788572528.142250:0:196070:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 85 seconds 00000004:00100000:0.0:1788572528.142278:0:196070:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788572528.142460:0:196070:0:(import.c:65:import_set_state_nolock()) ffff8e5a0a15c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572528.142590:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569578112:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 Request processed in 411us (3517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.142598:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1325 00000100:00100000:0.0:1788572528.159035:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572528.159345:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569533312 00000100:00100000:1.0:1788572528.159359:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569533312 00000100:00100000:1.0:1788572528.159441:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1326 00000100:00100000:1.0:1788572528.159454:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569533312:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00080000:1.0:1788572528.159506:0:188049:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350990, current: 347892350990, replaying 00000100:00100000:1.0:1788572528.159529:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569533312:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 79us (512us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572528.159537:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1326 00010000:00080000:0.0:1788572528.164726:0:201357:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1788572528.255608:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788572528.448746:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572528.448755:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a41346800 from 343 10000000:01000000:3.0:1788572528.448760:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572528.448811:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.448824:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.448836:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572528.448864:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584472832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.448963:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572528.461339:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572528.461374:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584472832 00000100:00100000:3.0:1788572528.461384:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584472832 00000100:00100000:3.0:1788572528.461458:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788572528.461468:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+10:6515:x1875444584472832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572528.461506:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572528.461527:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf84d expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.461563:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf84d expref: 11 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.461574:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf84d expref: 11 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.461584:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf200, rc 0) 00000100:00100000:3.0:1788572528.462850:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584472832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1375us (13880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572528.462862:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788572528.468725:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584472832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.468759:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.468773:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.468919:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584472960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.468996:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.469050:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a12872c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.469209:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584472960 00000100:00100000:0.0:1788572528.469217:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584472960 00000100:00100000:0.0:1788572528.469266:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788572528.469275:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584472960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788572528.469295:0:201331:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788572528.469310:0:201331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788572528.469313:0:201331:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 343 00000100:00100000:0.0:1788572528.469402:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584472960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.469411:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788572528.469453:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584472960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788572528.469534:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788572528.469542:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.469550:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572528.469560:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788572528.469563:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a40f51000 from 52 10000000:01000000:0.0:1788572528.469565:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788572528.469590:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.469598:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.469611:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572528.469623:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.469663:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.469680:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a050e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.469707:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584473088 00000100:00100000:0.0:1788572528.469712:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584473088 00000100:00100000:0.0:1788572528.469734:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788572528.469740:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+11:6515:x1875444584473088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.469749:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.469761:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a3164ea00/0x265cfe11109bf862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf85b expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.469779:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a3164ea00/0x265cfe11109bf862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf85b expref: 12 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.469789:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a3164ea00/0x265cfe11109bf862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf85b expref: 12 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.469798:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164ea00, rc 0) 00000100:00100000:0.0:1788572528.469824:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584473088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.469830:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788572528.469858:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.469869:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.469878:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572528.470561:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.470595:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.470617:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a050e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572528.471617:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584473216 00000100:00100000:3.0:1788572528.471627:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584473216 00000100:00100000:3.0:1788572528.471753:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788572528.471764:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584473216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.472303:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584473216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 538us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572528.472311:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788572528.472455:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.473266:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.473329:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.474771:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a050e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.481153:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584473344 00000100:00100000:2.0:1788572528.481170:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584473344 00000100:00100000:2.0:1788572528.482087:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572528.482100:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584473344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.482286:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584473344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (8955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.482294:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788572528.482395:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572528.485686:0:201393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788572528.488766:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788572528.488805:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788572528.488818:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.488830:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572528.488846:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788572528.488849:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a40f51000 from 341 10000000:01000000:1.0:1788572528.488852:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788572528.488904:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.488913:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.488924:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.488958:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.489029:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.489081:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5901a9fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.489092:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584473472 00000100:00100000:0.0:1788572528.489099:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584473472 00000100:00100000:0.0:1788572528.489224:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788572528.489235:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+12:6515:x1875444584473472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.489249:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.489262:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a3164e800/0x265cfe11109bf870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf869 expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.489296:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a3164e800/0x265cfe11109bf870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf869 expref: 13 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.489308:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a3164e800/0x265cfe11109bf870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf869 expref: 13 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.489322:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164e800, rc 0) 00000100:00100000:0.0:1788572528.489367:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584473472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.489373:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788572528.489428:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.489441:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.489450:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572528.489521:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.489554:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.489573:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.489585:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584473600 00000100:00100000:0.0:1788572528.489588:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584473600 00000100:00100000:0.0:1788572528.489608:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788572528.489614:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584473600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788572528.489628:0:201330:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788572528.489644:0:201330:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788572528.489649:0:201330:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788572528.489651:0:201330:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788572528.489654:0:201330:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 343 00000100:00100000:0.0:1788572528.489740:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584473600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.489746:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788572528.490283:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788572528.490362:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572528.490370:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.490379:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572528.490387:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788572528.490389:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1788572528.490391:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788572528.490417:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.490424:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.490437:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572528.490452:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.490513:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.490534:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590639bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.491111:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584473728 00000100:00100000:0.0:1788572528.491118:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584473728 00000100:00100000:0.0:1788572528.491241:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788572528.491251:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+13:6515:x1875444584473728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.491262:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.491276:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a3164f000/0x265cfe11109bf87e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf877 expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.491374:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a3164f000/0x265cfe11109bf87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf877 expref: 14 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.491463:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a3164f000/0x265cfe11109bf87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf877 expref: 14 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.491473:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164f000, rc 0) 00000100:00100000:0.0:1788572528.491543:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584473728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.491550:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788572528.491583:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572528.491599:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.491609:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572528.491778:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.491807:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.491841:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590639bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.491881:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584473856 00000100:00100000:1.0:1788572528.491895:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584473856 00000100:00100000:1.0:1788572528.491958:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788572528.491966:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584473856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.492117:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584473856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.492125:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788572528.492353:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.492385:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.492431:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.492453:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590639bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.493689:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584473984 00000100:00100000:1.0:1788572528.493698:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584473984 00000100:00100000:1.0:1788572528.493739:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788572528.493747:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584473984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.496882:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584473984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3120us (4434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.496910:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572528.496921:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584473984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572528.497859:0:201396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1788572528.498161:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1788572528.498193:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788572528.498205:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.498215:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572528.498225:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788572528.498228:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a40f51000 from 1 10000000:01000000:0.0:1788572528.498232:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788572528.498270:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.498288:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.498298:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572528.498322:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.498388:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.498426:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.498823:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584474112 00000100:00100000:1.0:1788572528.498832:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584474112 00000100:00100000:1.0:1788572528.498879:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788572528.498888:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+14:6515:x1875444584474112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572528.498903:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572528.498920:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11255800/0x265cfe11109bf88c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf885 expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.498954:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11255800/0x265cfe11109bf88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf885 expref: 15 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.498965:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11255800/0x265cfe11109bf88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf885 expref: 15 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.498973:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255800, rc 0) 00000100:00100000:1.0:1788572528.499304:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584474112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 414us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.499312:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788572528.502375:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.502404:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.502416:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572528.502435:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788572528.502441:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.502448:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572528.504237:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572528.504246:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a40f51000 from 7 10000000:01000000:1.0:1788572528.504252:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572528.505125:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.505141:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.505232:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.505266:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.505410:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.505461:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.505814:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584474240 00000100:00100000:2.0:1788572528.505822:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584474240 00000100:00100000:2.0:1788572528.505894:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788572528.505906:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+15:6515:x1875444584474240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572528.505920:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572528.505946:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590d14b000/0x265cfe11109bf89a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf893 expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.505972:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590d14b000/0x265cfe11109bf89a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf893 expref: 16 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.505984:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590d14b000/0x265cfe11109bf89a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf893 expref: 16 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.505993:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14b000, rc 0) 00000100:00100000:2.0:1788572528.506045:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584474240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.506053:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788572528.506099:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572528.506114:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.506123:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.506197:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.506225:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.506250:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.506597:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584474368 00000100:00100000:2.0:1788572528.506602:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584474368 00000100:00100000:2.0:1788572528.506632:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788572528.506649:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584474368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.506771:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584474368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.506779:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788572528.506838:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.506870:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.506943:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.506974:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.507053:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584474496 00000100:00100000:2.0:1788572528.507058:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584474496 00000100:00100000:2.0:1788572528.507088:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788572528.507096:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584474496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.507182:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584474496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.507199:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788572528.507237:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572528.508381:0:201397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788572528.508661:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788572528.508680:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788572528.508689:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.508700:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572528.508710:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788572528.508713:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a0a158000 from 52 10000000:01000000:1.0:1788572528.508716:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788572528.508747:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254000/0x265cfe11109bf8a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.508754:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254000/0x265cfe11109bf8a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.508763:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254000/0x265cfe11109bf8a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.508780:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.508824:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.508851:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.509006:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584474624 00000100:00100000:0.0:1788572528.509012:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584474624 00000100:00100000:0.0:1788572528.509049:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788572528.509057:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+16:6515:x1875444584474624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.509067:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.509078:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a3164f800/0x265cfe11109bf8a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf8a1 expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.509097:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a3164f800/0x265cfe11109bf8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf8a1 expref: 17 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.509107:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a3164f800/0x265cfe11109bf8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf8a1 expref: 17 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.509116:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164f800, rc 0) 00000100:00100000:0.0:1788572528.509153:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584474624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.509158:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788572528.510031:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572528.510051:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254000/0x265cfe11109bf8a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.510063:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254000/0x265cfe11109bf8a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf8a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.510124:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.510160:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.510208:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.510229:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584474752 00000100:00100000:2.0:1788572528.510235:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584474752 00000100:00100000:2.0:1788572528.510289:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788572528.510298:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584474752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.510410:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584474752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.510416:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788572528.510840:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.510867:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.511012:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.511039:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.511055:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584474880 00000100:00100000:2.0:1788572528.511059:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584474880 00000100:00100000:2.0:1788572528.511095:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788572528.511103:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584474880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.511199:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584474880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.511206:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788572528.511276:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584474880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572528.514246:0:201398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788572528.522666:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788572528.522704:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788572528.522716:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254000/0x265cfe11109bf8a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.522729:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254000/0x265cfe11109bf8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572528.522739:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788572528.522743:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788572528.522746:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788572528.522782:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14a200/0x265cfe11109bf8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.522790:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590d14a200/0x265cfe11109bf8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.522806:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590d14a200/0x265cfe11109bf8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572528.522833:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.522912:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.522964:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5902255480 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.523096:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584475008 00000100:00100000:1.0:1788572528.523106:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584475008 00000100:00100000:1.0:1788572528.523165:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788572528.523174:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+17:6515:x1875444584475008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572528.523197:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572528.523210:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254600/0x265cfe11109bf8b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf8af expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.523234:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254600/0x265cfe11109bf8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf8af expref: 18 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.523245:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254600/0x265cfe11109bf8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf8af expref: 18 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.523254:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254600, rc 0) 00000100:00100000:1.0:1788572528.523302:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584475008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.523309:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788572528.523971:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.523991:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590d14a200/0x265cfe11109bf8af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8b6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.524002:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590d14a200/0x265cfe11109bf8af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf8b6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572528.524081:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.524120:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.524145:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.524465:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584475136 00000100:00100000:2.0:1788572528.524471:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584475136 00000100:00100000:2.0:1788572528.524549:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788572528.524558:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584475136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.524726:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584475136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.524734:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788572528.525097:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.525131:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.525180:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.525213:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.525323:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584475264 00000100:00100000:2.0:1788572528.525328:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584475264 00000100:00100000:2.0:1788572528.525362:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788572528.525370:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584475264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.526315:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584475264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 936us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.526331:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788572528.526465:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572528.527765:0:201400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788572528.528104:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788572528.528139:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788572528.528156:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14a200/0x265cfe11109bf8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8b6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.528171:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590d14a200/0x265cfe11109bf8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8b6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572528.528185:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788572528.528189:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a0a158000 from 7 10000000:01000000:2.0:1788572528.528192:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572528.528242:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109bf8bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.528251:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109bf8bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.528263:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109bf8bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572528.528294:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.528372:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.528426:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.529650:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584475392 00000100:00100000:0.0:1788572528.529665:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584475392 00000100:00100000:0.0:1788572528.529735:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788572528.529747:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+18:6515:x1875444584475392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.529766:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.529788:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a3164ec00/0x265cfe11109bf8c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf8bd expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.529822:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a3164ec00/0x265cfe11109bf8c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf8bd expref: 19 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.529835:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a3164ec00/0x265cfe11109bf8c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf8bd expref: 19 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.529844:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164ec00, rc 0) 00000100:00100000:0.0:1788572528.529924:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584475392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.529943:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788572528.530072:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572528.530092:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109bf8bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8c4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.530103:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109bf8bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf8c4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572528.530194:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.530233:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.530274:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.530341:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584475520 00000100:00100000:0.0:1788572528.530346:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584475520 00000100:00100000:0.0:1788572528.530382:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788572528.530390:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584475520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.530767:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584475520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 377us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.530775:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788572528.539516:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.539615:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.539735:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.539800:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.540731:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584475648 00000100:00100000:0.0:1788572528.540745:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584475648 00000100:00100000:0.0:1788572528.540868:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572528.540882:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584475648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.541093:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584475648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.541103:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788572528.544325:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572528.551348:0:201402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788572528.553448:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788572528.553596:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572528.553615:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109bf8bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8c4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.553633:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590d14a000/0x265cfe11109bf8bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8c4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572528.553647:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788572528.553650:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e59028fe800 from 52 10000000:01000000:2.0:1788572528.553654:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788572528.553713:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14b800/0x265cfe11109bf8cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.553723:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e590d14b800/0x265cfe11109bf8cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.553738:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e590d14b800/0x265cfe11109bf8cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572528.553776:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572528.553887:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572528.554070:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572528.556799:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584475776 00000100:00100000:0.0:1788572528.556824:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584475776 00000100:00100000:0.0:1788572528.556918:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788572528.556951:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:6515:x1875444584475776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.556977:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572528.557003:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf8d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf8cb expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.557043:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf8cb expref: 20 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.557062:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a3164fe00/0x265cfe11109bf8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf8cb expref: 20 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.557073:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164fe00, rc 0) 00000100:00100000:0.0:1788572528.557187:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584475776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 258us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.557195:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788572528.558899:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572528.558944:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e590d14b800/0x265cfe11109bf8cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8d2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.558960:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e590d14b800/0x265cfe11109bf8cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf8d2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572528.559065:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.559134:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572528.559187:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572528.559220:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584475904 00000100:00100000:3.0:1788572528.559227:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584475904 00000100:00100000:3.0:1788572528.559276:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788572528.559288:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584475904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.559433:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584475904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572528.559441:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788572528.560598:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584475904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.560645:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.560700:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.560732:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.560749:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584476032 00000100:00100000:1.0:1788572528.560753:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584476032 00000100:00100000:1.0:1788572528.560784:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788572528.560792:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584476032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.560879:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584476032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.560886:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788572528.560940:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572528.567344:0:201406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788572528.567463:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788572528.567531:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788572528.567544:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14b800/0x265cfe11109bf8cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8d2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.567556:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e590d14b800/0x265cfe11109bf8cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8d2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572528.567565:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788572528.567568:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788572528.567571:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788572528.567614:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.567621:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.567631:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572528.567660:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.567736:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.567784:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f29c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572528.569729:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584476160 00000100:00100000:2.0:1788572528.569748:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584476160 00000100:00100000:2.0:1788572528.569843:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788572528.569858:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:6515:x1875444584476160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572528.569882:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572528.569907:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e590d14bc00/0x265cfe11109bf8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf8d9 expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.569953:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e590d14bc00/0x265cfe11109bf8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf8d9 expref: 21 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.569967:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e590d14bc00/0x265cfe11109bf8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf8d9 expref: 21 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.569979:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14bc00, rc 0) 00000100:00100000:2.0:1788572528.570090:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584476160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572528.570097:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788572528.570827:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572528.570857:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8e0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.570871:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf8e0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572528.571266:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.571332:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572528.571382:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91480 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.573317:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584476288 00000100:00100000:1.0:1788572528.573332:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584476288 00000100:00100000:1.0:1788572528.573405:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788572528.573416:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584476288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.573644:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584476288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.573652:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788572528.574171:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.574240:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.574306:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572528.574348:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91480 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.574993:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584476416 00000100:00100000:1.0:1788572528.575010:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584476416 00000100:00100000:1.0:1788572528.575057:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788572528.575067:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584476416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.577241:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584476416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2168us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572528.577256:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788572528.577323:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572528.584858:0:201410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788572528.584995:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788572528.585047:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788572528.585062:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf8d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8e0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.585076:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a11254800/0x265cfe11109bf8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8e0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572528.585088:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788572528.585092:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e59028fe800 from 7 10000000:01000000:3.0:1788572528.585095:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572528.585141:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfe00/0x265cfe11109bf8e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.585150:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfe00/0x265cfe11109bf8e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.585162:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfe00/0x265cfe11109bf8e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572528.585260:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.585341:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572528.585399:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5904b91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572528.585441:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584476544 00000100:00100000:3.0:1788572528.585448:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584476544 00000100:00100000:3.0:1788572528.585547:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788572528.585560:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:6515:x1875444584476544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572528.585574:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572528.585587:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcfa00/0x265cfe11109bf8ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf8e7 expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.585615:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcfa00/0x265cfe11109bf8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf8e7 expref: 22 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.585627:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dcfa00/0x265cfe11109bf8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf8e7 expref: 22 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572528.585752:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcfa00, rc 0) 00000100:00100000:3.0:1788572528.585801:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584476544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572528.585808:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788572528.585863:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.585893:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfe00/0x265cfe11109bf8e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8ee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.585907:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfe00/0x265cfe11109bf8e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf8ee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572528.586011:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.586068:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572528.586123:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584476672 00000100:00100000:3.0:1788572528.586131:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584476672 00000100:00100000:0.0:1788572528.586134:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572528.586170:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788572528.586181:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584476672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.586373:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584476672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572528.586380:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788572528.586533:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.586588:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.586647:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.586680:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572528.586733:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584476800 00000100:00100000:3.0:1788572528.586740:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584476800 00000100:00100000:3.0:1788572528.586772:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788572528.586782:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584476800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572528.586919:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584476800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572528.586937:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788572528.587013:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572528.588256:0:201411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788572528.592407:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788572528.592534:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572528.592835:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfe00/0x265cfe11109bf8e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8ee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.592854:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcfe00/0x265cfe11109bf8e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8ee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572528.592866:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788572528.592869:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e5a0efbb380 from 1 10000000:01000000:0.0:1788572528.592873:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788572528.592964:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e400/0x265cfe11109bf8f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.592973:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e400/0x265cfe11109bf8f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.592986:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e400/0x265cfe11109bf8f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572528.593023:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.594015:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.594083:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.594108:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584476928 00000100:00100000:1.0:1788572528.594126:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584476928 00000100:00100000:1.0:1788572528.594203:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788572528.594213:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584476928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572528.594231:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572528.594254:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11254200/0x265cfe11109bf8fc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf8f5 expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.594296:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11254200/0x265cfe11109bf8fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf8f5 expref: 23 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.594310:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11254200/0x265cfe11109bf8fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf8f5 expref: 23 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.594320:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11254200, rc 0) 00000100:00100000:1.0:1788572528.594421:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584476928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.594428:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788572528.595870:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584476928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.595905:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e400/0x265cfe11109bf8f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8fc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.595920:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e400/0x265cfe11109bf8f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf8fc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572528.595960:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788572528.595967:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e400/0x265cfe11109bf8f5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8fc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.595977:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e400/0x265cfe11109bf8f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf8fc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572528.595986:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788572528.595989:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5a0efbb380 from 1 10000000:01000000:0.0:1788572528.595992:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788572528.596030:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.596039:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.596051:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572528.596078:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584477056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.596147:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.596208:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.596218:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584477056 00000100:00100000:1.0:1788572528.596233:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584477056 00000100:00100000:1.0:1788572528.596310:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788572528.596320:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584477056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572528.596337:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572528.596356:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a11255400/0x265cfe11109bf90a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bf903 expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.596398:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a11255400/0x265cfe11109bf90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bf903 expref: 24 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.596409:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a11255400/0x265cfe11109bf90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf903 expref: 24 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572528.596418:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a11255400, rc 0) 00000100:00100000:1.0:1788572528.596629:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584477056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 309us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.596635:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788572528.596661:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584477056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572528.596679:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf90a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572528.596688:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf90a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572528.596763:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584477184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572528.596804:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572528.596842:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572528.597136:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584477184 00000100:00100000:1.0:1788572528.597153:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584477184 00000100:00100000:1.0:1788572528.597192:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788572528.597201:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584477184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572528.597309:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584477184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (505us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572528.597317:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788572528.597357:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584477184:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788572528.597401:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788572528.597409:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf90a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572528.597417:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf90a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572529.007834:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572529.007905:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572529.007990:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569578368 00000100:00100000:0.0:1788572529.008003:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569578368 00000100:00100000:0.0:1788572529.008101:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 545 00000100:00100000:0.0:1788572529.008114:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569578368:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:0.0:1788572529.008164:0:198183:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104f100 x1875444569578368/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:190/0 lens 224/224 e 0 to 0 dl 1788572540 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572529.008244:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569578368:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 132us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.008253:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 545 00000100:00080000:1.0:1788572529.008332:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572529.009063:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569578240 00000100:00100000:0.0:1788572529.009073:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569578240 00000100:00100000:0.0:1788572529.009129:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 73 00000100:00100000:0.0:1788572529.009147:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569578240:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572529.009211:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569578240:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 74us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.009218:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 73 00000100:00100000:3.0:1788572529.020973:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584477312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572529.020983:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584477440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572529.023740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.024246:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584477312 00000100:00100000:2.0:1788572529.024261:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584477312 00000100:00100000:2.0:1788572529.024358:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6459 00000100:00100000:2.0:1788572529.024382:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584477312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572529.024425:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572529.024910:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572529.025010:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584477440 00000100:00100000:0.0:1788572529.025019:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584477440 00000100:00100000:0.0:1788572529.025064:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6460 00000100:00100000:0.0:1788572529.025073:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584477440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572529.025113:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923492864 avail 3691970560 00000100:00080000:3.0:1788572529.025273:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572529.025281:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572529.025352:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584477312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 980us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.025363:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6459 00000100:00100000:3.0:1788572529.025614:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584477312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572529.025837:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584477440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 762us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.025851:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6460 00000100:00100000:2.0:1788572529.025891:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584477440:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572529.281097:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572530.301219:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572531.325104:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572532.354928:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572532.489426:0:201608:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788572532.606233:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572532.606241:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572532.606245:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572532.606253:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 9280 00000100:00080000:1.0:1788572532.606259:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572532.606267:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5a10ff8000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572532.606292:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104dc00 x1875444584477696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572532.606316:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572532.606320:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572532.606322:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572532.606325:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 9280 00000100:00080000:1.0:1788572532.606328:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572532.606332:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e590cc70000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572532.606343:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104ce00 x1875444584477952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572532.606370:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572532.606374:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572532.606375:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572532.606380:0:177620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 9280 00000100:00080000:1.0:1788572532.606383:0:177620:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572532.606386:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e5a3f8c7800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572532.606399:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104c000 x1875444584478208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572532.606424:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572532.606427:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572532.606429:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572532.606433:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572532.606443:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a4104d180 x1875444584478592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572532.606468:0:177620:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788572532.606471:0:177620:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572532.606473:0:177620:0:(import.c:65:import_set_state_nolock()) ffff8e5a412c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572532.606496:0:177620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e5a412c2800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572532.606507:0:177620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40523100 x1875444584479104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572532.606553:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584478080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.606624:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572532.606657:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584478848:0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.606690:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572532.606869:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788572532.606876:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584478336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.606900:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572532.606932:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584478976:0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.606959:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572532.607120:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584478080 00000100:00100000:1.0:1788572532.607128:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584478080 00000100:00100000:1.0:1788572532.607179:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1788572532.607190:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584478080:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572532.607214:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a40521f80 x1875444584478080/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:193/0 lens 224/224 e 0 to 0 dl 1788572543 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572532.607254:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584478080:12345-0@lo:400:kworker.0 Request processed in 67us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572532.607262:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1788572532.607286:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584478848 00000100:00100000:1.0:1788572532.607290:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584478848 00000100:00100000:1.0:1788572532.607318:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584478336 00000100:00100000:1.0:1788572532.607320:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584478336 00000100:00100000:1.0:1788572532.607343:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584478976 00000100:00100000:1.0:1788572532.607346:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584478976 00000100:00100000:1.0:1788572532.607364:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7898 00000100:00100000:1.0:1788572532.607371:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584478848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.607403:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584478848:12345-0@lo:400:kworker.0 Request processed in 33us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572532.607409:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7898 00000100:00100000:1.0:1788572532.607420:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7899 00000100:00100000:1.0:1788572532.607425:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584478336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.607449:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584478336:12345-0@lo:400:kworker.0 Request processed in 24us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572532.607455:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7899 00000100:00100000:2.0:1788572532.608126:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584477568:0@lo:400:kworker.0 00000100:00100000:2.0:1788572532.608171:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572532.608206:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584478464:0@lo:400:kworker.0 00000100:00100000:2.0:1788572532.608230:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572532.608250:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584479232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572532.608275:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572532.608297:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788572532.608303:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584477824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572532.608327:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572532.608343:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584478720:0@lo:400:kworker.0 00000100:00100000:2.0:1788572532.608361:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572532.608393:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584478464 00000100:00100000:2.0:1788572532.608398:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584478464 00000100:00100000:0.0:1788572532.608521:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584477696:0@lo:38:kworker.0 00000100:00100000:0.0:1788572532.608553:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572532.608575:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584477952:0@lo:38:kworker.0 00000100:00100000:0.0:1788572532.608597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572532.608613:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584478208:0@lo:38:kworker.0 00000100:00100000:0.0:1788572532.608633:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572532.608649:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4104d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584478592:0@lo:38:kworker.0 00000100:00100000:0.0:1788572532.608668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572532.608683:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584479104:0@lo:38:kworker.0 00000100:00100000:0.0:1788572532.608721:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572532.608751:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584477824 00000100:00100000:0.0:1788572532.608755:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584477824 00000100:00100000:0.0:1788572532.608784:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584477696 00000100:00100000:0.0:1788572532.608787:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584477696 00000100:00100000:0.0:1788572532.608798:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584477952 00000100:00100000:0.0:1788572532.608800:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584477952 00000100:00100000:0.0:1788572532.608808:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584478592 00000100:00100000:0.0:1788572532.608810:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584478592 00000100:00100000:0.0:1788572532.608817:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584479104 00000100:00100000:0.0:1788572532.608820:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584479104 00000100:00100000:0.0:1788572532.608831:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1788572532.608838:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584477824:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572532.608855:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a41018380 x1875444584477824/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:193/0 lens 224/224 e 0 to 0 dl 1788572543 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572532.608900:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584477824:12345-0@lo:400:kworker.0 Request processed in 63us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572532.608908:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1788572532.608936:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1788572532.608941:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584477696:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788572532.608969:0:196070:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9285 last 0 00000020:00000080:0.0:1788572532.609891:0:196070:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x265cfe11109bf911 00000004:00100000:0.0:1788572532.609921:0:196070:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788572532.610144:0:196070:0:(import.c:65:import_set_state_nolock()) ffff8e5a40dd9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572532.610210:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875444584477696:12345-0@lo:38:kworker.0 Request processed in 1267us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572532.610218:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1788572532.610244:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1788572532.610249:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584477952:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788572532.610266:0:196070:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9285 last 0 00000020:00000080:0.0:1788572532.610290:0:196070:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x265cfe11109bf918 00000004:00100000:0.0:1788572532.610297:0:196070:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788572532.610312:0:196070:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f05e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572532.610340:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875444584477952:12345-0@lo:38:kworker.0 Request processed in 89us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572532.610346:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1788572532.610358:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1788572532.610363:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584478592:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788572532.610375:0:196070:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9285 last 0 00000020:00000080:0.0:1788572532.610400:0:196070:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x265cfe11109bf91f 00000004:00100000:0.0:1788572532.610406:0:196070:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788572532.610420:0:196070:0:(import.c:65:import_set_state_nolock()) ffff8e5a090c9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572532.610448:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875444584478592:12345-0@lo:38:kworker.0 Request processed in 83us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572532.610454:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1788572532.610467:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1788572532.610471:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584479104:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788572532.610504:0:196070:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9285 last 0 00000020:00000080:0.0:1788572532.610527:0:196070:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x265cfe11109bf926 00000004:00100000:0.0:1788572532.610534:0:196070:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788572532.610548:0:196070:0:(import.c:65:import_set_state_nolock()) ffff8e5a12ad4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572532.610578:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875444584479104:12345-0@lo:38:kworker.0 Request processed in 105us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572532.610584:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1788572532.610612:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584477568 00000100:00100000:0.0:1788572532.610617:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584477568 00000100:00100000:0.0:1788572532.610649:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788572532.610656:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584477568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572532.610689:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584477568:12345-0@lo:400:kworker.0 Request processed in 34us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572532.610875:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7900 00000100:00100000:1.0:1788572532.610889:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584478976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.610937:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584478976:12345-0@lo:400:kworker.0 Request processed in 53us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572532.611589:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7901 00000100:00100000:2.0:1788572532.611610:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584478464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572532.611659:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584478464:12345-0@lo:400:kworker.0 Request processed in 63us (3428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572532.611665:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7901 00000100:00100000:2.0:1788572532.611693:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584479232 00000100:00100000:2.0:1788572532.611712:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584479232 00000100:00100000:2.0:1788572532.611736:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584478720 00000100:00100000:2.0:1788572532.611740:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584478720 00000100:00100000:2.0:1788572532.611751:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584478208 00000100:00100000:2.0:1788572532.611753:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584478208 00000100:00100000:2.0:1788572532.611763:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1788572532.611768:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1875444584479232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572532.611793:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00010000:00000080:2.0:1788572532.611806:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a3f99fb80 x1875444584479232/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:193/0 lens 224/368 e 0 to 0 dl 1788572543 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572532.611836:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1875444584479232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (3559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572532.611841:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1788572532.611853:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1788572532.611859:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584478720:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572532.611870:0:188053:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31c83b80 x1875444584478720/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:193/0 lens 224/224 e 0 to 0 dl 1788572543 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572532.611896:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584478720:12345-0@lo:400:kworker.0 Request processed in 38us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572532.611902:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1788572532.611927:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1788572532.611931:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584478208:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788572532.611953:0:188053:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8e5a10ff8800, cookie 0x265cfe11109bf797 00010000:00080000:2.0:1788572532.611957:0:188053:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t347892350997 exp ffff8e5a10ff8800 cur 9285 last 1788572527 00000004:00100000:2.0:1788572532.611972:0:188053:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572532.611997:0:188053:0:(import.c:65:import_set_state_nolock()) ffff8e5906855800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572532.612036:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584478208:12345-0@lo:38:kworker.0 Request processed in 104us (3402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572532.612042:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1788572532.612266:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7900 00000100:00080000:1.0:1788572532.612296:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572532.612300:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572532.612303:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572532.612355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584478336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.612370:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584478976:0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.612383:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584478080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572532.612395:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584478848:0@lo:400:kworker.0 00010000:00080000:1.0:1788572532.612579:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4104dc00 x1875444584477696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572532.612592:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 82 00000100:00080000:1.0:1788572532.613347:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8e5a4104dc00 x1875444584477696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572552 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572532.613357:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572532.613362:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a10ff8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572532.613365:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572532.613370:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875444584477696:0@lo:38:kworker.0 00010000:00080000:1.0:1788572532.613391:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4104ce00 x1875444584477952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572532.613402:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 82 00010000:00080000:3.0:1788572532.615660:0:201357:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788572532.615670:0:201357:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 347892350990 00000020:00080000:3.0:1788572532.615676:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.615680:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350990, next_transno: 347892350990 00010000:00080000:3.0:1788572532.615684:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892350990) 00000020:00080000:3.0:1788572532.615687:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.615700:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569533312 t347892350990 from 192.168.202.57@tcp req@ffff8e5a31cb9880 x1875444569533312/t0(347892350990) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:203/0 lens 528/0 e 0 to 0 dl 1788572553 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572532.615840:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584477824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572532.615861:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584478720:0@lo:400:kworker.0 00000100:00100000:3.0:1788572532.615872:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584477568:0@lo:400:kworker.0 00000100:00100000:3.0:1788572532.615886:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584478464:0@lo:400:kworker.0 00000100:00100000:3.0:1788572532.615902:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584479232:0@lo:41:osp-pre-1-0.0 00000004:00080000:3.0:1788572532.616341:0:201357:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 572us 00000100:00100000:0.0:1788572532.619974:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788572532.625453:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8e5a4104ce00 x1875444584477952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572552 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572532.625497:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572532.625505:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590cc70000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572532.625510:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572532.625517:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875444584477952:0@lo:38:kworker.0 00000100:00100000:1.0:1788572532.625578:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350989 gen 2 00000100:00100000:1.0:1788572532.625585:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e590a2d0380 x1875444584423040/t347892350997(347892350997) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1788572462 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572532.625600:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 82 00000100:00080000:1.0:1788572532.625610:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788572532.625617:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1788572532.625619:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350989 gen 2 00000100:00100000:1.0:1788572532.625623:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e590a2d0380 x1875444584423040/t347892350997(347892350997) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1788572462 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572532.625630:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a3f8c7800 from lustre-MDT0000_UUID committed 347892350989 last 0 00000100:00080000:1.0:1788572532.625637:0:3640:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff8e590a2d0380 x1875444584423040/t347892350997(347892350997) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1788572462 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572532.625648:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584478208:0@lo:38:kworker.0 00010000:00080000:1.0:1788572532.625664:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4104d180 x1875444584478592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572532.625675:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 82 00000100:00080000:1.0:1788572532.628621:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8e5a4104d180 x1875444584478592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572547 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572532.628636:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572532.628642:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572532.628647:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572532.628654:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4104d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584478592:0@lo:38:kworker.0 00010000:00080000:1.0:1788572532.628700:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a40523100 x1875444584479104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572532.628716:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 82 00000100:00080000:1.0:1788572532.628726:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788572532.628731:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788572532.628734:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a412c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572532.628737:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875444584479104:0@lo:38:kworker.0 00000100:00100000:1.0:1788572532.628787:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584423040:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788572532.628850:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572532.632366:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584423040 00000100:00100000:1.0:1788572532.632382:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584423040 00000100:00100000:1.0:1788572532.632445:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1788572532.632457:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584423040:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1788572532.632509:0:188053:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350990, current: 347892350997, replaying 00000100:00100000:1.0:1788572532.632518:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584423040:12345-0@lo:1000:osp_up0-1.0 Request processed in 64us (3668us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572532.632525:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00010000:00010000:0.0:1788572532.697279:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.697302:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.697324:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.697339:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.697346:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.697353:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.699030:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.699046:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.699054:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.699071:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.699076:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.699084:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.699100:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a02ffb000) 00010000:00010000:0.0:1788572532.699103:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.699108:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.699115:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164e000/0x265cfe11109bf92d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572532.699136:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c002c70 reply state 00000000ea03516f transno 347892350990 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.699148:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.699154:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a02ffba00) 00010000:00010000:0.0:1788572532.699156:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572532.699159:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572532.699275:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1788572532.699296:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.699300:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350997, next_transno: 347892350991 00000020:00080000:0.0:1788572532.699305:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.699307:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350997, next_transno: 347892350991 00000001:00080000:0.0:1788572532.701598:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350990 is committed 00010000:00010000:0.0:1788572532.701672:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.701689:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.701699:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.701707:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.701713:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.701725:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.701949:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a02ffba00) 00010000:00010000:0.0:1788572532.701954:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.701962:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.701970:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164f200/0x265cfe11109bf934 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572532.706400:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572532.706510:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569533824 00000100:00100000:3.0:1788572532.706523:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569533824 00000100:00100000:3.0:1788572532.706609:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1331 00000100:00100000:3.0:1788572532.706622:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569533824:12345-192.168.202.57@tcp:36:rm.0 00010000:00080000:3.0:1788572532.706652:0:196070:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350991, current: 347892350991, replaying 00000100:00100000:3.0:1788572532.706683:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569533824:12345-192.168.202.57@tcp:36:rm.0 Request processed in 64us (301us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572532.706692:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1331 00000020:00080000:0.0:1788572532.707364:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.707373:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892350991, next_transno: 347892350991 00010000:00080000:0.0:1788572532.707380:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892350991) 00000020:00080000:0.0:1788572532.707384:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.707399:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569533824 t347892350991 from 192.168.202.57@tcp req@ffff8e5a1fdf4000 x1875444569533824/t0(347892350991) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 512/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572532.707566:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.707590:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.707608:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.707624:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.707634:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.707641:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.708168:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 3/0,1 mode: --/EX res: [0x200027501:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.708185:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.708194:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709691:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709707:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709715:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709722:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.709728:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709738:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709755:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x5:0x0].0x0 (ffff8e5a18beb000) 00010000:00010000:0.0:1788572532.709759:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572532.709765:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 2/0,0 mode: --/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709772:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a800/0x265cfe11109bf949 lrc: 0/0,0 mode: --/EX res: [0x200027501:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709807:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709813:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709819:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709848:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.709852:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.709858:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.712802:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a18bebd00) 00010000:00010000:0.0:1788572532.712809:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.712820:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.712832:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a3164fc00/0x265cfe11109bf93b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572532.712877:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006926707c reply state 000000008600bde1 transno 347892350991 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.712900:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.712919:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18bebf00) 00010000:00010000:0.0:1788572532.712922:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572532.712927:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572532.713074:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572532.713115:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.713119:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350997, next_transno: 347892350992 00000020:00080000:0.0:1788572532.713126:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.713128:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350997, next_transno: 347892350992 00000100:00100000:2.0:1788572532.725436:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572532.727038:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569535360 00000100:00100000:1.0:1788572532.727066:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569535360 00000100:00100000:1.0:1788572532.727192:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1332 00000100:00100000:1.0:1788572532.727206:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2396:x1875444569535360:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00080000:1.0:1788572532.727233:0:188048:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350992, current: 347892350992, replaying 00000100:00100000:1.0:1788572532.727253:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2396:x1875444569535360:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 51us (1828us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572532.727263:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1332 00000020:00080000:3.0:1788572532.727397:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.727406:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892350992, next_transno: 347892350992 00010000:00080000:3.0:1788572532.727412:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892350992) 00000020:00080000:3.0:1788572532.727416:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.727433:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569535360 t347892350992 from 192.168.202.57@tcp req@ffff8e5a31c82680 x1875444569535360/t0(347892350992) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 528/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572532.727671:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.727692:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.727708:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.727722:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.727730:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.727735:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.735418:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.735443:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.735452:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.735458:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572532.735463:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.735472:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.735516:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590d91e500) 00010000:00010000:3.0:1788572532.735520:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572532.735526:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.735533:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf950 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572532.735565:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000764f3013 reply state 000000007b7fe83a transno 347892350992 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.735580:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.735588:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18bebf00) 00010000:00010000:3.0:1788572532.735590:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572532.735594:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572532.735777:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572532.735808:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.735812:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350997, next_transno: 347892350993 00000020:00080000:3.0:1788572532.735820:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.735822:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350997, next_transno: 347892350993 00000100:00100000:0.0:1788572532.742283:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572532.743032:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569535872 00000100:00100000:3.0:1788572532.743050:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569535872 00000100:00100000:3.0:1788572532.743129:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1333 00000100:00100000:3.0:1788572532.743142:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:2396:x1875444569535872:12345-192.168.202.57@tcp:36:rm.0 00010000:00080000:3.0:1788572532.743170:0:188050:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350993, current: 347892350993, replaying 00000100:00100000:3.0:1788572532.743190:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:2396:x1875444569535872:12345-192.168.202.57@tcp:36:rm.0 Request processed in 51us (915us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572532.743198:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1333 00000020:00080000:3.0:1788572532.743222:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.743227:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892350993, next_transno: 347892350993 00010000:00080000:3.0:1788572532.744411:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892350993) 00000020:00080000:3.0:1788572532.744424:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.744443:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569535872 t347892350993 from 192.168.202.57@tcp req@ffff8e590cb0b480 x1875444569535872/t0(347892350993) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 512/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572532.744617:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.744637:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.744654:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.744671:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.744684:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.744692:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.744818:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 3/0,1 mode: --/EX res: [0x200027501:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.744826:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.744832:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.745118:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.745127:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.745135:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.745141:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572532.745147:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.745157:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.745175:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x6:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:3.0:1788572532.745180:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572532.745186:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 2/0,0 mode: --/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.745193:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dce800/0x265cfe11109bf96c lrc: 0/0,0 mode: --/EX res: [0x200027501:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.745225:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.746415:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.746435:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.746441:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572532.746446:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.746456:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.746471:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e590d91e500) 00010000:00010000:3.0:1788572532.746475:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572532.746492:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.746500:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf800/0x265cfe11109bf95e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572532.746526:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f345d97 reply state 00000000be10d4a2 transno 347892350993 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.746546:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.746554:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18bebf00) 00010000:00010000:3.0:1788572532.746557:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572532.746562:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572532.746768:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572532.746799:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.746803:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350997, next_transno: 347892350994 00000020:00080000:3.0:1788572532.746809:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.746812:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350997, next_transno: 347892350994 00000100:00100000:3.0:1788572532.752195:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572532.752290:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569564672 00000100:00100000:1.0:1788572532.752307:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569564672 00000100:00100000:1.0:1788572532.752380:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1334 00000100:00100000:1.0:1788572532.752393:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2396:x1875444569564672:12345-192.168.202.57@tcp:36:rm.0 00010000:00080000:1.0:1788572532.752415:0:196070:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350994, current: 347892351006, replaying 00000100:00100000:1.0:1788572532.752431:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2396:x1875444569564672:12345-192.168.202.57@tcp:36:rm.0 Request processed in 42us (253us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572532.752437:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1334 00000020:00080000:1.0:1788572532.752459:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572532.752462:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892350997, next_transno: 347892350994 00010000:00080000:1.0:1788572532.752467:0:201357:0:(ldlm_lib.c:2284:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 347892350994, ql: 2, comp: 0, conn: 2, next: 347892350997, next_update 0 last_committed: 347892350990) 00000020:00080000:1.0:1788572532.752471:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572532.752502:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444584423040 t347892350997 from 0@lo req@ffff8e5a40523100 x1875444584423040/t0(347892350997) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 416/0 e 0 to 0 dl 1788572543 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788572532.753265:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572532.753283:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572532.753286:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892350998 00000020:00080000:1.0:1788572532.753289:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572532.753291:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892350998 00000100:00080000:3.0:1788572532.753426:0:3640:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff8e590a2d0380 x1875444584423040/t347892350997(347892350997) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1788572548 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572532.753439:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788572532.753443:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350989 gen 2 00000100:00100000:3.0:1788572532.753448:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e590a2d0380 x1875444584423040/t347892350997(347892350997) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1788572548 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572532.753456:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a3f8c7800 from lustre-MDT0000_UUID committed 347892350989 last 347892350997 00000100:00080000:3.0:1788572532.753465:0:3640:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff8e5a4143b480 x1875444584423296/t347892350998(347892350998) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 1788572462 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572532.753509:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584423040:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572532.753535:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584423296:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572532.753592:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572532.754978:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584423296 00000100:00100000:1.0:1788572532.755061:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584423296 00000100:00100000:1.0:1788572532.755133:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:1.0:1788572532.755144:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3640:x1875444584423296:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1788572532.755163:0:188054:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350998, current: 347892350998, replaying 00000100:00100000:1.0:1788572532.755181:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3640:x1875444584423296:12345-0@lo:1000:osp_up0-1.0 Request processed in 40us (1590us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572532.755189:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000020:00080000:3.0:1788572532.755226:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.755247:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892350998, next_transno: 347892350998 00010000:00080000:3.0:1788572532.755254:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892350998) 00000020:00080000:3.0:1788572532.755257:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.755271:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444584423296 t347892350998 from 0@lo req@ffff8e5a1fdf5f80 x1875444584423296/t0(347892350998) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 744/0 e 0 to 0 dl 1788572543 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788572532.755646:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572532.755677:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.755680:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892350999 00000020:00080000:3.0:1788572532.755685:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.755687:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892350999 00000100:00080000:3.0:1788572532.755741:0:3640:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff8e5a4143b480 x1875444584423296/t347892350998(347892350998) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 1788572548 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572532.755750:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788572532.755766:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350989 gen 2 00000100:00100000:3.0:1788572532.755773:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e590a2d0380 x1875444584423040/t347892350997(347892350997) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1788572548 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572532.755780:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a3f8c7800 from lustre-MDT0000_UUID committed 347892350989 last 347892350998 00000100:00080000:3.0:1788572532.755788:0:3640:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff8e5a1ffa5180 x1875444584434048/t347892351002(347892351002) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1788572482 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572532.755800:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584423296:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572532.755819:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584434048:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572532.755857:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572532.756204:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584434048 00000100:00100000:0.0:1788572532.756214:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584434048 00000100:00100000:0.0:1788572532.757076:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1788572532.757092:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3640:x1875444584434048:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1788572532.757112:0:188053:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350999, current: 347892351002, replaying 00000100:00100000:0.0:1788572532.757130:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3640:x1875444584434048:12345-0@lo:1000:osp_up0-1.0 Request processed in 43us (1273us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572532.757138:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000020:00080000:3.0:1788572532.757217:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.757222:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892351002, next_transno: 347892350999 00010000:00080000:3.0:1788572532.757228:0:201357:0:(ldlm_lib.c:2284:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 347892350999, ql: 2, comp: 0, conn: 2, next: 347892351002, next_update 0 last_committed: 347892350990) 00000020:00080000:3.0:1788572532.757314:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.757325:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444584434048 t347892351002 from 0@lo req@ffff8e5a1fdf5c00 x1875444584434048/t0(347892351002) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 1312/0 e 0 to 0 dl 1788572543 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000001:00080000:0.0:1788572532.773438:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351002 is committed 00000001:00080000:0.0:1788572532.773516:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350993 is committed 00010000:00080000:3.0:1788572532.773982:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00010000:2.0:1788572532.774024:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788572532.774035:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.774044:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892351003 00010000:00010000:2.0:1788572532.774049:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788572532.774053:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.774058:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892351003 00010000:00010000:2.0:1788572532.774074:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774085:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572532.774094:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774104:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774133:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18bebf00) 00010000:00010000:2.0:1788572532.774136:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572532.774143:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774154:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ae00/0x265cfe11109bf942 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774179:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774185:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774191:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774197:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572532.774200:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774207:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774216:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18bebf00) 00010000:00010000:2.0:1788572532.774219:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572532.774222:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.774228:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bf957 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572532.775092:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351002 gen 2 00000004:00080000:0.0:1788572532.775105:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350997 committed transno 347892351002 00000004:00080000:0.0:1788572532.775134:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350998 committed transno 347892351002 00000004:00080000:0.0:1788572532.775144:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892351002 committed transno 347892351002 00000100:00100000:0.0:1788572532.775165:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5a1ffa6680 x1875444584434304/t347892351003(347892351003) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1788572482 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572532.775183:0:3640:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff8e5a1ffa5180 x1875444584434048/t347892351002(347892351002) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1788572548 ref 1 fl Interpret:RMQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572532.775193:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788572532.775195:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351002 gen 2 00000100:00100000:0.0:1788572532.775200:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5a1ffa6680 x1875444584434304/t347892351003(347892351003) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1788572482 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572532.775208:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a3f8c7800 from lustre-MDT0000_UUID committed 347892351002 last 347892351002 00000100:00080000:0.0:1788572532.775216:0:3640:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff8e5a1ffa6680 x1875444584434304/t347892351003(347892351003) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1788572482 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572532.775229:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584434048:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1788572532.775359:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.775368:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.775376:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.775383:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572532.775388:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.775396:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.775408:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a18bebf00) 00010000:00010000:2.0:1788572532.775411:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572532.775415:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.775422:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bf965 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572532.776648:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584434304:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572532.776764:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572532.777050:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584434304 00000100:00100000:2.0:1788572532.777062:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584434304 00000100:00100000:2.0:1788572532.777151:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1788572532.777163:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584434304:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:2.0:1788572532.777190:0:189111:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892351003, current: 347892351003, replaying 00000100:00100000:2.0:1788572532.777211:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584434304:12345-0@lo:1000:osp_up0-1.0 Request processed in 50us (458us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572532.777220:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000020:00080000:3.0:1788572532.784462:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.784474:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892351003, next_transno: 347892351003 00010000:00080000:3.0:1788572532.784503:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892351003) 00000020:00080000:3.0:1788572532.784508:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.784524:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444584434304 t347892351003 from 0@lo req@ffff8e590cb0aa00 x1875444584434304/t0(347892351003) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 1312/0 e 0 to 0 dl 1788572543 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000001:00080000:0.0:1788572532.787098:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351003 is committed 00010000:00080000:3.0:1788572532.787549:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572532.787585:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.787589:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892351004 00000020:00080000:3.0:1788572532.787594:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.787597:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892351004 00000100:00100000:2.0:1788572532.798552:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351003 gen 2 00000004:00080000:2.0:1788572532.798570:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892351003 committed transno 347892351003 00000100:00100000:2.0:1788572532.798599:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5a1ffa7800 x1875444584434560/t347892351004(347892351004) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1788572482 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572532.798618:0:3640:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff8e5a1ffa6680 x1875444584434304/t347892351003(347892351003) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1788572548 ref 1 fl Interpret:RMQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572532.798628:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788572532.798632:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351003 gen 2 00000100:00100000:2.0:1788572532.798636:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5a1ffa7800 x1875444584434560/t347892351004(347892351004) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1788572482 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572532.798645:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a3f8c7800 from lustre-MDT0000_UUID committed 347892351003 last 347892351003 00000100:00080000:2.0:1788572532.798654:0:3640:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff8e5a1ffa7800 x1875444584434560/t347892351004(347892351004) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1788572482 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572532.798669:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584434304:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788572532.798720:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584434560:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788572532.798845:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572532.803103:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584434560 00000100:00100000:0.0:1788572532.803130:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584434560 00000100:00100000:0.0:1788572532.803251:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1788572532.803267:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584434560:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1788572532.803296:0:188053:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892351004, current: 347892351004, replaying 00000100:00100000:0.0:1788572532.803322:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584434560:12345-0@lo:1000:osp_up0-1.0 Request processed in 60us (4483us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572532.803332:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000020:00080000:3.0:1788572532.803397:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.803407:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892351004, next_transno: 347892351004 00010000:00080000:3.0:1788572532.803413:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892351004) 00000020:00080000:3.0:1788572532.803417:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.803431:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444584434560 t347892351004 from 0@lo req@ffff8e5905f6f100 x1875444584434560/t0(347892351004) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 264/0 e 0 to 0 dl 1788572543 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788572532.806193:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572532.806227:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.806231:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892351005 00000020:00080000:3.0:1788572532.806237:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.806239:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351006, next_transno: 347892351005 00000100:00080000:2.0:1788572532.815090:0:3640:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff8e5a1ffa7800 x1875444584434560/t347892351004(347892351004) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1788572548 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572532.815111:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788572532.815114:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351003 gen 2 00000100:00100000:2.0:1788572532.815120:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5a1ffa7800 x1875444584434560/t347892351004(347892351004) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1788572548 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572532.815129:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a3f8c7800 from lustre-MDT0000_UUID committed 347892351003 last 347892351004 00000100:00080000:2.0:1788572532.815138:0:3640:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff8e5a3f99df80 x1875444584444288/t347892351009(347892351009) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 1788572506 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572532.815151:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584434560:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788572532.815182:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584444288:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788572532.815580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572532.818267:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584444288 00000100:00100000:3.0:1788572532.818284:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584444288 00000100:00100000:3.0:1788572532.818372:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1788572532.818388:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3640:x1875444584444288:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:3.0:1788572532.818411:0:188054:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892351005, current: 347892351009, replaying 00000100:00100000:3.0:1788572532.818431:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3640:x1875444584444288:12345-0@lo:1000:osp_up0-1.0 Request processed in 49us (2853us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572532.818439:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000020:00080000:2.0:1788572532.818468:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.818501:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892351006, next_transno: 347892351005 00010000:00080000:2.0:1788572532.818509:0:201357:0:(ldlm_lib.c:2284:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 347892351005, ql: 2, comp: 0, conn: 2, next: 347892351006, next_update 0 last_committed: 347892351003) 00000020:00080000:2.0:1788572532.818515:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.818534:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569564672 t347892351006 from 192.168.202.57@tcp req@ffff8e5a1fdf6300 x1875444569564672/t0(347892351006) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 512/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572532.818663:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.818685:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.818701:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.818721:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.818728:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.818736:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.818999:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 3/0,1 mode: --/EX res: [0x200027501:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.819013:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.819021:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572532.820169:0:201357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1788572532.820205:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.820215:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.820223:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.820229:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ba00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572532.822985:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823013:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823066:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x4:0x0].0x0 (ffff8e5a122fb900) 00010000:00010000:2.0:1788572532.823070:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572532.823078:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 2/0,0 mode: --/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823089:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf981 lrc: 0/0,0 mode: --/EX res: [0x200027501:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823139:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823148:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823155:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823162:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14aa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572532.823165:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823173:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823182:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fb400) 00010000:00010000:2.0:1788572532.823185:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572532.823188:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823194:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf973 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572532.823211:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b47ad03b reply state 000000000f488242 transno 347892351006 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823226:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.823248:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8e5a122fb600) 00010000:00010000:2.0:1788572532.823252:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572532.823256:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572532.823397:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572532.823430:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.823434:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351009, next_transno: 347892351007 00000020:00080000:2.0:1788572532.823442:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.823444:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351009, next_transno: 347892351007 00000100:00100000:0.0:1788572532.832266:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572532.832367:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569566464 00000100:00100000:2.0:1788572532.832380:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569566464 00000100:00100000:2.0:1788572532.832468:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1335 00000100:00100000:2.0:1788572532.832524:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2396:x1875444569566464:12345-192.168.202.57@tcp:36:lfs.0 00010000:00080000:2.0:1788572532.832553:0:198183:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892351007, current: 347892351007, replaying 00000100:00100000:2.0:1788572532.832575:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2396:x1875444569566464:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 98us (326us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572532.832583:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1335 00000020:00080000:3.0:1788572532.832627:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.832636:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892351007, next_transno: 347892351007 00010000:00080000:3.0:1788572532.832643:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892351007) 00000020:00080000:3.0:1788572532.832647:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.832667:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569566464 t347892351007 from 192.168.202.57@tcp req@ffff8e590cb08380 x1875444569566464/t0(347892351007) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 568/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572532.835848:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.835897:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.835922:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.835943:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.835950:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.835957:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836686:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 3/0,1 mode: --/PW res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836701:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836710:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572532.836729:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd58d21d reply state 00000000ac01da2a transno 347892351007 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836743:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836750:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e5a18beb700) 00010000:00010000:0.0:1788572532.836754:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572532.836759:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788572532.836765:0:201357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1788572532.836773:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836780:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836787:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836793:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ba00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.836798:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836806:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836816:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a18beb900) 00010000:00010000:0.0:1788572532.836819:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.836823:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836830:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf988 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572532.836852:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd58d21d reply state 00000000ac01da2a transno 347892351007 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836860:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.836870:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e5a18beb800) 00010000:00010000:0.0:1788572532.836873:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572532.836874:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00080000:0.0:1788572532.837033:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572532.837063:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.837067:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351009, next_transno: 347892351008 00000020:00080000:0.0:1788572532.837074:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.837076:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351009, next_transno: 347892351008 00000100:00100000:1.0:1788572532.841791:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572532.841937:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569568512 00000100:00100000:3.0:1788572532.841953:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569568512 00000100:00100000:3.0:1788572532.842041:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1336 00000100:00100000:3.0:1788572532.842056:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:2396:x1875444569568512:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00080000:3.0:1788572532.842079:0:188050:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892351008, current: 347892351010, replaying 00000100:00100000:3.0:1788572532.842224:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:2396:x1875444569568512:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 171us (444us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572532.842232:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1336 00000020:00080000:2.0:1788572532.842348:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.842355:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 347892351009, next_transno: 347892351008 00010000:00080000:2.0:1788572532.842363:0:201357:0:(ldlm_lib.c:2284:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 347892351008, ql: 2, comp: 0, conn: 2, next: 347892351009, next_update 0 last_committed: 347892351003) 00000020:00080000:2.0:1788572532.842369:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.842383:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444584444288 t347892351009 from 0@lo req@ffff8e5905f6ed80 x1875444584444288/t0(347892351009) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 2520/0 e 0 to 0 dl 1788572543 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788572532.843068:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572532.843099:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.843102:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892351010, next_transno: 347892351010 00010000:00080000:2.0:1788572532.843106:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892351010) 00000020:00080000:2.0:1788572532.843109:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.843122:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569568512 t347892351010 from 192.168.202.57@tcp req@ffff8e5a40521500 x1875444569568512/t0(347892351010) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 528/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572532.843147:0:3640:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff8e5a3f99df80 x1875444584444288/t347892351009(347892351009) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 1788572548 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572532.843159:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788572532.843162:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351003 gen 2 00000100:00100000:3.0:1788572532.843169:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5a1ffa7800 x1875444584434560/t347892351004(347892351004) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1788572548 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572532.843176:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e5a3f8c7800 from lustre-MDT0000_UUID committed 347892351003 last 347892351009 00000100:00080000:3.0:1788572532.843181:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00010000:2.0:1788572532.843291:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.843312:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.843327:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.843340:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.843347:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.843353:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.844293:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.844307:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.844315:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.844322:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14aa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572532.844326:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.844335:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.844352:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fb400) 00010000:00010000:3.0:1788572532.844355:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572532.844361:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.844367:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf99d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572532.844391:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031f945b0 reply state 0000000049d34e5f transno 347892351010 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.844404:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572532.844411:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a122fb900) 00010000:00010000:3.0:1788572532.844413:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572532.844417:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572532.844556:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572532.844584:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.844588:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 347892351011 00000020:00080000:3.0:1788572532.844593:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572532.844595:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 347892351011 00000100:00100000:3.0:1788572532.848410:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584444288:0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1788572532.853263:0:201620:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1788572532.853272:0:201620:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1788572532.853278:0:201620:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:1.0:1788572532.854995:0:201620:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bef0f expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572532.855104:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584479360:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1788572532.855176:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788572532.855288:0:201620:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:2.0:1788572532.857371:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584479360 00000100:00100000:2.0:1788572532.857392:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584479360 00000100:00100000:2.0:1788572532.857532:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1788572532.857547:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3640:x1875444584479360:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788572532.857586:0:189111:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8e5a1fdf7480 x1875444584479360/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 328/0 e 0 to 0 dl 1788572543 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572532.857613:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3640:x1875444584479360:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 70us (2437us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572532.857621:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000020:00080000:1.0:1788572532.857637:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572532.857647:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892351011 00000100:00100000:3.0:1788572532.860067:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572532.860249:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569569024 00000100:00100000:1.0:1788572532.860261:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569569024 00000100:00100000:1.0:1788572532.860323:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1337 00000100:00100000:1.0:1788572532.860334:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2396:x1875444569569024:12345-192.168.202.57@tcp:36:rm.0 00010000:00080000:1.0:1788572532.860354:0:196070:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892351011, current: 347892351011, replaying 00000100:00100000:1.0:1788572532.860368:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2396:x1875444569569024:12345-192.168.202.57@tcp:36:rm.0 Request processed in 36us (310us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572532.860375:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1337 00000020:00080000:1.0:1788572532.860398:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572532.860402:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 347892351011, next_transno: 347892351011 00010000:00080000:1.0:1788572532.860407:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892351011) 00000020:00080000:1.0:1788572532.860410:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572532.860420:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569569024 t347892351011 from 192.168.202.57@tcp req@ffff8e5a1fdf4700 x1875444569569024/t0(347892351011) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 512/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572532.860536:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860552:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860566:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860577:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860584:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860589:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860712:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 3/0,1 mode: --/EX res: [0x200027501:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860720:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860727:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860940:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860948:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860955:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860961:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572532.860966:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.860975:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861186:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x8:0x0].0x0 (ffff8e5a36d24800) 00010000:00010000:1.0:1788572532.861190:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572532.861196:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 2/0,0 mode: --/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861203:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255a00/0x265cfe11109bf9b9 lrc: 0/0,0 mode: --/EX res: [0x200027501:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861228:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861235:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861241:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861246:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572532.861250:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861260:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861268:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a36d24d00) 00010000:00010000:1.0:1788572532.861271:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572532.861274:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861280:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255e00/0x265cfe11109bf9ab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572532.861291:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b900c058 reply state 00000000464e8013 transno 347892351011 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861304:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572532.861310:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a122fb900) 00010000:00010000:1.0:1788572532.861312:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572532.861315:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572532.861395:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572532.861540:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572532.861544:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892351012 00000020:00080000:1.0:1788572532.861548:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572532.861550:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892351012 00000100:00100000:2.0:1788572532.864094:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572532.864215:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569571200 00000100:00100000:1.0:1788572532.864230:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569571200 00000100:00100000:1.0:1788572532.864291:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1338 00000100:00100000:1.0:1788572532.864302:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:2396:x1875444569571200:12345-192.168.202.57@tcp:36:mcreate.0 00010000:00080000:1.0:1788572532.864322:0:188048:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892351012, current: 347892351012, replaying 00000100:00100000:1.0:1788572532.864347:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:2396:x1875444569571200:12345-192.168.202.57@tcp:36:mcreate.0 Request processed in 47us (268us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572532.864354:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1338 00000020:00080000:0.0:1788572532.864428:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.864435:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 347892351012, next_transno: 347892351012 00010000:00080000:0.0:1788572532.864441:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892351012) 00000020:00080000:0.0:1788572532.864447:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.864462:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569571200 t347892351012 from 192.168.202.57@tcp req@ffff8e5905f6e300 x1875444569571200/t0(347892351012) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 528/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572532.864687:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.864707:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.864723:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.864737:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.864746:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.864757:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.865283:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.865294:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.865302:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.865308:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ba00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.865313:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.865322:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.865337:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a18beb900) 00010000:00010000:0.0:1788572532.865341:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.865346:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.865353:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7ba00/0x265cfe11109bf9c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572532.865374:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b959b76 reply state 00000000b5f337be transno 347892351012 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.865387:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.865395:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a122fb900) 00010000:00010000:0.0:1788572532.865397:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572532.865400:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572532.865546:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572532.865573:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.865577:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892351013 00000020:00080000:0.0:1788572532.865581:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572532.865584:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892351013 00000100:00100000:1.0:1788572532.884029:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572532.884155:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569571712 00000100:00100000:2.0:1788572532.884173:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569571712 00000100:00100000:2.0:1788572532.884268:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1339 00000100:00100000:2.0:1788572532.884284:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+16:2396:x1875444569571712:12345-192.168.202.57@tcp:36:rm.0 00010000:00080000:2.0:1788572532.884317:0:188050:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892351013, current: 347892351013, replaying 00000100:00100000:2.0:1788572532.884337:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+16:2396:x1875444569571712:12345-192.168.202.57@tcp:36:rm.0 Request processed in 57us (320us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572532.884345:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1339 00000020:00080000:2.0:1788572532.884372:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.884378:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 347892351013, next_transno: 347892351013 00010000:00080000:2.0:1788572532.884384:0:201357:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892351013) 00000020:00080000:2.0:1788572532.884387:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.884404:0:201357:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875444569571712 t347892351013 from 192.168.202.57@tcp req@ffff8e5a40522a00 x1875444569571712/t0(347892351013) o36->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 512/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572532.884560:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.884581:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.884596:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.884611:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.884620:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.884632:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.884770:0:201357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 3/0,1 mode: --/EX res: [0x200027501:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.884780:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.884787:0:201357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885091:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885101:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885110:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885117:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14aa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572532.885122:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885132:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885149:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x9:0x0].0x0 (ffff8e5a122fb100) 00010000:00010000:2.0:1788572532.885152:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572532.885159:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 2/0,0 mode: --/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885167:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109bf9dc lrc: 0/0,0 mode: --/EX res: [0x200027501:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885197:0:201357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885204:0:201357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885209:0:201357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885214:0:201357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572532.885217:0:201357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885223:0:201357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885230:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fb200) 00010000:00010000:2.0:1788572532.885232:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572532.885235:0:201357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885240:0:201357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109bf9ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572532.885252:0:201357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f845244 reply state 00000000141f1876 transno 347892351013 ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885264:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.885271:0:201357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a122fb900) 00010000:00010000:2.0:1788572532.885273:0:201357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572532.885276:0:201357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572532.885388:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572532.885583:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.885587:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892351014 00000020:00080000:2.0:1788572532.885591:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.885593:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892351014 00000100:00100000:0.0:1788572532.893033:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572532.893089:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569578496 00000100:00100000:0.0:1788572532.893103:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569578496 00000100:00100000:0.0:1788572532.893179:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 548 00000100:00100000:0.0:1788572532.893191:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+18:2396:x1875444569578496:12345-192.168.202.57@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788572532.893223:0:196070:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e590cb0b800 x1875444569578496/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 224/0 e 0 to 0 dl 1788572557 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572532.893254:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+18:2396:x1875444569578496:12345-192.168.202.57@tcp:400:ldlm_lock_repla.0 Request processed in 66us (237us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572532.893262:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 548 00000020:00080000:2.0:1788572532.896067:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.896082:0:201357:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 347892351014 00010000:00080000:2.0:1788572532.896087:0:201357:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788572532.896092:0:201357:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572532.896103:0:201357:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788572532.896106:0:201357:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788572532.896124:0:201357:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff8e5a1fdf7480 x1875444584479360/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 328/0 e 0 to 0 dl 1788572543 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572532.896161:0:201357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572532.896215:0:201357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf9e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bef08 expref: -99 pid: 201357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.896263:0:201357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bef08 expref: 9 pid: 201357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.896280:0:201357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bef08 expref: 9 pid: 201357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572532.896290:0:201357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a00030400, rc 0) 00010000:00080000:2.0:1788572532.896420:0:201357:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572532.896437:0:201357:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00010000:0.0:1788572532.896588:0:3640:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf9e3 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788572532.896602:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1788572532.896641:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584479360:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1788572532.896677:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584479488:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1788572532.896731:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572532.898167:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584479488 00000100:00100000:2.0:1788572532.898180:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584479488 00000100:00100000:2.0:1788572532.898253:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1788572532.898268:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3640:x1875444584479488:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1788572532.898293:0:188054:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e5a1ffa5180 x1875444584479488/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 224/0 e 0 to 0 dl 1788572543 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572532.898312:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3640:x1875444584479488:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 49us (1581us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572532.898320:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00010000:00080000:2.0:1788572532.898343:0:201357:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1788572532.898536:0:201357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 82, last_transno is 352187318272 00000001:00100000:2.0:1788572532.901068:0:201325:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788572532.901082:0:201325:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:2.0:1788572532.901146:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351013 is committed 00000001:00080000:2.0:1788572532.901168:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892351009 is committed 00000001:00080000:2.0:1788572532.901217:0:201357:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788572532.901272:0:201357:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1788572532.901294:0:201357:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.202.57@tcp: req@ffff8e590cb0b800 x1875444569578496/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:207/0 lens 224/0 e 0 to 0 dl 1788572557 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788572532.901439:0:201357:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8e5a1ffa5180 x1875444584479488/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:193/0 lens 224/0 e 0 to 0 dl 1788572543 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788572532.901689:0:201357:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:2.0:1788572532.902738:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351009 gen 2 00000004:00080000:2.0:1788572532.902751:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892351004 committed transno 347892351009 00000020:00080000:2.0:1788572532.902759:0:3640:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e59056d1900 refcount 2 committed 0 result 0 batchid 21474837550 00000020:00080000:2.0:1788572532.902765:0:3640:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a05572900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8e59056d13c0 00000020:00080000:2.0:1788572532.902769:0:3640:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027cd1:0x1:0x0].1 00000020:00080000:2.0:1788572532.902773:0:3640:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a05572500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e590a1e4a00 00000020:00080000:2.0:1788572532.902776:0:3640:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].1 00000004:00080000:2.0:1788572532.902857:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892351009 committed transno 347892351009 00000020:00080000:2.0:1788572532.902862:0:3640:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e5905129180 refcount 2 committed 0 result 0 batchid 21474837551 00000020:00080000:2.0:1788572532.902865:0:3640:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a40e0a700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8e59051293c0 00000020:00080000:2.0:1788572532.902868:0:3640:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027cd1:0x1:0x0].2 00000020:00080000:2.0:1788572532.902870:0:3640:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a40e0aa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5904b86600 00000020:00080000:2.0:1788572532.902873:0:3640:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].2 00000100:00080000:2.0:1788572532.902894:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788572532.902906:0:3640:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8e5a1ffa6680 x1875444584479488/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572548 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572532.902931:0:3640:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8e5a1ffa6680 x1875444584479488/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572548 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572532.902939:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788572532.902955:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1788572532.902962:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008a9c660a): req@ffff8e5a31c83800 x1875444584458624/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572532.902984:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008a9c660a): req@ffff8e590d8ae300 x1875444584456960/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572516 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572532.902993:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584479488:0@lo:400:ptlrpcd_rcv.0 00000020:00080000:2.0:1788572532.903028:0:198981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 21474837551 committed batchid 17179873001 00000020:00080000:2.0:1788572532.903137:0:198981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000100:00100000:2.0:1788572532.903347:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572532.903364:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584479616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572532.903448:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572532.904748:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904768:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904777:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904784:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14be00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.904790:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904800:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904823:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8e5a122fb600) 00010000:00010000:0.0:1788572532.904827:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.904833:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904839:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14be00/0x265cfe11109bf97a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904896:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904904:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904919:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904926:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.904929:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904936:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904947:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e5a18beb800) 00010000:00010000:0.0:1788572532.904951:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.904954:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904961:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a200/0x265cfe11109bf98f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904983:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904990:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 2/0,0 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.904996:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905000:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.905003:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905008:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 4/0,0 mode: TXN/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905021:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e5a18beb700) 00010000:00010000:0.0:1788572532.905023:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.905027:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 2/0,0 mode: --/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905032:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7a600/0x265cfe11109bf996 lrc: 0/0,0 mode: --/TXN res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905049:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905055:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905060:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905065:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ba00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.905068:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905073:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905081:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a122fb900) 00010000:00010000:0.0:1788572532.905084:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.905087:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905093:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ba00/0x265cfe11109bf9a4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905274:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905281:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905288:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905293:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.905296:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905303:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905314:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a122fb900) 00010000:00010000:0.0:1788572532.905316:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.905319:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905325:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a11255c00/0x265cfe11109bf9b2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905336:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905342:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905348:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905354:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7bc00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.905357:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905362:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905373:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a122fb900) 00010000:00010000:0.0:1788572532.905374:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.905377:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905382:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5904a7bc00/0x265cfe11109bf9c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905392:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905398:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905404:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905409:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572532.905411:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905416:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905428:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d7d3e98 (ffff8e5a122fb900) 00010000:00010000:0.0:1788572532.905433:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572532.905436:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572532.905443:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14ae00/0x265cfe11109bf9d5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d7d3e98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572532.905629:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572532.907635:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584458624 00000100:00100000:0.0:1788572532.907654:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584458624 00000100:00100000:0.0:1788572532.907808:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4685 00000100:00100000:0.0:1788572532.907822:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:0:x1875444584458624:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1788572532.907843:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572532.907846:0:6504:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 265cfe11109bf62b) 00010000:00010000:0.0:1788572532.907849:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572532.907952:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:0:x1875444584458624:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 133us (2326us total) trans 0 rc 116/116 00000100:00100000:0.0:1788572532.907959:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4685 00000020:00080000:2.0:1788572532.908292:0:198961:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 21474837551 batchid updated 00000001:00100000:2.0:1788572532.908313:0:198961:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1788572532.908333:0:198981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000100:00100000:0.0:1788572532.911646:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572532.912683:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1875444584458624:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1788572532.915579:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584479616 00000100:00100000:3.0:1788572532.915602:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584479616 00000100:00100000:3.0:1788572532.915704:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584456960 00000100:00100000:3.0:1788572532.915708:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584456960 00000100:00100000:3.0:1788572532.915797:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1788572532.915813:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584479616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572532.916177:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445572608 avail 1299333120 00000100:00100000:3.0:1788572532.916363:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584479616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 552us (12914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572532.916372:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1788572532.916403:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1788572532.916410:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3642:x1875444584456960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572532.916423:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445572608 avail 1299333120 00000100:00100000:3.0:1788572532.916454:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3642:x1875444584456960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (4819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572532.916459:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1788572532.916633:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584479616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572532.916677:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584456960:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1788572532.955837:0:201357:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaac787f2be10 00100000:10000000:2.0:1788572532.955872:0:201357:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1788572532.968274:0:201345:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1989:0x0] 00000004:00080000:1.0:1788572532.968277:0:201343:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x1a22:0x0] 00000100:00100000:2.0:1788572532.968374:0:201345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:201345:1875444584479744:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788572532.968375:0:201343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:201343:1875444584479872:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788572532.976302:0:201343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572532.976365:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584479872 00000100:00100000:1.0:1788572532.976375:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584479872 00000100:00100000:1.0:1788572532.976422:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22725 00000100:00100000:1.0:1788572532.976432:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:201343:x1875444584479872:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788572532.976467:0:43920:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6753 -> diff = -63 00002000:02000040:1.0:1788572532.976473:0:43920:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6691 to 0x280000401:6753) 00000100:00100000:2.0:1788572532.982864:0:201345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572532.982953:0:201345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a272cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572532.983014:0:43924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584479744 00000100:00100000:2.0:1788572532.983027:0:43924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584479744 00000100:00100000:2.0:1788572532.983233:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22726 00000100:00100000:2.0:1788572532.983248:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f99df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:201345:x1875444584479744:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788572532.983301:0:43924:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6721 -> diff = -184 00002000:02000040:2.0:1788572532.983308:0:43924:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6538 to 0x2c0000401:6721) 00002000:00010000:1.0:1788572533.004311:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.004328:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.004347:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a61:0x0].0x0 since=9285s v=(0 0) 00010000:00010000:1.0:1788572533.004352:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.004358:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.004378:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.004396:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.004404:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.004431:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572533.005064:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.005070:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.005080:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a60:0x0].0x0 since=9285s v=(0 0) 00010000:00010000:1.0:1788572533.005083:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.005088:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.006219:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.006237:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.006245:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.006283:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572533.006325:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572533.006342:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006358:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572533.006364:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006378:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572533.006389:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.006399:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006407:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.006411:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5f:0x0].0x0 since=9285s v=(0 0) 00010000:00010000:1.0:1788572533.006429:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.006444:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006449:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000023ac4ad/0x265cfe11109bf9ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006517:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572533.006521:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006529:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572533.006533:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006541:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006552:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006558:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cafecc46/0x265cfe11109bf9f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.006572:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572533.006574:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572533.006576:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.007666:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.007682:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.007689:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.007716:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572533.007819:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.007825:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.007836:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5e:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.007842:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.007849:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.007860:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.007868:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.007877:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008153:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572533.008202:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.008208:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008216:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5d:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.008220:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.008224:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008234:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008243:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008250:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008274:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572533.008313:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.008318:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008327:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5c:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.008330:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.008333:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008341:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008348:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008355:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008373:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788572533.008409:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.008414:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008423:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5b:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.008426:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.008430:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008439:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008447:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008455:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.008463:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788572533.009385:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788572533.009394:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.009405:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572533.009409:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.009419:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.009441:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.009449:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059bfb543/0x265cfe11109bf9f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009598:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572533.009613:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009625:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11255000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.009629:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009642:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009662:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009669:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da61982/0x265cfe11109bf9ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009696:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572533.009699:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009706:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.009708:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009715:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009724:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009731:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd2523d/0x265cfe11109bfa06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009773:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572533.009777:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009783:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.009786:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009794:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009803:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009810:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000624a967f/0x265cfe11109bfa0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009824:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.009827:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009834:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.009837:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009849:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009858:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009866:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2118e3c/0x265cfe11109bfa14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.009879:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.009881:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.009883:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.010599:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.011882:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.011891:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.011894:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.011919:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.011951:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.013414:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.013428:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.013450:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5a:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.013455:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.013463:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.016254:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.016275:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.016285:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.016312:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572533.019281:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.019306:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019330:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a59:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.019337:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a59:0x0].0x0 since=0s v=(0 0) 00000001:00100000:1.0:1788572533.019344:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788572533.019345:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019373:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019389:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019399:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019437:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788572533.019598:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.019605:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019614:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a58:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.019618:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.019622:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019631:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019640:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019648:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019663:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788572533.019707:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.019712:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019721:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a57:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.019724:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.019728:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019737:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019746:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019753:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019772:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788572533.019788:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572533.019798:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019807:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7bc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.019812:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019822:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019841:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019850:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdc30a61/0x265cfe11109bfa1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019875:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572533.019880:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019887:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.019890:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019898:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019917:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019924:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9edb2b0/0x265cfe11109bfa22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019936:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572533.019940:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019946:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.019950:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019959:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019974:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019981:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e514d65c/0x265cfe11109bfa29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.019994:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.019997:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.020004:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ba00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.020006:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.020014:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.020023:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.020031:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8e71e12/0x265cfe11109bfa30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.020043:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.020045:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.020048:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.020073:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.021765:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.021781:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.022442:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.022458:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.023745:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a56:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.023753:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.023767:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.023791:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.023806:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.023814:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.023875:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572533.023890:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.023897:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.023906:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b400 already unused, calling callback (ffffffffc0c114f0) 00000100:00100000:1.0:1788572533.025546:0:201343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5901a9fe40 going to sleep for 10 seconds 00010000:00010000:0.0:1788572533.025556:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.025582:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.025608:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.025617:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001672921d/0x265cfe11109bfa37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.025653:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.025655:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.025658:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.025825:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.025832:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.025846:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a55:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.025852:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.025859:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.025872:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.025881:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.025891:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028259:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572533.028260:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572533.028283:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.028301:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572533.028308:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.028321:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.028352:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.028360:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080995b21/0x265cfe11109bfa3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.028391:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.028394:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.028396:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.028463:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.028751:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028771:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a54:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.028777:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.028784:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028800:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028811:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028820:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028839:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572533.028851:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.028857:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028866:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.028871:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028880:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028894:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.028902:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099742eff/0x265cfe11109bfa45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.030246:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.030253:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.030256:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.030421:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.030431:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.030451:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a53:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.030456:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.030463:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.032296:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.032315:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.032322:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.032384:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572533.032402:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.032410:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.032419:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7be00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.032425:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.032442:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.032464:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.032472:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5fa8ae/0x265cfe11109bfa4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.032524:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.032527:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.032529:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.033287:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.033298:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033313:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a52:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.033318:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.033325:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033337:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033347:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033354:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033382:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572533.033453:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.033460:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033507:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a51:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.033510:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.033515:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033526:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033535:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033543:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033559:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572533.033570:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572533.033576:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033584:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.033589:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033599:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033612:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033619:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002d249d2/0x265cfe11109bfa53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033639:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.033643:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033650:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.033654:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033662:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033672:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033679:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e447316/0x265cfe11109bfa5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033692:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.033694:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.033697:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.033755:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.033762:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.033770:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033779:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a50:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.033783:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.033787:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033796:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033803:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033810:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033830:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572533.033878:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.033883:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033890:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4f:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.033893:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.033897:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033906:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033926:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033935:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033950:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572533.033960:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572533.033971:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033978:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.033982:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.033990:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.034001:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.034009:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006929efc4/0x265cfe11109bfa61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.034025:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.034029:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.034040:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7b600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.034055:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.034063:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.034073:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.034081:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bf9e4f0/0x265cfe11109bfa68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.034094:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.034270:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.037677:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.037684:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.037906:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788572533.040267:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.040286:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.040310:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a41:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.040316:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.040324:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.040353:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.040365:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.040375:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.040400:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572533.040652:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040663:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4e:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.040667:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.040672:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040683:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040693:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040701:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040747:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.040757:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040766:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.040772:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040783:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040804:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040812:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0459297/0x265cfe11109bfa76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040845:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.040848:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.040850:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.040865:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572533.040875:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.040879:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040887:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7ae00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.040890:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040899:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040922:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040930:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed34dd42/0x265cfe11109bfa6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.040948:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.040950:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.040952:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.041255:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.041263:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041273:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a40:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.041277:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.041282:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041293:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041301:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041314:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041337:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572533.041386:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.041392:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041401:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3f:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.041404:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.041408:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041417:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041425:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041433:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.041451:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788572533.042288:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.042299:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.042314:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4d:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.042317:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.042323:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.042336:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.042346:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.042355:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.042372:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788572533.042385:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572533.042391:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.042399:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.042404:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.042413:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.042429:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.042443:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a2ef00d/0x265cfe11109bfa7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572533.042691:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.042699:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042709:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3e:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.042712:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.042716:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042726:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042734:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042740:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042756:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788572533.042814:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.042819:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042828:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3d:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.042831:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.042835:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042844:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042852:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042859:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.042873:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788572533.043339:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572533.043348:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043357:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.043362:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043370:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043384:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043391:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a22b5fdf/0x265cfe11109bfa84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043412:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572533.043417:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043424:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7aa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.043428:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043436:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043447:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043454:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021db0b84/0x265cfe11109bfa8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043497:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572533.043502:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043509:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.043512:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043519:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043530:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043537:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fc507e1/0x265cfe11109bfa92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043552:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.043556:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043562:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00030200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.043566:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043574:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043584:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043590:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e0b15c2/0x265cfe11109bfa99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.043603:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.043605:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.043607:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.043619:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.043625:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.043711:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.043716:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572533.044292:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.044302:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.044314:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3c:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.044318:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.044325:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.044338:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.044349:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.044357:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.044397:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572533.045212:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.045224:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045238:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3b:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.045242:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.045248:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045261:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045271:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045280:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045305:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788572533.045389:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.045397:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045407:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3a:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.045412:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.045416:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045426:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045434:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045442:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045457:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788572533.045548:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.045554:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045562:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a39:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.045565:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.045569:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045580:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045589:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045598:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045610:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788572533.045668:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.045673:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045682:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a38:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.045685:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.045689:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045699:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045706:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045713:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.045723:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788572533.045856:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4c:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.045862:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.045868:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.045881:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.045891:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.045898:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.045938:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572533.045947:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.045956:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.045962:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.045972:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.045998:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.046007:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4699137/0x265cfe11109bfaa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.046055:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572533.046060:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.046068:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a00031a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.046072:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.046081:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.046092:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047221:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b511be74/0x265cfe11109bfaae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047253:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572533.047258:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047267:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ae00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.047271:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047282:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047301:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047310:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9a2ffb8/0x265cfe11109bfab5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047325:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572533.047329:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047336:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ba00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.047340:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047347:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047357:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047366:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015c67fc6/0x265cfe11109bfabc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047381:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.047385:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047392:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14be00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.047395:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047403:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047413:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047421:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b21cc0/0x265cfe11109bfac3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.047434:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.047436:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.047439:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.047451:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.048715:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.048727:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.048747:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a37:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.048752:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.048760:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.048777:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.048788:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.048796:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.048827:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572533.048884:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.048889:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.048898:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a36:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.048901:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.048905:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.048979:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.048989:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.048997:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.049003:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049013:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049031:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049039:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb52490/0x265cfe11109bfaca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049080:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.049082:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.049084:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.049091:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.049572:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572533.049585:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.049604:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049613:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5904a7a800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.049618:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049633:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049649:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049657:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e477c810/0x265cfe11109bfaa0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049680:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.049682:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.049684:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.049781:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.049787:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049799:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4b:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.049802:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.049807:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049819:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049827:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049837:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049851:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572533.049858:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.049862:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049869:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.049872:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049879:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049890:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049897:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3a4de0/0x265cfe11109bfad8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049921:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.049923:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.049925:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572533.049976:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.049981:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.049990:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4a:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.049993:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.049997:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.050006:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.050013:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.050020:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.050032:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572533.050039:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.050043:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.050050:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.050053:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.050060:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.050070:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.050077:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a622675/0x265cfe11109bfadf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.050090:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.050092:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.050094:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.051824:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.051842:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.051851:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572533.051979:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572533.052066:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:0.0:1788572533.052762:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572533.052773:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.052788:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a49:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:0.0:1788572533.052794:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572533.052801:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.052813:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.052823:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.052831:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.052850:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572533.052863:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572533.052870:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.052879:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572533.052884:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.052894:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572533.053998:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569578624 00000100:00100000:1.0:1788572533.054019:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569578624 00000100:00100000:1.0:1788572533.054088:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 75 00000100:00100000:1.0:1788572533.054177:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569578624:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572533.054273:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569578624:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 174us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572533.054280:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 75 00010000:00010000:2.0:1788572533.055307:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.055323:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572533.055348:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569578752 00000100:00100000:2.0:1788572533.055362:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569578752 00000100:00100000:2.0:1788572533.055458:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 549 00000100:00100000:2.0:1788572533.055503:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569578752:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:2.0:1788572533.055544:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5906a01f80 x1875444569578752/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:208/0 lens 224/224 e 0 to 0 dl 1788572558 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572533.055620:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569578752:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 151us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572533.055628:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 549 00010000:00010000:2.0:1788572533.055678:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572533.055846:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.055855:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.055876:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a35:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.055883:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.055891:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.055920:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.055932:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.055940:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.055957:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788572533.056002:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.056008:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056016:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a34:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.056019:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.056023:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056032:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056040:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056048:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056063:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788572533.056072:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572533.056078:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056088:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14aa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.056093:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056115:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056136:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056144:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003baca950/0x265cfe11109bfad1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056172:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572533.056177:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056190:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.056193:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056202:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056212:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056219:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f84aef/0x265cfe11109bfaed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056230:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.056233:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056240:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.056243:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056250:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056258:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056265:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fe47cf9/0x265cfe11109bfaf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056275:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056277:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056278:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.056324:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.056328:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056336:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a33:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.056339:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.056343:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056352:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056359:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056366:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056379:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572533.056387:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.056391:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056397:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.056401:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056408:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056417:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056424:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d41b6055/0x265cfe11109bfafb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056437:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056438:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056440:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.056506:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.056511:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056518:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a32:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.056521:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.056525:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056539:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056547:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056553:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056566:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572533.056572:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.056576:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056582:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.056585:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056593:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056603:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056610:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721114dd/0x265cfe11109bfb02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056625:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056626:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056628:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.056671:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.056676:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056684:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a31:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.056686:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.056690:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056699:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056708:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056715:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056728:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572533.056734:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.056738:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056750:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.056753:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056761:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056771:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056779:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aba74e8a/0x265cfe11109bfb09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056792:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056794:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056795:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.056843:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.056848:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056856:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a30:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.056858:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.056863:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056872:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056881:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056889:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056901:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572533.056919:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.056922:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056929:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.056932:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056940:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056951:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056959:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018430ad3/0x265cfe11109bfb10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.056975:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056977:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.056979:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.057028:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.057033:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057039:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2f:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.057042:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.057046:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057054:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057061:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057068:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057079:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572533.057085:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.057089:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057095:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.057098:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057112:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057123:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057130:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c559550/0x265cfe11109bfb17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057145:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057146:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057148:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.057190:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.057194:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057202:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2e:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.057205:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.057210:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057219:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057227:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057236:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057248:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572533.057255:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.057258:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057264:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.057267:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057274:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057285:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057292:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d5db0e/0x265cfe11109bfb1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057307:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057310:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057311:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.057356:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.057362:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057369:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2d:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.057372:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.057375:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057383:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057391:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057398:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057408:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572533.057414:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.057417:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057424:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.057427:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057434:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057443:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057450:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109bfb25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057463:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057465:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057467:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.057536:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.057541:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057548:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2c:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.057551:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.057555:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057563:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057570:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057576:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057589:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572533.057595:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.057599:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057605:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.057608:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057615:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057625:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057633:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bc003b0/0x265cfe11109bfb2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057648:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057650:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057651:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.057696:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.057701:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057710:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2b:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.057713:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.057718:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057727:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057735:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057743:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057755:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572533.057760:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.057764:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057770:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.057774:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057782:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057792:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057805:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007484ef31/0x265cfe11109bfb33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057820:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057821:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.057823:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572533.057868:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572533.057873:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057882:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2a:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:2.0:1788572533.057884:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572533.057888:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057898:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.057905:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.058747:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.058762:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004805c810/0x265cfe11109bfae6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572533.061721:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.061735:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.061767:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.061770:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572533.061772:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572533.068035:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788572533.072708:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788572533.073607:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788572533.073940:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572533.074205:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572533.074216:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074236:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a29:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:3.0:1788572533.074242:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572533.074250:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074269:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074280:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074289:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074308:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788572533.074372:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572533.074379:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074419:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a28:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:3.0:1788572533.074433:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572533.074445:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074464:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074576:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074585:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074609:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788572533.074669:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572533.074676:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074685:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a27:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:3.0:1788572533.074688:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572533.074693:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074704:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074714:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074729:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074747:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788572533.074803:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572533.074809:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074817:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a26:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:3.0:1788572533.074820:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572533.074824:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074834:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074843:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074850:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074865:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788572533.074906:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572533.074924:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074933:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a25:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:3.0:1788572533.074936:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572533.074940:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074949:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074958:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074966:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.074977:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788572533.075034:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572533.075041:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.075049:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a24:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:3.0:1788572533.075052:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572533.075056:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.075070:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.075082:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.075089:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076561:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788572533.076688:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572533.076697:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076717:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a23:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:3.0:1788572533.076722:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572533.076729:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076746:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076757:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076765:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076781:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788572533.076823:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572533.076829:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076838:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a22:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:3.0:1788572533.076841:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572533.076845:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076854:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076862:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076870:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572533.076881:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1788572533.077620:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788572533.077632:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077644:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.077649:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077660:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077683:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077692:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ac22c5/0x265cfe11109bfb3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077731:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788572533.077736:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077742:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.077746:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077753:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077770:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077779:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfb41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077797:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788572533.077802:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077808:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.077811:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077820:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077830:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077837:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfb48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077850:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788572533.077854:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077861:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.077864:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077872:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077881:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077889:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfb4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077903:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572533.077918:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077925:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.077929:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077937:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077952:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077961:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c728bfee/0x265cfe11109bfb56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077977:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572533.077981:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.077988:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.077991:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078001:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078015:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078023:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc626c4/0x265cfe11109bfb5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078040:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572533.078045:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078051:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.078055:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078063:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078074:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078081:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b052b295/0x265cfe11109bfb64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078107:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572533.078112:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078119:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.078122:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078130:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078141:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078149:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003201058/0x265cfe11109bfb6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078172:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572533.078176:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078183:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.078188:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078197:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078210:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078219:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f829ba/0x265cfe11109bfb72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.078237:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.078240:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.078245:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.078259:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.079554:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.079565:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572533.079602:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.079691:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.079710:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a48:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.079716:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.079723:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.079740:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.079751:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.079760:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.079781:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572533.079921:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.079928:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.079936:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a47:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.079940:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.079945:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.079956:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.079966:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.079974:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.081201:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572533.081216:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572533.081326:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.081336:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.081353:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a46:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.081359:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.081365:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.081379:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.081390:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.081398:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788572533.083393:0:43924:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6537 00000100:00100000:3.0:1788572533.083646:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f99df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:201345:x1875444584479744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 100394us (100786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572533.083660:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22726 00000100:00100000:3.0:1788572533.083764:0:201345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:201345:1875444584479744:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788572533.083786:0:201345:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1a41:0x0] from OST, last_created [0x2c0000401:0x1a41:0x0]last_used is [0x2c0000401:0x1989:0x0] 00000100:00100000:3.0:1788572533.083902:0:201345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:201345:1875444584480128:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788572533.083961:0:201345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572533.083992:0:201345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590d7c4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572533.084012:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572533.084025:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584480000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572533.085541:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572533.085636:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584480000 00000100:00100000:3.0:1788572533.085646:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584480000 00000100:00100000:3.0:1788572533.085726:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6461 00000100:00100000:3.0:1788572533.085738:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584480000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572533.085780:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572533.085851:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584480000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572533.085859:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6461 00010000:00010000:1.0:1788572533.088017:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572533.088076:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572533.088088:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088222:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572533.088229:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088244:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088270:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088279:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062592c9/0x265cfe11109bfb80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088317:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572533.088320:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088327:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572533.088331:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088338:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088348:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088355:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6eb10ae/0x265cfe11109bfb87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088368:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.088370:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.088372:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572533.088710:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.088718:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088827:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a45:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.088834:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.088842:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088857:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088946:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088954:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.088980:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572533.088991:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572533.088995:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.089003:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572533.089007:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.089015:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.089027:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.089034:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfb8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572533.089194:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584480000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572533.089247:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.089629:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.089632:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.089635:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.089972:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.089985:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572533.089990:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.089999:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.090014:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572533.090021:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002257d724/0x265cfe11109bfb79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572533.090964:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.090978:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.090995:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a44:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.090999:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.091007:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.091027:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.091037:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572533.091987:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584480128 00000100:00100000:0.0:1788572533.092008:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584480128 00000100:00100000:0.0:1788572533.092087:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22727 00010000:00010000:1.0:1788572533.092234:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092258:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572533.092274:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572533.092281:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092289:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572533.092294:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092304:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092324:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092332:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfb95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092362:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.092364:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.092366:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572533.092691:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.092698:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092712:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a43:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.092716:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.092723:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092737:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092746:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092754:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092769:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572533.092818:0:43920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572533.092824:0:43920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092839:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a42:0x0].0x0 since=9286s v=(0 0) 00010000:00010000:1.0:1788572533.092842:0:43920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572533.092846:0:43920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092855:0:43920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092863:0:43920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092870:0:43920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092885:0:43920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572533.092895:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572533.092900:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092918:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572533.092921:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092930:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092947:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092955:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a4a651/0x265cfe11109bfb9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092974:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572533.092977:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092984:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572533.092987:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.092995:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.093004:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.093011:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8c0de6/0x265cfe11109bfba3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572533.093024:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.093025:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572533.093028:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788572533.093352:0:43920:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6690 00000100:00100000:1.0:1788572533.093471:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:201343:x1875444584479872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 117036us (117173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572533.093515:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22725 00000100:00100000:1.0:1788572533.093584:0:201343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:201343:1875444584479872:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788572533.093605:0:201343:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x1a61:0x0] from OST, last_created [0x280000401:0x1a61:0x0]last_used is [0x280000401:0x1a22:0x0] 00000100:00100000:1.0:1788572533.093688:0:201343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:201343:1875444584480384:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788572533.093730:0:201343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572533.093762:0:201343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572533.093783:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584480256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572533.093811:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572533.093849:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584480384 00000100:00100000:1.0:1788572533.093856:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584480384 00000100:00100000:1.0:1788572533.093895:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22728 00000100:00100000:1.0:1788572533.093904:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:201343:x1875444584480384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788572533.093968:0:43920:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 6754 00000100:00100000:0.0:1788572533.094980:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:201345:x1875444584480128:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788572533.095027:0:43923:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6722 00010000:00010000:3.0:1788572533.096638:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.101419:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.101430:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.101435:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572533.102279:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:201345:x1875444584480128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10168us (18304us total) trans 4294975699 rc 0/0 00000100:00100000:0.0:1788572533.102297:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22727 00000100:00100000:0.0:1788572533.102374:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584480256 00000100:00100000:0.0:1788572533.102387:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584480256 00000100:00100000:0.0:1788572533.102439:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6462 00000100:00100000:0.0:1788572533.102449:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584480256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572533.103680:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 896 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572533.103803:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584480256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1352us (9987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572533.103813:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6462 00000100:00100000:0.0:1788572533.103906:0:201345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:201345:1875444584480128:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788572533.103935:0:201345:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1a41:0x0]-[0x2c0000401:0x1a61:0x0] 00000100:00100000:0.0:1788572533.103988:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584480256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572533.104070:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572533.110679:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:201343:x1875444584480384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16763us (16936us total) trans 38654705690 rc 0/0 00000100:00100000:1.0:1788572533.110699:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22728 00000100:00100000:1.0:1788572533.110804:0:201343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:201343:1875444584480384:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788572533.110827:0:201343:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1a61:0x0]-[0x280000401:0x1a81:0x0] 00010000:00010000:1.0:1788572533.377637:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788572533.909817:0:201663:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572533.910306:0:201663:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788572534.141080:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584480512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572534.141200:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572534.141305:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584480512 00000100:00100000:3.0:1788572534.141318:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584480512 00000100:00100000:3.0:1788572534.141411:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6463 00000100:00100000:3.0:1788572534.141424:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584480512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572534.141472:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923476480 avail 3691954176 00000100:00080000:0.0:1788572534.144692:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572534.148636:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584480512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7203us (7424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572534.148661:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6463 00000100:00100000:2.0:1788572534.155539:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584480640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572534.155672:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572534.155912:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584480640 00000100:00100000:0.0:1788572534.155926:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584480640 00000100:00100000:0.0:1788572534.156014:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6464 00000100:00100000:0.0:1788572534.156028:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584480640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572534.156061:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142656 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572534.156122:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584480640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572534.156129:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6464 00000100:00080000:2.0:1788572534.156191:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572534.156245:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584480640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572534.162922:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584480512:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572534.396716:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788572535.054647:0:201713:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572535.054953:0:201713:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788572535.425396:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572536.452527:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572537.470160:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572537.571700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572537.572370:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569578880 00000100:00100000:3.0:1788572537.572386:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569578880 00000100:00100000:3.0:1788572537.572527:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1340 00000100:00100000:3.0:1788572537.572541:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:165380:x1875444569578880:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572537.572582:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572537.572613:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bfbaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb661 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572537.572709:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bfbb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572537.572728:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bfbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572537.572743:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bfbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572537.572827:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1788572537.572831:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572537.572862:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bfbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572537.572926:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcee00/0x265cfe11109bfbaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb661 expref: 8 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572537.572949:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bfbb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb661 expref: 7 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572537.572965:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:3.0:1788572537.572968:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572537.572973:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf600, rc 0) 00000100:00100000:3.0:1788572537.573062:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:165380:x1875444569578880:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 524us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.573071:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1340 00000100:00080000:2.0:1788572537.575224:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572537.599569:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572537.599746:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569579008 00000100:00100000:1.0:1788572537.599760:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569579008 00000100:00100000:1.0:1788572537.599841:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1341 00000100:00100000:1.0:1788572537.599855:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:165380:x1875444569579008:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:1.0:1788572537.599919:0:196070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1788572537.600023:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:165380:x1875444569579008:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 171us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572537.600032:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1341 00000100:00100000:0.0:1788572537.616977:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572537.617220:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569579136 00000100:00100000:2.0:1788572537.617234:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569579136 00000100:00100000:2.0:1788572537.617356:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1342 00000100:00100000:2.0:1788572537.617370:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:165380:x1875444569579136:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:2.0:1788572537.617431:0:188048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00010000:00000080:2.0:1788572537.617475:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffaca80 x1875444569579136/t0(0) o41->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:212/0 lens 224/368 e 0 to 0 dl 1788572562 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572537.617604:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:165380:x1875444569579136:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 238us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572537.617614:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1342 00000100:00080000:0.0:1788572537.617864:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572537.627055:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572537.627977:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569579264 00000100:00100000:0.0:1788572537.627993:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569579264 00000100:00100000:0.0:1788572537.628058:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22729 00000100:00100000:0.0:1788572537.628068:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2396:x1875444569579264:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:0.0:1788572537.628644:0:43919:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9290 last 0 00000020:00000080:0.0:1788572537.628696:0:43919:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109bfbb8 00002000:00100000:0.0:1788572537.628712:0:43919:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e590b8c9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572537.628737:0:43919:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572537.629036:0:43919:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788572537.629158:0:43919:0:(import.c:65:import_set_state_nolock()) ffff8e590b8cf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572537.629270:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569579264:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 1200us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572537.629282:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22729 00000100:00100000:1.0:1788572537.638791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572537.639971:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569579392 00000100:00100000:0.0:1788572537.639992:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569579392 00000100:00100000:0.0:1788572537.640114:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6465 00000100:00100000:0.0:1788572537.640128:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:165380:x1875444569579392:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572537.640168:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572537.644066:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:165380:x1875444569579392:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 3915us (5266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572537.644088:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6465 00000100:00080000:2.0:1788572537.644906:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572537.649157:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572537.649393:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569579520 00000100:00100000:3.0:1788572537.649407:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569579520 00000100:00100000:3.0:1788572537.649464:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22730 00000100:00100000:3.0:1788572537.649533:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2396:x1875444569579520:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:3.0:1788572537.649588:0:43918:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9290 last 0 00000020:00000080:3.0:1788572537.649630:0:43918:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109bfbbf 00002000:00100000:3.0:1788572537.649645:0:43918:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e5a071d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788572537.649671:0:43918:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788572537.649764:0:43918:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788572537.649808:0:43918:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572537.649915:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569579520:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 439us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.649924:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22730 00000100:00100000:1.0:1788572537.663424:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572537.663625:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569579648 00000100:00100000:3.0:1788572537.663639:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569579648 00000100:00100000:3.0:1788572537.663735:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6466 00000100:00100000:3.0:1788572537.663749:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:165380:x1875444569579648:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572537.663789:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572537.663888:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:165380:x1875444569579648:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 141us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.663905:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6466 00000100:00080000:2.0:1788572537.664278:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572537.727681:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584481024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572537.727784:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572537.727873:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584481536:0@lo:400:kworker.0 00000100:00100000:1.0:1788572537.727914:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572537.727939:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584482048:0@lo:400:kworker.0 00000100:00100000:1.0:1788572537.727963:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572537.728001:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572537.728014:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584481152:0@lo:400:kworker.0 00000100:00100000:1.0:1788572537.728037:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572537.728054:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584481664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572537.728079:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572537.728100:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584482176:0@lo:400:kworker.0 00000100:00100000:1.0:1788572537.728121:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572537.728159:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584481664 00000100:00100000:1.0:1788572537.728170:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584481664 00000100:00100000:1.0:1788572537.728374:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584482176 00000100:00100000:1.0:1788572537.728379:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584482176 00000100:00100000:1.0:1788572537.728407:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7902 00000100:00100000:1.0:1788572537.728417:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584481664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.728667:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584480896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572537.728730:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584481664:12345-0@lo:400:kworker.0 Request processed in 314us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572537.728740:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7902 00000100:00100000:1.0:1788572537.728761:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7903 00000100:00100000:1.0:1788572537.728768:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584482176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572537.728843:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584480768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572537.730110:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584481024 00000100:00100000:3.0:1788572537.730125:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584481024 00000100:00100000:3.0:1788572537.730198:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584481152 00000100:00100000:3.0:1788572537.730202:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584481152 00000100:00100000:3.0:1788572537.730248:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1788572537.730258:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584481024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.735756:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572537.735846:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584481408:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.735904:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572537.735945:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584481920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.735971:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572537.736532:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584482176:12345-0@lo:400:kworker.0 Request processed in 7759us (8405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572537.736548:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7903 00000100:00100000:1.0:1788572537.736659:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584481664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572537.736677:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584482176:0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.737139:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584481024:12345-0@lo:400:kworker.0 Request processed in 6877us (9351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.737151:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1788572537.738314:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584482432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.738377:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572537.745605:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584481408 00000100:00100000:3.0:1788572537.745629:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584481408 00000100:00100000:3.0:1788572537.745697:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584481920 00000100:00100000:3.0:1788572537.745701:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584481920 00000100:00100000:3.0:1788572537.745724:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1788572537.745737:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584481152:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572537.745774:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104dc00 x1875444584481152/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:212/0 lens 224/224 e 0 to 0 dl 1788572562 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572537.745883:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584481152:12345-0@lo:400:kworker.0 Request processed in 148us (17843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.745900:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1788572537.745923:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1788572537.745930:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584481408:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572537.745941:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffad180 x1875444584481408/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:212/0 lens 224/224 e 0 to 0 dl 1788572562 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572537.745978:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875444584481408:12345-0@lo:400:kworker.0 Request processed in 49us (10074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.745997:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1788572537.746017:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1788572537.746025:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584481920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.746062:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584481920:12345-0@lo:400:kworker.0 Request processed in 38us (10090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.746068:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1788572537.746100:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584481536 00000100:00100000:3.0:1788572537.746104:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584481536 00000100:00100000:3.0:1788572537.746149:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584482048 00000100:00100000:3.0:1788572537.746152:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584482048 00000100:00100000:3.0:1788572537.746164:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1788572537.746169:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3641:x1875444584481536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.746207:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3641:x1875444584481536:12345-0@lo:400:kworker.0 Request processed in 37us (18293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.746214:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1788572537.746247:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1788572537.746253:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584482048:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572537.746266:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104ce00 x1875444584482048/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:198/0 lens 224/224 e 0 to 0 dl 1788572548 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572537.746294:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584482048:12345-0@lo:400:kworker.0 Request processed in 42us (18331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.746301:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1788572537.746380:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584481152:0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.746398:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584481024:0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.746411:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584481536:0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.746423:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584482048:0@lo:400:kworker.0 00000100:00080000:3.0:1788572537.746644:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572537.746650:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572537.746654:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572537.746707:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572537.746737:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584480768 00000100:00100000:3.0:1788572537.746741:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584480768 00000100:00100000:3.0:1788572537.746764:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1788572537.746770:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584480768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572537.746797:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00010000:00000080:3.0:1788572537.746812:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b0e00 x1875444584480768/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:198/0 lens 224/368 e 0 to 0 dl 1788572548 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572537.746841:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584480768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.746847:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1788572537.746886:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584480768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572537.746910:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584481280:0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.746979:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584480896 00000100:00100000:3.0:1788572537.746984:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584480896 00000100:00100000:3.0:1788572537.747016:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788572537.747023:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584480896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.747063:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584480896:12345-0@lo:400:kworker.0 Request processed in 40us (11320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.747070:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788572537.748121:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572537.748159:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584482432 00000100:00100000:0.0:1788572537.748168:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584482432 00000100:00100000:0.0:1788572537.748236:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584481280 00000100:00100000:0.0:1788572537.748240:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584481280 00000100:00100000:0.0:1788572537.748276:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1788572537.748285:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584482432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748349:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584482432:12345-0@lo:400:kworker.0 Request processed in 66us (9971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572537.748356:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1788572537.748377:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1788572537.748383:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584481280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748412:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584481280:12345-0@lo:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572537.748418:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00080000:0.0:1788572537.748439:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572537.748511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584481280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748525:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584481792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748565:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572537.748593:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584481792 00000100:00100000:0.0:1788572537.748596:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584481792 00000100:00100000:0.0:1788572537.748631:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7904 00000100:00100000:0.0:1788572537.748637:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584481792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748669:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584481792:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572537.748675:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7904 00000100:00080000:0.0:1788572537.748693:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572537.748709:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584481792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748717:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584482304:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572537.748810:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584482432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748834:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584480896:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748846:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584481408:0@lo:400:kworker.0 00000100:00100000:0.0:1788572537.748860:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584481920:0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.752947:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584482304 00000100:00100000:3.0:1788572537.752971:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584482304 00000100:00100000:3.0:1788572537.754646:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7905 00000100:00100000:3.0:1788572537.754663:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584482304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572537.754793:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584482304:12345-0@lo:400:kworker.0 Request processed in 134us (6050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572537.754801:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7905 00000100:00080000:0.0:1788572537.755036:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572537.755098:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584482304:0@lo:400:kworker.0 00000100:00100000:1.0:1788572538.220968:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572538.221022:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572538.221069:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572538.221106:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572538.221146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572538.221185:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569579904 00000100:00100000:1.0:1788572538.221199:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569579904 00000100:00100000:0.0:1788572538.221347:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569580032 00000100:00100000:0.0:1788572538.221353:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569580032 00000100:00100000:0.0:1788572538.221407:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 556 00000100:00100000:0.0:1788572538.221420:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569580032:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:0.0:1788572538.221466:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a4104d500 x1875444569580032/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:199/0 lens 224/224 e 0 to 0 dl 1788572549 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572538.221623:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569580032:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 205us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572538.221631:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 556 00000100:00100000:0.0:1788572538.221679:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569580160 00000100:00100000:0.0:1788572538.221682:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569580160 00000100:00100000:0.0:1788572538.221706:0:43926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569580288 00000100:00100000:0.0:1788572538.221708:0:43926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569580288 00000100:00100000:0.0:1788572538.221731:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7906 00000100:00100000:0.0:1788572538.221738:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569580160:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572538.221769:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569580160:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572538.221776:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7906 00000100:00100000:0.0:1788572538.221795:0:43926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7907 00000100:00100000:0.0:1788572538.221801:0:43926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569580288:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572538.221826:0:43926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2398:x1875444569580288:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 26us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572538.221831:0:43926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7907 00000100:00100000:1.0:1788572538.222341:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 557 00000100:00100000:1.0:1788572538.222351:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4104d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569579904:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572538.222382:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4104d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569579904:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 36us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572538.222388:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 557 00000100:00100000:2.0:1788572538.224015:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569579776 00000100:00100000:2.0:1788572538.224032:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569579776 00000100:00100000:2.0:1788572538.224431:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 77 00000100:00100000:2.0:1788572538.224444:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569579776:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572538.224781:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569579776:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 339us (3711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572538.224789:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 77 00000100:00100000:1.0:1788572538.237393:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584482560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572538.237540:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572538.238040:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584482560 00000100:00100000:2.0:1788572538.238052:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584482560 00000100:00100000:2.0:1788572538.238141:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1788572538.238154:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3641:x1875444584482560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572538.238204:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1788572538.238283:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3641:x1875444584482560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572538.238292:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1788572538.238534:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584482560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572538.238866:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584482688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572538.238942:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572538.239148:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584482688 00000100:00100000:0.0:1788572538.239156:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584482688 00000100:00100000:0.0:1788572538.239209:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6467 00000100:00100000:0.0:1788572538.239220:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584482688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572538.239242:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572538.239291:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584482688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572538.239299:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6467 00000100:00100000:3.0:1788572538.239474:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584482688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572538.241854:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584482816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572538.242689:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572538.243713:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584482816 00000100:00100000:3.0:1788572538.243734:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584482816 00000100:00100000:3.0:1788572538.247180:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6468 00000100:00100000:3.0:1788572538.247198:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584482816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572538.247242:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572538.247378:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875444584482816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (4694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572538.247386:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6468 00000100:00100000:1.0:1788572538.247954:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584482816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572538.492729:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788572538.754775:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:1.0:1788572538.754799:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705690 is committed 00000001:00100000:0.0:1788572538.764037:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:0.0:1788572538.764317:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975699 is committed 00000100:00100000:0.0:1788572539.261113:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584482944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572539.261222:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572539.261439:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584482944 00000100:00100000:3.0:1788572539.261451:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584482944 00000100:00100000:3.0:1788572539.261566:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6469 00000100:00100000:3.0:1788572539.261580:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584482944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572539.261623:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572539.261685:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584482944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572539.261694:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6469 00000100:00100000:3.0:1788572539.261850:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584482944:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572539.262163:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572539.271787:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584483072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572539.271912:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572539.272021:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584483072 00000100:00100000:0.0:1788572539.272033:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584483072 00000100:00100000:0.0:1788572539.272111:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6470 00000100:00100000:0.0:1788572539.272124:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584483072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572539.272166:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00080000:1.0:1788572539.286750:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572539.287220:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584483072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 15087us (15296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572539.287238:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6470 00000100:00100000:2.0:1788572539.287424:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584483072:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572539.516995:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572540.544677:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572541.565526:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572542.589821:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572542.848911:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584483200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849024:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849101:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584483712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849135:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849162:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584484224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849184:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849199:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584484736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849226:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849258:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788572542.849264:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584483584:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849287:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849306:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584484096:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849333:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849354:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584484608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849377:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849415:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584483328:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849440:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849460:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584483840:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849520:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849541:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584484352:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849564:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849586:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572542.849592:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584483456:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849618:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849636:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584483968:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849659:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849676:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584484480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.849700:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572542.849740:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584483712 00000100:00100000:3.0:1788572542.849750:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584483712 00000100:00100000:3.0:1788572542.849826:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584484224 00000100:00100000:3.0:1788572542.849830:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584484224 00000100:00100000:3.0:1788572542.849846:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584484736 00000100:00100000:3.0:1788572542.849848:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584484736 00000100:00100000:3.0:1788572542.849858:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584483584 00000100:00100000:3.0:1788572542.849861:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584483584 00000100:00100000:3.0:1788572542.849892:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1788572542.849903:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584483712:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572542.849938:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fafdf80 x1875444584483712/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:203/0 lens 224/224 e 0 to 0 dl 1788572553 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572542.849988:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584483712:12345-0@lo:400:kworker.0 Request processed in 86us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.849996:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1788572542.850018:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584483328 00000100:00100000:3.0:1788572542.850021:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584483328 00000100:00100000:3.0:1788572542.850034:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584483456 00000100:00100000:3.0:1788572542.850037:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584483456 00000100:00100000:3.0:1788572542.850051:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1788572542.850057:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584484224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850089:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584484224:12345-0@lo:400:kworker.0 Request processed in 32us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850096:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1788572542.850108:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1788572542.850114:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584484736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850142:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584484736:12345-0@lo:400:kworker.0 Request processed in 29us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850148:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1788572542.850159:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1788572542.850165:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584483584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850192:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584483584:12345-0@lo:400:kworker.0 Request processed in 28us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850198:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1788572542.850208:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1788572542.850213:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584483328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850245:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584483328:12345-0@lo:400:kworker.0 Request processed in 31us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850250:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1788572542.850261:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1788572542.850267:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584483456:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572542.850279:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fafea00 x1875444584483456/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:203/0 lens 224/224 e 0 to 0 dl 1788572553 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572542.850304:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584483456:12345-0@lo:400:kworker.0 Request processed in 38us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850312:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1788572542.850351:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584484096 00000100:00100000:3.0:1788572542.850354:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584484096 00000100:00100000:3.0:1788572542.850384:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584484608 00000100:00100000:3.0:1788572542.850388:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584484608 00000100:00100000:3.0:1788572542.850405:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584483968 00000100:00100000:3.0:1788572542.850408:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584483968 00000100:00100000:3.0:1788572542.850427:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584484480 00000100:00100000:3.0:1788572542.850429:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584484480 00000100:00100000:3.0:1788572542.850447:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7908 00000100:00100000:3.0:1788572542.850453:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584484096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850516:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584484096:12345-0@lo:400:kworker.0 Request processed in 62us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850523:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7908 00000100:00100000:3.0:1788572542.850535:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7909 00000100:00100000:3.0:1788572542.850541:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584484608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850570:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584484608:12345-0@lo:400:kworker.0 Request processed in 30us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850577:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7909 00000100:00100000:3.0:1788572542.850586:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7910 00000100:00100000:3.0:1788572542.850592:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584483968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850620:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584483968:12345-0@lo:400:kworker.0 Request processed in 29us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850626:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7910 00000100:00100000:3.0:1788572542.850637:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7911 00000100:00100000:3.0:1788572542.850643:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584484480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850672:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584484480:12345-0@lo:400:kworker.0 Request processed in 30us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850677:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7911 00000100:00100000:3.0:1788572542.850706:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584483840 00000100:00100000:3.0:1788572542.850710:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584483840 00000100:00100000:3.0:1788572542.850736:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584484352 00000100:00100000:3.0:1788572542.850739:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584484352 00000100:00100000:3.0:1788572542.850752:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1788572542.850757:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584483840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850792:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584483840:12345-0@lo:400:kworker.0 Request processed in 35us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850799:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1788572542.850812:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1788572542.850818:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584484352:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572542.850829:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1faff100 x1875444584484352/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:203/0 lens 224/224 e 0 to 0 dl 1788572553 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572542.850855:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584484352:12345-0@lo:400:kworker.0 Request processed in 38us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572542.850861:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1788572542.850959:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584483456:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850973:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584483968:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.850983:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705690 gen 2 00000100:00100000:3.0:1788572542.851006:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584484480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.851018:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584483328:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.851029:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584483840:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.851038:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584484352:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.851086:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584483584:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.851098:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584484096:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.851107:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975699 gen 2 00000100:00100000:3.0:1788572542.851116:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584484608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.851129:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584483712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.851141:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584484224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572542.851154:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584484736:0@lo:400:kworker.0 00000100:00100000:0.0:1788572542.851790:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584483200 00000100:00100000:0.0:1788572542.851800:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584483200 00000100:00100000:0.0:1788572542.851853:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788572542.851861:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584483200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572542.851949:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584483200:12345-0@lo:400:kworker.0 Request processed in 89us (2925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572542.851957:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788572542.852041:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584483200:0@lo:400:kworker.0 00000100:00080000:1.0:1788572542.852444:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572542.852451:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572542.852455:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572542.852458:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572542.853700:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572542.853732:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584484864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572542.853902:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572542.853970:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584484864 00000100:00100000:0.0:1788572542.853979:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584484864 00000100:00100000:0.0:1788572542.854029:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1788572542.854039:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584484864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572542.854550:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00010000:00000080:0.0:1788572542.854573:0:188054:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1ffae680 x1875444584484864/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:203/0 lens 224/368 e 0 to 0 dl 1788572553 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572542.854703:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584484864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 664us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572542.854713:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1788572542.854919:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584484864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572543.345086:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572543.345139:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572543.345195:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572543.345223:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572543.345247:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572543.345283:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569580416 00000100:00100000:1.0:1788572543.345296:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569580416 00000100:00100000:1.0:1788572543.345364:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 79 00000100:00100000:1.0:1788572543.345375:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569580416:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572543.345520:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569580416:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 146us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572543.345529:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 79 00000100:00100000:1.0:1788572543.345584:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569580800 00000100:00100000:1.0:1788572543.345588:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569580800 00000100:00100000:1.0:1788572543.345628:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569580928 00000100:00100000:1.0:1788572543.345632:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569580928 00000100:00100000:1.0:1788572543.345656:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7912 00000100:00100000:1.0:1788572543.345663:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569580800:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572543.345695:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569580800:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572543.345702:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7912 00000100:00100000:1.0:1788572543.345716:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7913 00000100:00100000:1.0:1788572543.345723:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569580928:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572543.345749:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569580928:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572543.345755:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7913 00000100:00080000:2.0:1788572543.346183:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572543.346190:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572543.347147:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569580544 00000100:00100000:3.0:1788572543.347162:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569580544 00000100:00100000:3.0:1788572543.347242:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569580672 00000100:00100000:3.0:1788572543.347246:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569580672 00000100:00100000:3.0:1788572543.347287:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 564 00000100:00100000:3.0:1788572543.347297:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2397:x1875444569580544:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572543.347381:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2397:x1875444569580544:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 85us (2312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572543.347389:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 564 00000100:00100000:3.0:1788572543.347411:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 565 00000100:00100000:3.0:1788572543.347418:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569580672:12345-192.168.202.57@tcp:400:kworker.0 00000100:00080000:2.0:1788572543.347539:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572543.347544:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00000080:3.0:1788572543.348539:0:188048:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cd3800 x1875444569580672/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:204/0 lens 224/224 e 0 to 0 dl 1788572554 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572543.348748:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2397:x1875444569580672:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 1328us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572543.348771:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 565 00000100:00100000:2.0:1788572543.356967:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584484992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572543.357090:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572543.357183:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584484992 00000100:00100000:3.0:1788572543.357194:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584484992 00000100:00100000:3.0:1788572543.357256:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6471 00000100:00100000:3.0:1788572543.357267:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584484992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572543.357307:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572543.357434:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572543.357448:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584485120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572543.357498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572543.358394:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584485248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572543.358447:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572543.358528:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584485120 00000100:00100000:1.0:1788572543.358535:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584485120 00000100:00100000:1.0:1788572543.358584:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6472 00000100:00100000:1.0:1788572543.358594:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584485120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572543.358625:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572543.358675:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584485120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572543.358684:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6472 00000100:00100000:1.0:1788572543.358766:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584485120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572543.367285:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584484992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10004us (10180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572543.367306:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6471 00000100:00100000:3.0:1788572543.367377:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584485248 00000100:00100000:3.0:1788572543.367391:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584485248 00000100:00100000:0.0:1788572543.368841:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1788572543.368879:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3642:x1875444584485248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572543.369197:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1788572543.369332:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3642:x1875444584485248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 475us (10883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572543.369341:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1788572543.369435:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584485248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572543.372279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584484992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572543.612712:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572544.381031:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572544.381068:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584485376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572544.381180:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572544.381255:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584485376 00000100:00100000:1.0:1788572544.381271:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584485376 00000100:00100000:1.0:1788572544.381380:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6473 00000100:00100000:1.0:1788572544.381393:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584485376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572544.381433:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572544.381564:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572544.381580:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584485504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572544.381593:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584485376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 201us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572544.381604:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6473 00000100:00100000:0.0:1788572544.381631:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572544.381699:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584485376:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572544.381912:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572544.382040:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584485504 00000100:00100000:3.0:1788572544.382046:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584485504 00000100:00100000:3.0:1788572544.382091:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6474 00000100:00100000:3.0:1788572544.382099:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584485504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572544.382113:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572544.382161:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584485504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572544.382167:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6474 00000100:00080000:2.0:1788572544.382256:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572544.382895:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584485504:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572544.636660:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572545.664917:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572545.915713:0:201907:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788572546.685064:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572547.709534:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572547.966404:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584485632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572547.966556:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572547.966669:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584485632 00000100:00100000:3.0:1788572547.966681:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584485632 00000100:00100000:3.0:1788572547.966743:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1788572547.966753:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584485632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572547.966803:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00000100:00100000:1.0:1788572547.966806:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584485888:0@lo:400:kworker.0 00010000:00000080:3.0:1788572547.966821:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a84df80 x1875444584485632/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:208/0 lens 224/368 e 0 to 0 dl 1788572558 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572547.966844:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572547.966947:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584485632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572547.966955:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1788572547.966994:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584486144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572547.968421:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584485888 00000100:00100000:3.0:1788572547.968439:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584485888 00000100:00100000:3.0:1788572547.968547:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1788572547.968561:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584485888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572547.968660:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584485888:12345-0@lo:400:kworker.0 Request processed in 104us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572547.968669:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00080000:3.0:1788572547.968697:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572547.968715:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584485888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572547.968716:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572547.968732:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584486400:0@lo:400:kworker.0 00000100:00100000:3.0:1788572547.968740:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584486656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.968769:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572547.968769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572547.968788:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584487168:0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.968794:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584486912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.968814:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572547.968814:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572547.968873:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572547.968880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584486016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.968905:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572547.969020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584485632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572547.969036:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788572547.969043:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584485760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572547.969201:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572547.969234:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584486272:0@lo:400:kworker.0 00000100:00100000:3.0:1788572547.969262:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572547.969284:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584486784:0@lo:400:kworker.0 00000100:00100000:3.0:1788572547.969306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572547.969338:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584486656 00000100:00100000:3.0:1788572547.969343:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584486656 00000100:00100000:3.0:1788572547.969383:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584486912 00000100:00100000:3.0:1788572547.969386:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584486912 00000100:00100000:2.0:1788572547.969713:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584486144 00000100:00100000:2.0:1788572547.969720:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584486144 00000100:00100000:2.0:1788572547.969758:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584487168 00000100:00100000:2.0:1788572547.969762:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584487168 00000100:00100000:2.0:1788572547.969775:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584486016 00000100:00100000:2.0:1788572547.969778:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584486016 00000100:00100000:2.0:1788572547.969793:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584486272 00000100:00100000:2.0:1788572547.969796:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584486272 00000100:00100000:2.0:1788572547.969809:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584486784 00000100:00100000:2.0:1788572547.969812:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584486784 00000100:00100000:2.0:1788572547.969827:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1788572547.969835:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584486144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572547.969924:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584486144:12345-0@lo:400:kworker.0 Request processed in 89us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572547.969931:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1788572547.969952:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1788572547.969958:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584487168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572547.969988:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584487168:12345-0@lo:400:kworker.0 Request processed in 30us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572547.969995:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1788572547.970006:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1788572547.970011:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584486016:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572547.970028:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a27263b80 x1875444584486016/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:208/0 lens 224/224 e 0 to 0 dl 1788572558 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572547.970058:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584486016:12345-0@lo:400:kworker.0 Request processed in 47us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572547.970063:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1788572547.970075:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1788572547.970081:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584486272:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572547.970105:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e590a84e300 x1875444584486272/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:208/0 lens 224/224 e 0 to 0 dl 1788572558 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572547.970278:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584486528:0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.970317:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572547.970349:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584487040:0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.970373:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572547.970415:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584486016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.970452:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584486400 00000100:00100000:1.0:1788572547.970457:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584486400 00000100:00100000:1.0:1788572547.970505:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:1.0:1788572547.970512:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584486400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.970553:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3643:x1875444584486400:12345-0@lo:400:kworker.0 Request processed in 42us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572547.970559:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:1.0:1788572547.970592:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584486528 00000100:00100000:1.0:1788572547.970596:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584486528 00000100:00100000:1.0:1788572547.970620:0:177558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584487040 00000100:00100000:1.0:1788572547.970623:0:177558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584487040 00000100:00100000:1.0:1788572547.970646:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7914 00000100:00100000:1.0:1788572547.970652:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584486656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.970687:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584486656:12345-0@lo:400:kworker.0 Request processed in 36us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572547.970694:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7914 00000100:00100000:1.0:1788572547.970710:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7915 00000100:00100000:1.0:1788572547.970717:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584486912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.970746:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584486912:12345-0@lo:400:kworker.0 Request processed in 29us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572547.970752:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7915 00000100:00100000:1.0:1788572547.970763:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7916 00000100:00100000:1.0:1788572547.970769:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584486528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.970798:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584486528:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572547.970804:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7916 00000100:00100000:1.0:1788572547.970816:0:177558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7917 00000100:00100000:1.0:1788572547.970822:0:177558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584487040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572547.970861:0:177558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584487040:12345-0@lo:400:kworker.0 Request processed in 25us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572547.970868:0:177558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7917 00000100:00100000:1.0:1788572547.970893:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1788572547.970901:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584486784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572547.971023:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584485760 00000100:00100000:3.0:1788572547.971030:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584485760 00000100:00100000:3.0:1788572547.971066:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788572547.971073:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584485760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572547.971230:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875444584486272:12345-0@lo:400:kworker.0 Request processed in 50us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572547.971244:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:2.0:1788572547.971688:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572547.971693:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572547.971697:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572547.971699:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572547.975271:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875444584486272:0@lo:400:kworker.0 00000100:00100000:2.0:1788572547.975296:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584486144:0@lo:400:kworker.0 00000100:00100000:2.0:1788572547.975312:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584486656:0@lo:400:kworker.0 00000100:00100000:2.0:1788572547.975333:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584487168:0@lo:400:kworker.0 00000100:00100000:0.0:1788572547.975910:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584486528:0@lo:400:kworker.0 00000100:00100000:0.0:1788572547.975928:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584487040:0@lo:400:kworker.0 00000100:00100000:0.0:1788572547.975943:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584486400:0@lo:400:kworker.0 00000100:00100000:0.0:1788572547.975957:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584486912:0@lo:400:kworker.0 00000100:00100000:3.0:1788572547.979765:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584485760:12345-0@lo:400:kworker.0 Request processed in 8675us (10670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572547.979788:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788572547.984006:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584486784:12345-0@lo:400:kworker.0 Request processed in 13091us (14683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572547.984024:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1788572547.986667:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584485760:0@lo:400:kworker.0 00000100:00100000:2.0:1788572547.987041:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584486784:0@lo:400:kworker.0 00000001:02000400:1.0:1788572548.144807:0:201955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1788572548.464841:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572548.464909:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572548.464942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572548.464965:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572548.464997:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572548.465030:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569581312 00000100:00100000:3.0:1788572548.465188:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569581056 00000100:00100000:3.0:1788572548.465200:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569581056 00000100:00100000:3.0:1788572548.465272:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 81 00000100:00100000:3.0:1788572548.465286:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569581056:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572548.465384:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569581056:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 101us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572548.465393:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 81 00000100:00100000:2.0:1788572548.465896:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569581312 00000100:00100000:2.0:1788572548.465956:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569581184 00000100:00100000:2.0:1788572548.465960:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569581184 00000100:00100000:2.0:1788572548.465986:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 572 00000100:00100000:2.0:1788572548.465994:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569581312:12345-192.168.202.57@tcp:400:kworker.0 00010000:00000080:2.0:1788572548.466020:0:196070:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a1fea4e00 x1875444569581312/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:209/0 lens 224/224 e 0 to 0 dl 1788572559 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572548.466178:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 573 00000100:00100000:3.0:1788572548.466188:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569581184:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572548.466247:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569581184:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 60us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572548.466258:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 573 00000100:00100000:3.0:1788572548.466289:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569581568 00000100:00100000:3.0:1788572548.466293:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569581568 00000100:00100000:3.0:1788572548.466327:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569581440 00000100:00100000:3.0:1788572548.466331:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569581440 00000100:00100000:3.0:1788572548.466357:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7918 00000100:00100000:3.0:1788572548.466364:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569581568:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572548.466393:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569581568:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 30us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572548.466522:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569581312:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 529us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572548.466531:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 572 00000100:00080000:2.0:1788572548.466551:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572548.466556:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572548.466559:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572548.466561:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572548.467515:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7918 00000100:00100000:3.0:1788572548.467558:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7919 00000100:00100000:3.0:1788572548.467573:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569581440:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572548.467636:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569581440:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 70us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572548.467644:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7919 00000100:00100000:3.0:1788572548.485806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584487296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572548.485919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572548.486000:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584487296 00000100:00100000:3.0:1788572548.486010:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584487296 00000100:00100000:1.0:1788572548.486365:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584487424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572548.486494:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572548.488114:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584487424 00000100:00100000:3.0:1788572548.488130:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584487424 00000100:00100000:3.0:1788572548.488168:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6475 00000100:00100000:3.0:1788572548.488180:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584487296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572548.488231:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572548.488333:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584487296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572548.488341:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6475 00000100:00100000:3.0:1788572548.488364:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6476 00000100:00100000:3.0:1788572548.488371:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584487424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572548.488392:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572548.488588:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584487552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572548.488637:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572548.490593:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584487424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572548.490702:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584487424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1467us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572548.490717:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6476 00000100:00100000:3.0:1788572548.490777:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584487552 00000100:00100000:3.0:1788572548.490786:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584487552 00000100:00100000:3.0:1788572548.490837:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1788572548.491965:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3644:x1875444584487552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572548.492023:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1788572548.494690:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584487296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572548.494909:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3644:x1875444584487552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4059us (6267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572548.494922:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1788572548.495559:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584487552:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788572548.732683:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572549.501107:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572549.501145:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584487680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572549.501246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572549.503333:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584487680 00000100:00100000:0.0:1788572549.503363:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584487680 00000100:00100000:0.0:1788572549.503751:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6477 00000100:00100000:0.0:1788572549.503769:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584487680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572549.503802:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572549.503919:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584487680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572549.503928:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6477 00000100:00080000:2.0:1788572549.504011:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572549.504704:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572549.504728:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584487808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572549.504798:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572549.505165:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584487680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572549.511005:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584487808 00000100:00100000:3.0:1788572549.511029:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584487808 00000100:00080000:2.0:1788572549.511293:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572549.512366:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6478 00000100:00100000:3.0:1788572549.512394:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584487808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572549.512437:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572549.512568:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584487808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (7769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572549.512576:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6478 00000100:00100000:1.0:1788572549.512731:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584487808:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572549.756694:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572550.494802:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572550.495367:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569581696 00000100:00100000:0.0:1788572550.495381:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569581696 00000100:00100000:0.0:1788572550.495545:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1343 00000100:00100000:0.0:1788572550.495560:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:165848:x1875444569581696:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:0.0:1788572550.495616:0:198183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1788572550.495727:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:165848:x1875444569581696:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 170us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.495737:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1343 00000100:00080000:2.0:1788572550.495988:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572550.498602:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572550.498730:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569581824 00000100:00100000:0.0:1788572550.498743:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569581824 00000100:00100000:0.0:1788572550.498847:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1344 00000100:00100000:0.0:1788572550.498861:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:165848:x1875444569581824:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:0.0:1788572550.498914:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00010000:00000080:0.0:1788572550.498942:0:188050:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a411b3800 x1875444569581824/t0(0) o41->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:211/0 lens 224/368 e 0 to 0 dl 1788572561 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572550.499029:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:165848:x1875444569581824:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 171us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.499037:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1344 00000100:00080000:2.0:1788572550.499130:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572550.502616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572550.502972:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569581952 00000100:00100000:0.0:1788572550.502995:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569581952 00000100:00100000:0.0:1788572550.503098:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6479 00000100:00080000:2.0:1788572550.503210:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572550.503517:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:165848:x1875444569581952:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572550.503574:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572550.503671:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:165848:x1875444569581952:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 562us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.503680:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6479 00000100:00100000:1.0:1788572550.507425:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572550.508028:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569582080 00000100:00100000:3.0:1788572550.508047:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569582080 00000100:00100000:3.0:1788572550.508159:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6480 00000100:00100000:3.0:1788572550.508172:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:165848:x1875444569582080:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572550.508233:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572550.508328:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a27262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:165848:x1875444569582080:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 158us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572550.508336:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6480 00000100:00080000:2.0:1788572550.508476:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572550.780704:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572551.804807:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572552.828805:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572553.084876:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572553.084908:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a27261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584487936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572553.085021:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572553.085111:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584487936 00000100:00100000:1.0:1788572553.085122:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584487936 00000100:00100000:1.0:1788572553.085181:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1788572553.085193:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584487936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572553.085243:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445974016 avail 1299734528 00010000:00000080:1.0:1788572553.085265:0:189111:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a31cd3100 x1875444584487936/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:214/0 lens 224/368 e 0 to 0 dl 1788572564 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572553.085317:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584487936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.085324:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1788572553.085401:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a27261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584487936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572553.092899:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584488448:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.092986:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.093046:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584488960:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.093070:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.093088:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584489472:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.093106:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.093136:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572553.093143:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584488064:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.093174:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.093196:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584488576:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.093217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.093236:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584489088:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.093256:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.093284:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584488192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.093309:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.093327:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584488704:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.093353:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572553.095609:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584488448 00000100:00100000:2.0:1788572553.095627:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584488448 00000100:00100000:2.0:1788572553.095744:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584489472 00000100:00100000:2.0:1788572553.095748:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584489472 00000100:00100000:2.0:1788572553.095763:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584488576 00000100:00100000:2.0:1788572553.095766:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584488576 00000100:00100000:3.0:1788572553.099139:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584489216:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.099250:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.099312:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788572553.099323:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584488320:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.099374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.099390:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584488832:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.099417:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.099437:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584489344:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.099460:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.099529:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584488064 00000100:00100000:3.0:1788572553.099540:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584488064 00000100:00100000:3.0:1788572553.099599:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788572553.099610:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a314be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584488064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.099678:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a314be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584488064:12345-0@lo:400:kworker.0 Request processed in 69us (6502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572553.099686:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788572553.099732:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584489088 00000100:00100000:3.0:1788572553.099736:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584489088 00000100:00100000:3.0:1788572553.099758:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584488192 00000100:00100000:3.0:1788572553.099761:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584488192 00000100:00080000:1.0:1788572553.099951:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572553.099958:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572553.100341:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584488320 00000100:00100000:2.0:1788572553.100348:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584488320 00000100:00100000:2.0:1788572553.100500:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:2.0:1788572553.100511:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584488448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.100582:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584488448:12345-0@lo:400:kworker.0 Request processed in 73us (7596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572553.100588:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:2.0:1788572553.100605:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:2.0:1788572553.100612:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584489472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.100644:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584489472:12345-0@lo:400:kworker.0 Request processed in 32us (7536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572553.100650:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:2.0:1788572553.100662:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1788572553.100668:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584489088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.100695:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584489088:12345-0@lo:400:kworker.0 Request processed in 28us (7438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572553.100701:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1788572553.100712:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1788572553.100718:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584488576:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572553.100733:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36944700 x1875444584488576/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:214/0 lens 224/224 e 0 to 0 dl 1788572564 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572553.100760:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584488576:12345-0@lo:400:kworker.0 Request processed in 43us (7543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572553.100767:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1788572553.100778:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1788572553.100784:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584488320:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788572553.100797:0:188833:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8e5a36945f80 x1875444584488320/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:214/0 lens 224/224 e 0 to 0 dl 1788572564 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572553.100926:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572553.101175:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1788572553.101182:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584488192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.101234:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584488192:12345-0@lo:400:kworker.0 Request processed in 52us (7924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572553.101240:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1788572553.101273:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584488704 00000100:00100000:3.0:1788572553.101278:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584488704 00000100:00100000:3.0:1788572553.101310:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1788572553.101317:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3641:x1875444584488704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.101351:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3641:x1875444584488704:12345-0@lo:400:kworker.0 Request processed in 35us (7996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572553.101357:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1788572553.101555:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584488960 00000100:00100000:1.0:1788572553.101561:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584488960 00000100:00100000:1.0:1788572553.101602:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584489216 00000100:00100000:1.0:1788572553.101605:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584489216 00000100:00100000:1.0:1788572553.101626:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584488832 00000100:00100000:1.0:1788572553.101629:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584488832 00000100:00100000:1.0:1788572553.101647:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584489344 00000100:00100000:1.0:1788572553.101650:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584489344 00000100:00100000:1.0:1788572553.101672:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7920 00000100:00100000:1.0:1788572553.101679:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584488960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572553.101726:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584488960:12345-0@lo:400:kworker.0 Request processed in 46us (8653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.101733:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7920 00000100:00100000:1.0:1788572553.101746:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7921 00000100:00100000:1.0:1788572553.101753:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584489216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572553.101782:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584489216:12345-0@lo:400:kworker.0 Request processed in 30us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.101787:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7921 00000100:00100000:2.0:1788572553.102269:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875444584488320:12345-0@lo:400:kworker.0 Request processed in 1485us (2894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572553.102276:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1788572553.102314:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7922 00000100:00100000:2.0:1788572553.102322:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584488832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.102357:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584488832:12345-0@lo:400:kworker.0 Request processed in 37us (2939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.102589:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7923 00000100:00100000:1.0:1788572553.102597:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584489344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572553.102631:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584489344:12345-0@lo:400:kworker.0 Request processed in 35us (3169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.102637:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7923 00000100:00080000:1.0:1788572553.102670:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572553.102674:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572553.102791:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584488064:0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.103098:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7922 00000100:00100000:2.0:1788572553.103189:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875444584488320:0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.103204:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584488832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.103216:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584489344:0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.103229:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584488192:0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.103243:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584488704:0@lo:400:kworker.0 00000100:00100000:2.0:1788572553.103256:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584489216:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.103348:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584488576:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.103438:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584489088:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.103455:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584488448:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.103468:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584488960:0@lo:400:kworker.0 00000100:00100000:3.0:1788572553.103511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584489472:0@lo:400:kworker.0 00000020:01000004:0.0:1788572553.219373:0:202053:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788572553.219451:0:202053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.219470:0:202053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.219495:0:202053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.219504:0:202053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.219528:0:202053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788572553.219534:0:202053:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788572553.219579:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788572553.219586:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788572553.219593:0:202053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788572553.219629:0:202053:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788572553.219876:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584489600:0@lo:39:umount.0 00000100:00100000:2.0:1788572553.219973:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572553.220259:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584489600 00000100:00100000:0.0:1788572553.220269:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584489600 00000100:00100000:0.0:1788572553.220337:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1788572553.220347:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875444584489600:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788572553.220946:0:188048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bf91f 00000100:00080000:0.0:1788572553.220968:0:188048:0:(import.c:65:import_set_state_nolock()) ffff8e5a090c9800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788572553.221076:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+1:3640:x1875444584489600:12345-0@lo:39:umount.0 Request processed in 728us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572553.221084:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000020:00000080:0.0:1788572553.221100:0:188048:0:(genops.c:885:class_export_put()) final put ffff8e5a090ca000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788572553.221304:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a090ca000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788572553.221380:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a090c9800 for lustre-MDT0000 00010000:00010000:0.0:1788572553.222538:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572553.222552:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.222566:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164fa00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572553.222572:0:10396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.222585:0:10396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572553.222600:0:10396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572553.222606:0:10396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572553.222609:0:10396:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788572553.222614:0:10396:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788572553.222662:0:10396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.222669:0:10396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572553.222705:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.222713:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a3164fa00/0x265cfe11109bf85b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf862 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.222729:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572553.222731:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572553.222733:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572553.222931:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788572553.222952:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584489600:0@lo:39:umount.0 00000100:00100000:3.0:1788572553.222990:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572553.223003:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584489728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572553.223083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.223151:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584489728 00000100:00100000:3.0:1788572553.224474:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584489728 00000100:00100000:3.0:1788572553.224577:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4686 00000100:00100000:3.0:1788572553.224589:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584489728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572553.224610:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572553.224633:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a3164ea00/0x265cfe11109bf862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf85b expref: 24 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572553.224654:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572553.224735:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3643:x1875444584489728:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572553.224742:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4686 00010000:00010000:1.0:1788572553.225631:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572553.226289:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584489728:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788572553.228710:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572553.228724:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788572553.228737:0:202053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788572553.235550:0:202053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235590:0:202053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235598:0:202053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235605:0:202053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235634:0:202053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572553.235642:0:202053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235649:0:202053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235656:0:202053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235663:0:202053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235675:0:202053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572553.235684:0:202053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235691:0:202053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235702:0:202053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235710:0:202053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235723:0:202053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788572553.235729:0:202053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235736:0:202053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235743:0:202053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235749:0:202053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.235761:0:202053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788572553.235765:0:202053:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788572553.235831:0:202053:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788572553.235837:0:202053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:2.0:1788572553.235843:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788572553.235850:0:202053:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:0.0:1788572553.236920:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572553.236932:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.236943:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a600 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572553.236948:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.236958:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572553.236972:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572553.236978:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572553.236981:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1788572553.236984:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1788572553.237041:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237048:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572553.237085:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237093:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e590d14a600/0x265cfe11109bf877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf87e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237111:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572553.237115:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237119:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254a00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572553.237122:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237128:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572553.237134:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572553.237143:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572553.237145:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788572553.237148:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788572553.237172:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237178:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572553.237184:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237190:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11254a00/0x265cfe11109bf869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf870 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237203:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572553.237207:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237212:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a11254c00 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572553.237215:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237220:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572553.237226:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572553.237231:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788572553.237233:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788572553.237236:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788572553.237248:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237253:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572553.237269:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237276:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a11254c00/0x265cfe11109bf893 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf89a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237284:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572553.237288:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237294:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e600 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:0.0:1788572553.237297:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237303:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572553.237310:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572553.237315:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572553.237318:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788572553.237319:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788572553.237330:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237337:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572553.237343:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237351:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a3164e600/0x265cfe11109bf885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x265cfe11109bf88c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.237473:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572553.237475:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572553.237476:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572553.237521:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584489856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572553.237618:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572553.237690:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572553.237696:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584489984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572553.237721:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572553.237754:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584490240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572553.237779:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572553.237809:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572553.237815:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584490112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572553.237841:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572553.237872:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584489856 00000100:00100000:0.0:1788572553.237881:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584489856 00000100:00100000:0.0:1788572553.237936:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584489984 00000100:00100000:0.0:1788572553.237940:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584489984 00000100:00100000:0.0:1788572553.237957:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584490240 00000100:00100000:0.0:1788572553.237959:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584490240 00000100:00100000:0.0:1788572553.237971:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584490112 00000100:00100000:0.0:1788572553.237973:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584490112 00000100:00100000:0.0:1788572553.237991:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4687 00000100:00100000:0.0:1788572553.238001:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+26:3641:x1875444584489856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572553.238020:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572553.238038:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a3164f000/0x265cfe11109bf87e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf877 expref: 26 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.238053:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572553.238096:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+25:3641:x1875444584489856:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572553.238104:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4687 00000100:00100000:0.0:1788572553.238128:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4688 00000100:00100000:0.0:1788572553.238134:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584489984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572553.238143:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572553.239560:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a3164e800/0x265cfe11109bf870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf869 expref: 24 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.239582:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572553.239654:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3641:x1875444584489984:12345-0@lo:103:ldlm_bl.0 Request processed in 1518us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572553.239663:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4688 00000100:00100000:0.0:1788572553.239695:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4689 00000100:00100000:0.0:1788572553.239704:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3644:x1875444584490240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572553.239722:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572553.239737:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a11255800/0x265cfe11109bf88c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf885 expref: 22 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.239746:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572553.239779:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:3644:x1875444584490240:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572553.239785:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4689 00000100:00100000:0.0:1788572553.239816:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4690 00000100:00100000:0.0:1788572553.239824:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a09e7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:3644:x1875444584490112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572553.239832:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572553.239842:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e590d14b000/0x265cfe11109bf89a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bf893 expref: 20 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572553.239852:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572553.239874:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a09e7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3644:x1875444584490112:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572553.239881:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4690 00000100:00100000:0.0:1788572553.239988:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584490112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572553.239999:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584490240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572553.240028:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572553.240044:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584489984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572553.240053:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584489856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572553.240169:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572553.240176:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788572553.240655:0:202053:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:2.0:1788572553.241033:0:202053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788572553.241043:0:202053:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e5a36e20800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572553.241050:0:202053:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e590b9ab000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572553.241056:0:202053:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e590b9ac800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572553.241064:0:202053:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e5a1d702000 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 192.168.202.57@tcp 5 (0 0 0) 0 0 0 0: 0000000000000000 25769803846 stale:0 00000020:00080000:2.0:1788572553.241069:0:202053:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8e5a109fb380) has exports, disconnecting them 00000020:00080000:2.0:1788572553.241076:0:202053:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e5a36e20800), last request at 1788572527 00000020:00000080:2.0:1788572553.241086:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bf7d6 00000100:00080000:2.0:1788572553.241098:0:202053:0:(import.c:65:import_set_state_nolock()) ffff8e5a36e26000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788572553.241172:0:202053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5a36e20800): rc 0 00000020:00000080:2.0:1788572553.241175:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5a36e20800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1788572553.241187:0:202053:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e590b9ab000), last request at 1788572553 00000020:00000080:2.0:1788572553.241190:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bed80 00000100:00080000:2.0:1788572553.241196:0:202053:0:(import.c:65:import_set_state_nolock()) ffff8e590b9ad800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788572553.241767:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572553.241781:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a36e20800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00080000:2.0:1788572553.242124:0:202053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e590b9ab000): rc 0 00000020:00000080:2.0:1788572553.242127:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e590b9ab000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:1.0:1788572553.242202:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572553.242727:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a36e26000 for lustre-MDT0001 00000020:00080000:2.0:1788572553.242898:0:202053:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e590b9ac800), last request at 1788572553 00000020:00000080:2.0:1788572553.242911:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bed79 00000100:00080000:2.0:1788572553.242923:0:202053:0:(import.c:65:import_set_state_nolock()) ffff8e590b9aa800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788572553.242979:0:202053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e590b9ac800): rc 0 00000020:00000080:2.0:1788572553.242982:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e590b9ac800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:1.0:1788572553.243013:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572553.243089:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b9ab000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788572553.243168:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590b9ad800 for lustre-MDT0001 00000020:00080000:2.0:1788572553.243242:0:202053:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.202.57@tcp (ffff8e5a1d702000), last request at 1788572550 00000020:00000080:2.0:1788572553.243246:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109becb5 00000100:00080000:2.0:1788572553.243258:0:202053:0:(import.c:65:import_set_state_nolock()) ffff8e5904e01000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788572553.243302:0:202053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.57@tcp (ffff8e5a1d702000): rc 0 00000020:00000080:2.0:1788572553.243304:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5a1d702000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000004:00000080:2.0:1788572553.243314:0:202053:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaac781743ae0 00000100:00080000:2.0:1788572553.243337:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572553.243342:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351009 gen 3 00010000:00010000:2.0:1788572553.243513:0:202053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0x265cfe11109bf9e3 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572553.243528:0:202053:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0x265cfe11109bf9e3 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572553.243592:0:202053:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788572553.243631:0:202053:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572553.243644:0:202053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117fe00/0x265cfe11109bef08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0x265cfe11109bf9e3 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788572553.244450:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b9ac800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788572553.244510:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a1d702000/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-MDT0001 00000020:00000080:0.0:1788572553.244541:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590b9aa800 for lustre-MDT0001 00000020:00000080:0.0:1788572553.244545:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5904e01000 for lustre-MDT0001 00010000:00010000:1.0:1788572553.245240:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572553.245689:0:202053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788572553.245731:0:202053:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788572553.245856:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584490368:0@lo:39:umount.0 00000100:00100000:0.0:1788572553.245965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572553.246117:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584490368 00000100:00100000:1.0:1788572553.246137:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584490368 00000100:00100000:1.0:1788572553.246219:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1788572553.246230:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3640:x1875444584490368:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572553.246271:0:188053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bf797 00000020:00010000:1.0:1788572553.246284:0:188053:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e5a10ff8800: total 0 00000100:00080000:1.0:1788572553.246289:0:188053:0:(import.c:65:import_set_state_nolock()) ffff8e5906855800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572553.246319:0:188053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 82, last_transno is 352187318272 00000020:00010000:2.0:1788572553.250509:0:82817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e5a10ff8800: total 0 00010000:00010000:2.0:1788572553.250616:0:82817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e5a10ff8800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788572553.250673:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:2.0:1788572553.250678:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788572553.250691:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a00030400/0x265cfe11109bf9e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109bef08 expref: 5 pid: 201357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572553.250719:0:82817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e5a10ff8800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788572553.250734:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.250737:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572553.250739:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572553.250963:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+3:3640:x1875444584490368:12345-0@lo:39:umount.0 Request processed in 4729us (4994us total) trans 352187318273 rc 0/0 00000100:00100000:1.0:1788572553.250978:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00080000:1.0:1788572553.251330:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572553.251336:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705689 gen 3 00000004:00080000:1.0:1788572553.251363:0:202053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788572553.251435:0:202053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788572553.251471:0:202053:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efdc800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788572553.251523:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572553.251526:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975698 gen 3 00000004:00080000:1.0:1788572553.251538:0:202053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788572553.251603:0:202053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788572553.251613:0:202053:0:(import.c:65:import_set_state_nolock()) ffff8e5906750000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788572553.251663:0:202053:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8e5a109fb380) has no exports 00000020:00080000:1.0:1788572553.251684:0:198981:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e5a1d633000 refcount 1 committed 1 result 0 batchid 17179873002 00000020:00080000:1.0:1788572553.251690:0:198981:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a244a8300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 0 stopped 0 result 0 sub_th 0000000000000000 00000020:00080000:1.0:1788572553.251694:0:198981:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027502:0x1:0x0].3 00000020:00080000:1.0:1788572553.251697:0:198981:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a244a8f00 obd lustre-MDT0001-osd committed 1 started 0 stopped 0 result 0 sub_th 0000000000000000 00000020:00080000:1.0:1788572553.251700:0:198981:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x24000272a:0x1:0x0].3 00000020:00080000:1.0:1788572553.251710:0:198981:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e59056d1900 refcount 1 committed 1 result 0 batchid 21474837550 00000020:00080000:1.0:1788572553.251714:0:198981:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a05572900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8e59056d13c0 00000020:00080000:1.0:1788572553.251717:0:198981:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027cd1:0x1:0x0].1 00000020:00080000:1.0:1788572553.251720:0:198981:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a05572500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e590a1e4a00 00000020:00080000:1.0:1788572553.251723:0:198981:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].1 00000020:00080000:1.0:1788572553.251730:0:198981:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e5905129180 refcount 1 committed 1 result 0 batchid 21474837551 00000020:00080000:1.0:1788572553.251734:0:198981:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a40e0a700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8e59051293c0 00000020:00080000:1.0:1788572553.251737:0:198981:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027cd1:0x1:0x0].2 00000020:00080000:1.0:1788572553.251740:0:198981:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a40e0aa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5904b86600 00000020:00080000:1.0:1788572553.251743:0:198981:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].2 00000040:00080000:1.0:1788572553.252013:0:202053:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 10 00000100:00080000:0.0:1788572553.252703:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572553.252718:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584490368:0@lo:39:umount.0 00000100:00100000:1.0:1788572553.252868:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584490496:0@lo:9:umount.0 00000100:00100000:1.0:1788572553.252959:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572553.253005:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584490624:0@lo:9:umount.0 00000100:00100000:1.0:1788572553.253030:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572553.253117:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584490496 00000100:00100000:0.0:1788572553.253126:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584490496 00000100:00100000:0.0:1788572553.253198:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584490624 00000100:00100000:0.0:1788572553.253201:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584490624 00000100:00100000:0.0:1788572553.253230:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22731 00000100:00100000:0.0:1788572553.253241:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3640:x1875444584490496:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788572553.253280:0:179391:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109becfb 00000100:00080000:0.0:1788572553.253292:0:179391:0:(import.c:65:import_set_state_nolock()) ffff8e5906753800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572553.253350:0:179391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705690 00000100:00100000:1.0:1788572553.253523:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22732 00000100:00100000:1.0:1788572553.253533:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3640:x1875444584490624:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788572553.253547:0:43920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bed17 00000100:00080000:1.0:1788572553.253553:0:43920:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f310800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572553.253588:0:43920:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975699 00000100:00100000:1.0:1788572553.253758:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2:3640:x1875444584490624:12345-0@lo:9:umount.0 Request processed in 226us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.253766:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22732 00000100:00080000:1.0:1788572553.253821:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5906750000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788572553.253834:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788572553.253836:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572553.253840:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584490624:0@lo:9:umount.0 00010000:00010000:1.0:1788572553.253872:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572553.254055:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+2:3640:x1875444584490496:12345-0@lo:9:umount.0 Request processed in 814us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572553.254063:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22731 00010000:00010000:0.0:1788572553.254090:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572553.254277:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a0efdc800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788572553.254292:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788572553.254294:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572553.254297:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584490496:0@lo:9:umount.0 00000020:00080000:2.0:1788572553.255452:0:202053:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8e5a109fb380) has no exports 00000020:01000000:3.0:1788572553.297463:0:202053:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a31ae2960 - data ffff8e5a35a170d8/ffff8e5a316ae000 00000020:01000000:2.0:1788572553.297767:0:202053:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e5a07d15ba0 - data ffff8e5a08a15a20/ffff8e590cafc000 00000100:00080000:3.0:1788572553.348097:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572553.348107:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351009 gen 4 00000100:00100000:3.0:1788572553.348125:0:202053:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e5a31cdce00 x1875444584490368/t352187318273(352187318273) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572563 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572553.348154:0:202053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788572553.363492:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788572553.363500:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705689 gen 4 00000004:00080000:3.0:1788572553.363516:0:202053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788572553.363519:0:202053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788572553.365659:0:198969:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788572553.365668:0:198969:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 11 count 1 00000040:00080000:1.0:1788572553.365686:0:198969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 6 count 2 00000100:00080000:2.0:1788572553.367932:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788572553.367944:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975698 gen 4 00000004:00080000:2.0:1788572553.367971:0:202053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572553.367975:0:202053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788572553.368373:0:198971:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788572553.368380:0:198971:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 11 count 1 00000040:00080000:3.0:1788572553.368394:0:198971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 6 count 2 00000020:00000080:2.0:1788572553.371437:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bec84 00000020:00000080:2.0:1788572553.371457:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5a0efda000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788572553.371640:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efda000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788572553.372899:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bec99 00000020:00000080:2.0:1788572553.372913:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5904e07000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788572553.372943:0:202053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788572553.372950:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572553.372963:0:202053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788572553.372968:0:202053:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8e5a109fcd40) has no exports 00000004:01000000:2.0:1788572553.373252:0:202053:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788572553.373265:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bed02 00000020:00000080:2.0:1788572553.373271:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5a0f3c5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788572553.373275:0:202053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788572553.373279:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572553.373284:0:202053:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788572553.373287:0:202053:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8e5904158000) has no exports 00000020:00000080:2.0:1788572553.373294:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109becf4 00000020:00000080:2.0:1788572553.373298:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5906756800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788572553.374280:0:202053:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788572553.374289:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788572553.374294:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975698 gen 5 00000004:00080000:2.0:1788572553.374304:0:202053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572553.374307:0:202053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572553.374348:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572553.374359:0:202053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788572553.374367:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bece6 00000020:00000080:2.0:1788572553.374374:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e590b9a9800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788572553.374380:0:202053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788572553.374385:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572553.374389:0:202053:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788572553.374392:0:202053:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8e5901bfb380) has no exports 00000020:00000080:2.0:1788572553.374397:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109becdf 00000020:00000080:2.0:1788572553.374400:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5a0efdb800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788572553.374802:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e07000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788572553.374813:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f3c5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788572553.374820:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906756800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788572553.374827:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5906750000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788572553.374834:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5906753000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788572553.374836:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906753000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788572553.374842:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572553.374954:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b9a9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788572553.374960:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efdb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788572553.375518:0:202053:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788572553.375523:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788572553.375528:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705689 gen 5 00000004:00080000:2.0:1788572553.375534:0:202053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572553.375537:0:202053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572553.375590:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572553.375599:0:202053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788572553.375614:0:202053:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788572553.375622:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109becca 00000020:00000080:2.0:1788572553.375629:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5a40f55800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788572553.378323:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0efdc800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788572553.378350:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5a3191f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788572553.378354:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3191f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788572553.378363:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788572553.378591:0:202053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:2.0:1788572553.378599:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572553.378613:0:202053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788572553.378619:0:202053:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8e59028a3380) has no exports 00000020:00000080:2.0:1788572553.378630:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109becc3 00000020:00000080:2.0:1788572553.379063:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5a3f8c2000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788572553.379526:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a40f55800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788572553.379537:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a3f8c2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788572553.381615:0:202053:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788572553.381627:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572553.381644:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892351009 gen 5 00000100:00100000:3.0:1788572553.381657:0:202053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788572553.381722:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572553.381737:0:202053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572553.381783:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572553.381788:0:202053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572553.381808:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5904e00000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788572553.381814:0:202053:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e00000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788572553.381825:0:202053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572553.381993:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109beca0 00000020:00000080:3.0:1788572553.382003:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5904e04800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788572553.382011:0:202053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788572553.382016:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572553.382022:0:202053:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572553.382028:0:202053:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8e5901bf99c0) has no exports 00000020:00000080:3.0:1788572553.382055:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572553.382059:0:202053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788572553.382063:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109beca7 00000020:00000080:3.0:1788572553.382067:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5904e06000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788572553.382078:0:202053:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a40f51000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788572553.382082:0:202053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a40f51000 2 00000020:01000004:3.0:1788572553.382086:0:202053:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5a40f51000 from lustre-MDT0001 00000020:00000080:3.0:1788572553.382116:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572553.382119:0:202053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788572553.382122:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5a0efdd000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788572553.382124:0:202053:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efdd000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788572553.382134:0:202053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788572553.382179:0:202053:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:3.0:1788572553.382183:0:202053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788572553.382185:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572553.382189:0:202053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788572553.382197:0:202053:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8e5904e03000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572553.382204:0:202053:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8e590415b380) has exports, disconnecting them 00000020:00080000:3.0:1788572553.382209:0:202053:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8e5904e03000), last request at 1788572446 00000020:00000080:3.0:1788572553.382214:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bed41 00000020:00080000:3.0:1788572553.382231:0:202053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5904e03000): rc 0 00000020:00000080:3.0:1788572553.382236:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5904e03000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788572553.383077:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a3f8c7800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788572553.383091:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e59019df800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788572553.383094:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e59019df800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788572553.383101:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788572553.383189:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e04800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788572553.383195:0:105698:0:(genops.c:885:class_export_put()) final put ffff8e5a0efde800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788572553.383197:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0efde800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788572553.383201:0:105698:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788572553.383238:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e06000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788572553.383243:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e03000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788572553.494557:0:202053:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788572553.494571:0:202053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572553.494576:0:202053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788572553.494586:0:202053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572553.494643:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e59019da800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788572553.494906:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572553.494918:0:202053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788572553.494925:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5904e00800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788572553.494930:0:202053:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e00800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788572553.494948:0:202053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788572553.495055:0:202053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a40f51000 1 00000020:00000080:1.0:1788572553.495063:0:202053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bec5a 00000020:00000080:1.0:1788572553.495071:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5904e02000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788572553.495081:0:202053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788572553.495090:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5904e02000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788572553.495100:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572553.495106:0:202053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788572553.495111:0:202053:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8e5a413f8000) has no exports 00000100:00100000:3.0:1788572553.580533:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572553.580580:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572553.580617:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572553.580627:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569582464 00000100:00100000:2.0:1788572553.580641:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569582464 00000100:00100000:3.0:1788572553.580644:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572553.580673:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572553.580692:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569582336 00000100:00100000:2.0:1788572553.580695:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569582336 00000100:00100000:3.0:1788572553.580697:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569582208 00000100:00100000:3.0:1788572553.580699:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569582208 00000100:00100000:2.0:1788572553.580744:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 580 00000100:00100000:3.0:1788572553.580744:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 83 00000100:00100000:2.0:1788572553.580754:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2397:x1875444569582336:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572553.580754:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569582208:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572553.580860:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2397:x1875444569582336:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 108us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572553.580869:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 580 00000100:00100000:2.0:1788572553.580892:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1346 00000100:00100000:2.0:1788572553.580897:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1875444569582464:12345-192.168.202.57@tcp:400:kworker.0 00000020:00080000:2.0:1788572553.580904:0:188050:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.57@tcp 00000100:00100000:2.0:1788572553.580931:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1875444569582464:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 32us (351us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572553.580941:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1346 00000100:00080000:2.0:1788572553.580965:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572553.581177:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569582208:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 424us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572553.581185:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 83 00000100:00100000:3.0:1788572553.581236:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569582720 00000100:00100000:3.0:1788572553.581241:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569582720 00000100:00100000:1.0:1788572553.581365:0:177560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569582592 00000100:00100000:1.0:1788572553.581371:0:177560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569582592 00000100:00100000:1.0:1788572553.581451:0:177560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7924 00000100:00100000:1.0:1788572553.581459:0:177560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569582592:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572553.581518:0:177560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569582592:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 60us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.581525:0:177560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7924 00000100:00080000:2.0:1788572553.581917:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572553.584292:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572553.584421:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572553.584440:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7925 00000100:00100000:3.0:1788572553.584456:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569582720:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572553.584554:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569582720:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 101us (3935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572553.584562:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7925 00000100:00100000:1.0:1788572553.584630:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569582848 00000100:00100000:1.0:1788572553.584639:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569582848 00000100:00100000:1.0:1788572553.584674:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1347 00000100:00100000:1.0:1788572553.584679:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569582848:12345-192.168.202.57@tcp:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788572553.584708:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572553.584749:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875444569582848:12345-192.168.202.57@tcp:38:ptlrpcd_00_00.0 Request processed in 69us (330us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572553.584757:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1347 00000100:00100000:1.0:1788572553.597718:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584490752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572553.597832:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572553.597905:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584490752 00000100:00100000:1.0:1788572553.597915:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584490752 00000100:00100000:1.0:1788572553.597981:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6481 00000100:00100000:1.0:1788572553.597992:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584490752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572553.598035:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572553.598081:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584490752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572553.598089:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6481 00000100:00100000:1.0:1788572553.598135:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584490752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572553.598536:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584490880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572553.598562:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572553.598612:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584490880 00000100:00100000:3.0:1788572553.598616:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584490880 00000100:00100000:3.0:1788572553.598649:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6482 00000100:00100000:3.0:1788572553.598657:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584490880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572553.598676:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572553.598718:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584490880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572553.598725:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6482 00000100:00100000:3.0:1788572553.598760:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584490880:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788572553.687105:0:202053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572553.687127:0:202053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788572553.687135:0:202053:0:(genops.c:885:class_export_put()) final put ffff8e5a40f53800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788572553.687142:0:202053:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a40f53800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788572553.687159:0:202053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788572553.691630:0:202053:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e5a40f54800 00000020:02000400:0.0:1788572553.691756:0:202053:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788572553.855617:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572554.882578:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572555.911511:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572556.924852:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572557.949783:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572558.210822:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572558.210848:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584491008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572558.210924:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572558.211078:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584491008 00000100:00100000:3.0:1788572558.211087:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584491008 00000100:00100000:3.0:1788572558.211134:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1788572558.211143:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875444584491008:12345-0@lo:41:osp-pre-1-0.0 00000020:00080000:3.0:1788572558.211152:0:188054:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788572558.211203:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875444584491008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (279us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788572558.211210:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:02020000:3.0:1788572558.211261:0:3644:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788572558.211266:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788572558.211270:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788572558.211274:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788572558.211280:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572558.211284:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9280 00000100:00080000:3.0:1788572558.211291:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e590b16f800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572558.211316:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c7f100 x1875444584491136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572558.211457:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584491136:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788572558.211517:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572558.212332:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584491136 00000100:00100000:3.0:1788572558.212339:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584491136 00000100:00100000:3.0:1788572558.212411:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1788572558.212417:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584491136:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788572558.212439:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572558.212519:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584491136:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 100us (1001us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572558.212526:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00080000:1.0:1788572558.212627:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572558.212632:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572558.212636:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584491136:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788572558.212866:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584491520:0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.212904:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572558.212939:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584492032:0@lo:400:kworker.0 00000100:00100000:1.0:1788572558.212958:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584491392:0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.212963:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572558.212985:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572558.213030:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584491648:0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.213030:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584491264:0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.213063:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572558.213076:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584492032 00000100:00100000:0.0:1788572558.213080:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584492032 00000100:00100000:3.0:1788572558.213087:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584491776:0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.213115:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584491264 00000100:00100000:3.0:1788572558.213118:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584491264 00000100:00100000:0.0:1788572558.213121:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7926 00000100:00100000:0.0:1788572558.213128:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584492032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.213164:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788572558.213171:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3644:x1875444584491264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572558.213208:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3644:x1875444584491264:12345-0@lo:400:kworker.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572558.213228:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788572558.216974:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584491904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572558.217047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572558.217125:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584491904 00000100:00100000:1.0:1788572558.217133:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584491904 00000100:00100000:1.0:1788572558.217183:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7927 00000100:00100000:1.0:1788572558.217193:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584491904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572558.217258:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584491904:12345-0@lo:400:kworker.0 Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572558.217266:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7927 00000100:00080000:1.0:1788572558.217288:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572558.217292:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572558.217323:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584491904:0@lo:400:kworker.0 00000100:00100000:1.0:1788572558.217361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572558.220986:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584492032:12345-0@lo:400:kworker.0 Request processed in 7847us (8010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572558.221002:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7926 00000100:00100000:0.0:1788572558.221107:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584492032:0@lo:400:kworker.0 00000100:00100000:1.0:1788572558.222162:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584492160:0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.223255:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584491520 00000100:00100000:2.0:1788572558.223277:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584491520 00000100:00100000:1.0:1788572558.223330:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572558.238559:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584491392 00000100:00100000:2.0:1788572558.238576:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584491392 00000100:00100000:2.0:1788572558.239531:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584491648 00000100:00100000:2.0:1788572558.239540:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584491648 00000100:00100000:2.0:1788572558.239559:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584492160 00000100:00100000:2.0:1788572558.239561:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584492160 00000100:00100000:2.0:1788572558.239579:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1788572558.239588:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584491392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.239698:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584491392:12345-0@lo:400:kworker.0 Request processed in 110us (26712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572558.239705:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1788572558.239723:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1788572558.239729:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584491648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.239928:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584491648:12345-0@lo:400:kworker.0 Request processed in 199us (22566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572558.239935:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1788572558.239948:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1788572558.239955:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584492160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.239984:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584492160:12345-0@lo:400:kworker.0 Request processed in 30us (16655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572558.239990:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1788572558.240003:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1788572558.240007:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875444584491520:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788572558.240014:0:188833:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788572558.240055:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875444584491520:12345-0@lo:400:kworker.0 Request processed in 46us (27151us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572558.240061:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1788572558.240118:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584491392:0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.240162:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584491648:0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.240175:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584492160:0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.240246:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572558.240617:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584491264:0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.240640:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584491776 00000100:00100000:2.0:1788572558.240644:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584491776 00000100:00100000:2.0:1788572558.240669:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1788572558.240674:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875444584491776:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788572558.240679:0:188833:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788572558.240713:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875444584491776:12345-0@lo:400:kworker.0 Request processed in 39us (468us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572558.240720:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00080000:2.0:1788572558.240838:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572558.240843:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572558.240847:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572558.240852:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572558.240856:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9204 00000100:00080000:2.0:1788572558.240862:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572558.240890:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f32a00 x1875444584492288/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572558.240912:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875444584491776:0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.240931:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584492288:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788572558.240964:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572558.240991:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584492288 00000100:00100000:2.0:1788572558.240995:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584492288 00000100:00100000:2.0:1788572558.241017:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1788572558.241021:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584492288:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788572558.241040:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572558.241069:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584492288:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 46us (104us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572558.241075:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00080000:2.0:1788572558.241100:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572558.241105:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572558.241108:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584492288:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788572558.241156:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572558.241160:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572558.241162:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572558.241167:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572558.241171:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9204 00000100:00080000:2.0:1788572558.241175:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:2.0:1788572558.241203:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40f32a00 x1875444584492416/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572558.241587:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584491520:0@lo:400:kworker.0 00000100:00100000:2.0:1788572558.241620:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584492416:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788572558.241646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572558.241674:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584492416 00000100:00100000:2.0:1788572558.241678:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584492416 00000100:00100000:2.0:1788572558.241699:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1788572558.241704:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584492416:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788572558.241717:0:198183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572558.241872:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3640:x1875444584492416:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 166us (224us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572558.241879:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00080000:2.0:1788572558.241906:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572558.241909:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572558.241912:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584492416:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1788572558.242012:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572558.700185:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572558.700293:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569582976 00000100:00100000:3.0:1788572558.700303:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569582976 00000100:00100000:3.0:1788572558.700360:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 85 00000100:00100000:3.0:1788572558.700370:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569582976:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572558.700442:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569582976:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572558.700449:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 85 00000100:00100000:2.0:1788572558.701916:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572558.702047:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569583104 00000100:00100000:0.0:1788572558.702055:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569583104 00000100:00100000:0.0:1788572558.702125:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 584 00000100:00100000:0.0:1788572558.702136:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569583104:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572558.702202:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569583104:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 68us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572558.702209:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 584 00000100:00080000:2.0:1788572558.702304:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572558.704412:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572558.704509:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569583232 00000100:00100000:2.0:1788572558.704518:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569583232 00000100:00100000:2.0:1788572558.704567:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1352 00000100:00100000:2.0:1788572558.704576:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569583232:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572558.704613:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572558.704680:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569583232:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 104us (277us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572558.704687:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1352 00000100:00100000:3.0:1788572558.706273:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572558.706315:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572558.706408:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569583488 00000100:00100000:1.0:1788572558.706416:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569583488 00000100:00100000:1.0:1788572558.706507:0:43925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569583360 00000100:00100000:1.0:1788572558.706512:0:43925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569583360 00000100:00100000:1.0:1788572558.706540:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7928 00000100:00100000:1.0:1788572558.706549:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569583488:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572558.706621:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569583488:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572558.706628:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7928 00000100:00100000:1.0:1788572558.706645:0:43925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7929 00000100:00100000:1.0:1788572558.706651:0:43925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569583360:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572558.706675:0:43925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569583360:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572558.706681:0:43925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7929 00000100:00080000:2.0:1788572558.707226:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572558.707231:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572558.717456:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584492544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572558.717549:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572558.717623:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584492544 00000100:00100000:3.0:1788572558.717631:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584492544 00000100:00100000:3.0:1788572558.717679:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6483 00000100:00100000:3.0:1788572558.717689:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584492544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572558.717732:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572558.717790:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584492544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572558.717797:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6483 00000100:00100000:3.0:1788572558.717847:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584492544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572558.718139:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584492672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572558.718178:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572558.718302:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584492672 00000100:00100000:1.0:1788572558.718308:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584492672 00000100:00100000:1.0:1788572558.718341:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6484 00000100:00100000:1.0:1788572558.718348:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584492672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572558.718369:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572558.718408:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584492672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572558.718414:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6484 00000100:00100000:1.0:1788572558.718444:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584492672:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788572558.721747:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788572558.721755:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5a0f312800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788572558.722006:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788572558.722010:0:194757:0:(genops.c:885:class_export_put()) final put ffff8e5906757800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788572558.722093:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a0f312800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788572558.722144:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5906757800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788572558.722165:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a0f310800 for lustre-OST0001 00000020:00000080:3.0:1788572558.722171:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5906753800 for lustre-OST0000 00000001:00100000:2.0:1788572558.724077:0:201325:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788572558.724089:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318273 is committed 00000020:00000080:2.0:1788572558.724094:0:201325:0:(genops.c:885:class_export_put()) final put ffff8e5a10ff8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788572558.727963:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a10ff8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788572558.728036:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5906855800 for lustre-MDT0000 00010000:00010000:1.0:1788572558.972660:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572559.996734:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572561.020711:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572562.044763:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572563.068703:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572563.325620:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572563.325627:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572563.325631:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572563.325640:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9311 00000100:00080000:3.0:1788572563.325646:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572563.325653:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572563.325675:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c7ea00 x1875444584493056/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572563.325715:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572563.325717:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572563.325719:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572563.325722:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9311 00000100:00080000:3.0:1788572563.325725:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572563.325728:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572563.325740:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c7e680 x1875444584493312/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572563.325748:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572563.325751:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572563.325753:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572563.325756:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9311 00000100:00080000:3.0:1788572563.325758:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788572563.325761:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e590b16f800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572563.325771:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c7c380 x1875444584493440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572563.325826:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584493184:0@lo:400:kworker.0 00000100:00100000:3.0:1788572563.325896:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572563.325989:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572563.325996:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584492928:0@lo:400:kworker.0 00000100:00100000:3.0:1788572563.326021:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572563.326055:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584493824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572563.326090:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572563.326125:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584493184 00000100:00100000:3.0:1788572563.326134:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584493184 00000100:00100000:3.0:1788572563.326183:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584492928 00000100:00100000:3.0:1788572563.326186:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584492928 00000100:00100000:3.0:1788572563.326204:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584493824 00000100:00100000:3.0:1788572563.326207:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584493824 00000100:00100000:3.0:1788572563.326226:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:3.0:1788572563.326235:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584493184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572563.326299:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584493184:12345-0@lo:400:kworker.0 Request processed in 64us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572563.326320:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:3.0:1788572563.326340:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1788572563.326346:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584492928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572563.326374:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584492928:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572563.326379:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1788572563.326390:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:3.0:1788572563.326396:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584493824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572563.326434:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584493824:12345-0@lo:400:kworker.0 Request processed in 38us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572563.326440:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00080000:3.0:1788572563.326457:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572563.326518:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584492928:0@lo:400:kworker.0 00000100:00100000:3.0:1788572563.326531:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584493824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572563.326540:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584493184:0@lo:400:kworker.0 00000100:00100000:1.0:1788572563.326778:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584493568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572563.326812:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572563.326847:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572563.326853:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584492800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572563.326878:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572563.326901:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584493696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572563.326922:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572563.326948:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584492800 00000100:00100000:1.0:1788572563.326952:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584492800 00000100:00100000:1.0:1788572563.326982:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788572563.326989:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3641:x1875444584492800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572563.327024:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3641:x1875444584492800:12345-0@lo:400:kworker.0 Request processed in 36us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572563.327030:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788572563.327059:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584493568 00000100:00100000:1.0:1788572563.327064:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584493568 00000100:00100000:1.0:1788572563.327092:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584493696 00000100:00100000:1.0:1788572563.327095:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584493696 00000100:00100000:1.0:1788572563.327113:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7930 00000100:00100000:1.0:1788572563.327119:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584493568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572563.327149:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584493568:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572563.327154:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7930 00000100:00100000:1.0:1788572563.327165:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7931 00000100:00100000:1.0:1788572563.327170:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584493696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572563.327193:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584493696:12345-0@lo:400:kworker.0 Request processed in 23us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572563.327199:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7931 00000100:00080000:1.0:1788572563.327220:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572563.327223:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572563.327360:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584492800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572563.327379:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584493696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572563.327388:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584493568:0@lo:400:kworker.0 00000100:00100000:2.0:1788572563.327516:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584493056:0@lo:38:kworker.0 00000100:00100000:2.0:1788572563.327576:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572563.327596:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584493312:0@lo:38:kworker.0 00000100:00100000:2.0:1788572563.327617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572563.327634:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584493440:0@lo:38:kworker.0 00000100:00100000:2.0:1788572563.327656:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572563.327698:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584493056 00000100:00100000:2.0:1788572563.327702:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584493056 00000100:00100000:2.0:1788572563.327722:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584493312 00000100:00100000:2.0:1788572563.327725:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584493312 00000100:00100000:2.0:1788572563.327738:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1788572563.327743:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584493056:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572563.327762:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572563.327795:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584493056:12345-0@lo:38:kworker.0 Request processed in 50us (218us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572563.327801:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1788572563.327813:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:2.0:1788572563.327817:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584493312:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572563.327826:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572563.327847:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584493312:12345-0@lo:38:kworker.0 Request processed in 28us (229us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572563.327853:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00080000:2.0:1788572563.327876:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572563.327881:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572563.327885:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584493056:0@lo:38:kworker.0 00000100:00080000:2.0:1788572563.327893:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572563.327896:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572563.327899:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584493312:0@lo:38:kworker.0 00000100:00100000:1.0:1788572563.327974:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584493440 00000100:00100000:1.0:1788572563.327978:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584493440 00000100:00100000:1.0:1788572563.328008:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1788572563.328013:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584493440:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572563.328024:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572563.328055:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584493440:12345-0@lo:38:kworker.0 Request processed in 41us (399us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572563.328062:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00080000:1.0:1788572563.328084:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572563.328088:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572563.328091:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584493440:0@lo:38:kworker.0 00000100:00100000:3.0:1788572563.819167:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572563.819545:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569583872 00000100:00100000:1.0:1788572563.819555:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569583872 00000100:00100000:1.0:1788572563.819606:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1355 00000100:00100000:1.0:1788572563.819614:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2396:x1875444569583872:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:1.0:1788572563.819639:0:198183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572563.819703:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2396:x1875444569583872:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 88us (545us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572563.819711:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1355 00000100:00100000:3.0:1788572563.820022:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572563.820103:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572563.820138:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572563.820158:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572563.820602:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569584000 00000100:00100000:1.0:1788572563.820609:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569584000 00000100:00100000:1.0:1788572563.820652:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569584128 00000100:00100000:1.0:1788572563.820655:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569584128 00000100:00100000:1.0:1788572563.820694:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7932 00000100:00100000:1.0:1788572563.820702:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569584000:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572563.820751:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569584000:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 50us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572563.820758:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7932 00000100:00100000:1.0:1788572563.820771:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7933 00000100:00100000:1.0:1788572563.820778:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569584128:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572563.820800:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569584128:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 23us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572563.820806:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7933 00000100:00100000:2.0:1788572563.821104:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569583744 00000100:00100000:2.0:1788572563.821119:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569583744 00000100:00100000:2.0:1788572563.821154:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 588 00000100:00100000:2.0:1788572563.821161:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569583744:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572563.821201:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2398:x1875444569583744:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 40us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572563.821207:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 588 00000100:00080000:3.0:1788572563.821585:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572563.821589:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572563.821592:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572563.821885:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569583616 00000100:00100000:0.0:1788572563.821892:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569583616 00000100:00100000:0.0:1788572563.821924:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 87 00000100:00100000:0.0:1788572563.821932:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569583616:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572563.822400:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2398:x1875444569583616:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 466us (2377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572563.822408:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 87 00000100:00100000:0.0:1788572563.838743:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584493952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572563.838838:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572563.839326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584494080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572563.839360:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572563.839408:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584493952 00000100:00100000:2.0:1788572563.839417:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584493952 00000100:00100000:2.0:1788572563.839458:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584494080 00000100:00100000:2.0:1788572563.839461:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584494080 00000100:00100000:2.0:1788572563.839476:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6485 00000100:00100000:2.0:1788572563.839504:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3a49c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584493952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572563.839537:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572563.839581:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3a49c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584493952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572563.839589:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6485 00000100:00100000:2.0:1788572563.839857:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6486 00000100:00100000:2.0:1788572563.839864:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584494080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572563.839879:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572563.839910:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584494080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572563.839917:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6486 00000100:00100000:2.0:1788572563.839957:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584494080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572563.845247:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584493952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572564.092702:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572565.118923:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572566.141071:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572567.164680:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572568.197306:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572568.445650:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572568.445659:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572568.445664:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572568.445672:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9316 00000100:00080000:3.0:1788572568.445680:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572568.445687:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572568.445712:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ea9c00 x1875444584494464/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572568.445738:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572568.445741:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572568.445742:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572568.445746:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9316 00000100:00080000:3.0:1788572568.445748:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572568.445752:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572568.445761:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ea8e00 x1875444584494720/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572568.445770:0:186041:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572568.445773:0:186041:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572568.445775:0:186041:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572568.445778:0:186041:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9316 00000100:00080000:3.0:1788572568.445780:0:186041:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788572568.445783:0:186041:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e590b16f800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572568.445794:0:186041:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eab100 x1875444584494848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572568.445838:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584494976:0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.445903:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.445957:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572568.445963:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584494208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.445992:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.446012:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584495104:0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.446032:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.446057:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584494336:0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.446080:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.446096:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584495232:0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.446113:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.446128:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572568.446133:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584494592:0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.446148:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.446176:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584494464:0@lo:38:kworker.0 00000100:00100000:3.0:1788572568.446196:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.446223:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584494720:0@lo:38:kworker.0 00000100:00100000:3.0:1788572568.446242:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.446257:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584494848:0@lo:38:kworker.0 00000100:00100000:0.0:1788572568.446387:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584494336 00000100:00100000:0.0:1788572568.446396:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584494336 00000100:00100000:0.0:1788572568.446444:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584495232 00000100:00100000:0.0:1788572568.446447:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584495232 00000100:00100000:3.0:1788572568.446447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572568.446460:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584494592 00000100:00100000:0.0:1788572568.446462:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584494592 00000100:00100000:0.0:1788572568.446473:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584494464 00000100:00100000:0.0:1788572568.446476:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584494464 00000100:00100000:3.0:1788572568.446500:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584494720 00000100:00100000:3.0:1788572568.446504:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584494720 00000100:00100000:0.0:1788572568.446509:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1788572568.446517:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584494336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.446518:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1788572568.446524:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584495232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.446567:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584495232:12345-0@lo:400:kworker.0 Request processed in 42us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572568.446576:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1788572568.446595:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1788572568.446602:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584494592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.446631:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584494592:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572568.446637:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1788572568.446650:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788572568.446654:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584494464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572568.446674:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572568.446707:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584494464:12345-0@lo:38:kworker.0 Request processed in 51us (510us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572568.446714:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788572568.446726:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1788572568.446730:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584494720:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572568.446739:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572568.446763:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875444584494720:12345-0@lo:38:kworker.0 Request processed in 31us (519us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572568.446769:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00080000:3.0:1788572568.446786:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572568.446797:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584494848 00000100:00100000:3.0:1788572568.446801:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584494848 00000100:00100000:3.0:1788572568.446822:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1788572568.446827:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584494848:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572568.446837:0:189111:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572568.446865:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584494848:12345-0@lo:38:kworker.0 Request processed in 36us (417us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572568.446871:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1788572568.446911:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584494592:0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.446923:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584495232:0@lo:400:kworker.0 00000100:00080000:3.0:1788572568.446951:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572568.446956:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572568.446959:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584494464:0@lo:38:kworker.0 00000100:00080000:3.0:1788572568.446968:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572568.446971:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572568.446974:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584494720:0@lo:38:kworker.0 00000100:00080000:3.0:1788572568.446981:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572568.446984:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572568.446987:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584494848:0@lo:38:kworker.0 00000100:00100000:0.0:1788572568.447929:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584494336:12345-0@lo:400:kworker.0 Request processed in 1409us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572568.447939:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1788572568.447979:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584494208 00000100:00100000:0.0:1788572568.447985:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584494208 00000100:00100000:0.0:1788572568.448018:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788572568.448026:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3641:x1875444584494208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572568.448070:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3641:x1875444584494208:12345-0@lo:400:kworker.0 Request processed in 45us (2077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572568.448076:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788572568.448107:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584494976 00000100:00100000:0.0:1788572568.448111:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584494976 00000100:00100000:0.0:1788572568.448141:0:177559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584495104 00000100:00100000:0.0:1788572568.448144:0:177559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584495104 00000100:00100000:0.0:1788572568.448164:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7934 00000100:00100000:0.0:1788572568.448170:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584494976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572568.448202:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584494976:12345-0@lo:400:kworker.0 Request processed in 32us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572568.448219:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7934 00000100:00100000:0.0:1788572568.448232:0:177559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7935 00000100:00100000:0.0:1788572568.448239:0:177559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584495104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572568.448266:0:177559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584495104:12345-0@lo:400:kworker.0 Request processed in 29us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572568.448272:0:177559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7935 00000100:00100000:3.0:1788572568.454048:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584494336:0@lo:400:kworker.0 00000100:00080000:3.0:1788572568.454090:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572568.454095:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572568.454114:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584494208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.454127:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584495104:0@lo:400:kworker.0 00000100:00100000:3.0:1788572568.454140:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584494976:0@lo:400:kworker.0 00000100:00100000:2.0:1788572568.945786:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572568.945819:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572568.945842:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572568.945859:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572568.945883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572568.945909:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569584384 00000100:00100000:2.0:1788572568.945920:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569584384 00000100:00100000:2.0:1788572568.945982:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569584512 00000100:00100000:2.0:1788572568.945985:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569584512 00000100:00100000:2.0:1788572568.946000:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 592 00000100:00100000:2.0:1788572568.946009:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2397:x1875444569584384:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572568.946083:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2397:x1875444569584384:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572568.946091:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 592 00000100:00100000:2.0:1788572568.946110:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1358 00000100:00100000:2.0:1788572568.946115:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569584512:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572568.946136:0:196070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572568.946157:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569584512:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 41us (274us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572568.946163:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1358 00000100:00100000:2.0:1788572568.946180:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569584256 00000100:00100000:2.0:1788572568.946194:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569584256 00000100:00100000:2.0:1788572568.946218:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 89 00000100:00100000:2.0:1788572568.946223:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569584256:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572568.946245:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569584256:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572568.946251:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 89 00000100:00100000:2.0:1788572568.946280:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569584768 00000100:00100000:2.0:1788572568.946284:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569584768 00000100:00100000:2.0:1788572568.946309:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7936 00000100:00100000:2.0:1788572568.946321:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569584768:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572568.946343:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569584768:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572568.946349:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7936 00000100:00100000:2.0:1788572568.946358:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569584640 00000100:00100000:2.0:1788572568.946362:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569584640 00000100:00100000:2.0:1788572568.946382:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7937 00000100:00100000:2.0:1788572568.946387:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569584640:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572568.946408:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569584640:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 21us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572568.946414:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7937 00000100:00080000:2.0:1788572568.946426:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572568.946431:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572568.946433:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572568.956687:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572568.956716:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5906a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584495360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572568.956843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.957006:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584495360 00000100:00100000:3.0:1788572568.957015:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584495360 00000100:00100000:3.0:1788572568.957381:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6487 00000100:00100000:3.0:1788572568.957393:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584495360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572568.957434:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572568.957527:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584495360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572568.957535:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6487 00000100:00100000:1.0:1788572568.957645:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5906a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584495360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572568.968524:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572568.968552:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5906a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584495488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572568.968654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572568.968857:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584495488 00000100:00100000:3.0:1788572568.968869:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584495488 00000100:00100000:3.0:1788572568.968997:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6488 00000100:00100000:3.0:1788572568.969007:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584495488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572568.969038:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572568.969170:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584495488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572568.969178:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6488 00000100:00100000:3.0:1788572568.969256:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5906a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584495488:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572569.212673:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572570.242405:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572571.289814:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572572.284696:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572573.308732:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572573.565947:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572573.565955:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572573.565959:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572573.565967:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9321 00000100:00080000:3.0:1788572573.565974:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788572573.565981:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572573.566139:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ea9500 x1875444584495872/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572573.566174:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572573.566180:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572573.566182:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572573.566186:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9321 00000100:00080000:3.0:1788572573.566189:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788572573.566194:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572573.566207:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eab800 x1875444584496128/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572573.566216:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572573.566219:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788572573.566221:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572573.566224:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9321 00000100:00080000:3.0:1788572573.566227:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788572573.566231:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e590b16f800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572573.566259:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ea8a80 x1875444584496256/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572573.567157:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584495616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.567246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572573.567364:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584496512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.567406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572573.567435:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572573.567441:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584496384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.567464:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572573.567554:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5906a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584495744:0@lo:400:kworker.0 00000100:00100000:0.0:1788572573.567591:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572573.567614:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584496640:0@lo:400:kworker.0 00000100:00100000:0.0:1788572573.567636:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572573.567655:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572573.567870:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584495872:0@lo:38:kworker.0 00000100:00100000:3.0:1788572573.567902:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572573.567924:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584496128:0@lo:38:kworker.0 00000100:00100000:3.0:1788572573.567942:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572573.568130:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584495616 00000100:00100000:1.0:1788572573.568139:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584495616 00000100:00100000:1.0:1788572573.568202:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788572573.568211:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3642:x1875444584495616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572573.568763:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584496000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572573.568894:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3642:x1875444584495616:12345-0@lo:400:kworker.0 Request processed in 684us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572573.568902:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788572573.568951:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584495616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.568998:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584496256:0@lo:38:kworker.0 00000100:00100000:3.0:1788572573.569062:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572573.569110:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584496512 00000100:00100000:3.0:1788572573.569115:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584496512 00000100:00100000:3.0:1788572573.569155:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584496384 00000100:00100000:3.0:1788572573.569159:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584496384 00000100:00100000:3.0:1788572573.569179:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7938 00000100:00100000:3.0:1788572573.569186:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584496512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.569229:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584496512:12345-0@lo:400:kworker.0 Request processed in 43us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572573.569236:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7938 00000100:00100000:3.0:1788572573.569253:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7939 00000100:00100000:3.0:1788572573.569333:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584496384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.569372:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584496384:12345-0@lo:400:kworker.0 Request processed in 112us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572573.569379:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7939 00000100:00100000:1.0:1788572573.569593:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584496256 00000100:00100000:1.0:1788572573.569598:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584496256 00000100:00100000:1.0:1788572573.569620:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1788572573.569625:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584496256:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572573.569645:0:188054:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572573.569837:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584496256:12345-0@lo:38:kworker.0 Request processed in 210us (774us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572573.569844:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00080000:1.0:1788572573.572378:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572573.572390:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572573.572395:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584496256:0@lo:38:kworker.0 00000100:00100000:1.0:1788572573.572435:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584496384:0@lo:400:kworker.0 00000100:00100000:1.0:1788572573.572447:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584496512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572573.573369:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584495744 00000100:00100000:1.0:1788572573.573379:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584495744 00000100:00100000:3.0:1788572573.573430:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584496640 00000100:00100000:1.0:1788572573.573432:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584495872 00000100:00100000:3.0:1788572573.573437:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584496640 00000100:00100000:1.0:1788572573.573438:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584495872 00000100:00100000:1.0:1788572573.573460:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584496128 00000100:00100000:1.0:1788572573.573463:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584496128 00000100:00100000:3.0:1788572573.573474:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1788572573.573509:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584495744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.573607:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584495744:12345-0@lo:400:kworker.0 Request processed in 112us (6015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572573.575805:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1788572573.577301:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1788572573.577340:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1788572573.577352:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584496128:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572573.577380:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572573.577509:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875444584496128:12345-0@lo:38:kworker.0 Request processed in 158us (9565us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572573.577517:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1788572573.577557:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572573.577616:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5906a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584495744:0@lo:400:kworker.0 00000100:00080000:3.0:1788572573.577649:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572573.577655:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572573.577658:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572573.577698:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584496000 00000100:00100000:3.0:1788572573.577705:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584496000 00000100:00100000:3.0:1788572573.577746:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1788572573.577752:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584496000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.577799:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584496000:12345-0@lo:400:kworker.0 Request processed in 46us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572573.577805:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00080000:3.0:1788572573.577822:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572573.577840:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584496000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.577879:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1788572573.577885:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584496640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572573.577923:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584496640:12345-0@lo:400:kworker.0 Request processed in 38us (10285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572573.577929:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1788572573.577952:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584496640:0@lo:400:kworker.0 00000100:00080000:2.0:1788572573.580229:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572573.580243:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572573.580247:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584496128:0@lo:38:kworker.0 00000100:00100000:1.0:1788572573.583825:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584495872:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572573.583856:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572573.583944:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584495872:12345-0@lo:38:kworker.0 Request processed in 129us (16041us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572573.583953:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00080000:1.0:1788572573.584046:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572573.584051:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572573.584055:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584495872:0@lo:38:kworker.0 00000100:00100000:2.0:1788572574.065125:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572574.065181:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572574.065202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572574.065224:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572574.065247:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572574.066812:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569585024 00000100:00100000:3.0:1788572574.066830:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569585024 00000100:00100000:3.0:1788572574.066903:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569585152 00000100:00100000:3.0:1788572574.066907:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569585152 00000100:00100000:3.0:1788572574.066929:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 596 00000100:00100000:3.0:1788572574.066939:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569585024:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572574.067037:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569585024:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 99us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572574.067044:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 596 00000100:00100000:3.0:1788572574.067068:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1361 00000100:00100000:3.0:1788572574.067072:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569585152:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:3.0:1788572574.067096:0:188833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572574.067121:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1875444569585152:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 47us (1918us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572574.067127:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1361 00000100:00100000:0.0:1788572574.067410:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569584896 00000100:00100000:0.0:1788572574.067416:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569584896 00000100:00100000:0.0:1788572574.067458:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 91 00000100:00100000:0.0:1788572574.067466:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569584896:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572574.067530:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569584896:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 65us (2356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572574.067537:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 91 00000100:00100000:0.0:1788572574.067572:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569585280 00000100:00100000:0.0:1788572574.067576:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569585280 00000100:00100000:0.0:1788572574.067599:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569585408 00000100:00100000:0.0:1788572574.067602:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569585408 00000100:00100000:0.0:1788572574.067621:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22733 00000100:00100000:0.0:1788572574.067627:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2396:x1875444569585280:12345-192.168.202.57@tcp:9:kworker.0 00000020:00000080:0.0:1788572574.067658:0:43922:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bfbb8 00000100:00080000:0.0:1788572574.067667:0:43922:0:(import.c:65:import_set_state_nolock()) ffff8e590b8cf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572574.067713:0:43922:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705690 00000100:00100000:0.0:1788572574.067857:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+2:2396:x1875444569585280:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 229us (2631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572574.067863:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22733 00000100:00100000:0.0:1788572574.067877:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22734 00000100:00100000:0.0:1788572574.067883:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2396:x1875444569585408:12345-192.168.202.57@tcp:9:kworker.0 00000020:00000080:0.0:1788572574.067894:0:43922:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x265cfe11109bfbbf 00000100:00080000:0.0:1788572574.067900:0:43922:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572574.067925:0:43922:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975699 00000100:00100000:0.0:1788572574.068011:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+2:2396:x1875444569585408:12345-192.168.202.57@tcp:9:kworker.0 Request processed in 128us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572574.068017:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22734 00010000:00010000:0.0:1788572574.068126:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572574.068133:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572574.068791:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572574.068797:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572574.068799:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572574.077222:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572574.077246:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584496768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572574.077362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572574.077503:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584496768 00000100:00100000:1.0:1788572574.077513:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584496768 00000100:00100000:1.0:1788572574.077573:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6489 00000100:00100000:1.0:1788572574.077583:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584496768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572574.077612:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572574.077669:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584496768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572574.077680:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6489 00000100:00100000:0.0:1788572574.077887:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584496768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572574.078111:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584496896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572574.078154:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572574.078236:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584496896 00000100:00100000:2.0:1788572574.078241:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584496896 00000100:00100000:2.0:1788572574.078280:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6490 00000100:00100000:2.0:1788572574.078288:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584496896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572574.078306:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142656 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572574.078345:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584496896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572574.078351:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6490 00000100:00100000:0.0:1788572574.078876:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584496896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572574.334254:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572575.357543:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572576.380716:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572577.405697:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572578.428733:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572578.684776:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572578.684783:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572578.684788:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572578.684795:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9326 00000100:00080000:1.0:1788572578.684800:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572578.684815:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572578.684827:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572578.684837:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eab800 x1875444584497280/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572578.684845:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584497024:0@lo:400:kworker.0 00000100:00080000:1.0:1788572578.684859:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572578.684862:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572578.684864:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572578.684867:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9326 00000100:00080000:1.0:1788572578.684870:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572578.684873:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572578.684882:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ea8700 x1875444584497536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572578.684890:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572578.684893:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788572578.684895:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572578.684898:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9326 00000100:00080000:1.0:1788572578.684900:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572578.684903:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e590b16f800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572578.684912:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572578.684913:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ea8e00 x1875444584497664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572578.684952:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584497408:0@lo:400:kworker.0 00000100:00100000:3.0:1788572578.684960:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584497792:0@lo:400:kworker.0 00000100:00100000:3.0:1788572578.684984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572578.684985:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572578.685023:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788572578.685029:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584497152:0@lo:400:kworker.0 00000100:00100000:3.0:1788572578.685039:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572578.685044:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584497920:0@lo:400:kworker.0 00000100:00100000:1.0:1788572578.685051:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572578.685063:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572578.685066:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584498048:0@lo:400:kworker.0 00000100:00100000:3.0:1788572578.685092:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584497024 00000100:00100000:3.0:1788572578.685100:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584497024 00000100:00100000:1.0:1788572578.685102:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572578.685128:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584497280:0@lo:38:kworker.0 00000100:00100000:3.0:1788572578.685145:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788572578.685150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572578.685153:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3641:x1875444584497024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572578.685164:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584497536:0@lo:38:kworker.0 00000100:00100000:1.0:1788572578.685181:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572578.685196:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584497664:0@lo:38:kworker.0 00000100:00100000:3.0:1788572578.685197:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:3641:x1875444584497024:12345-0@lo:400:kworker.0 Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572578.685205:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788572578.685231:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572578.685239:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584497792 00000100:00100000:3.0:1788572578.685242:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584497792 00000100:00100000:1.0:1788572578.685260:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584497408 00000100:00100000:1.0:1788572578.685262:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584497408 00000100:00100000:3.0:1788572578.685275:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584497920 00000100:00100000:3.0:1788572578.685277:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584497920 00000100:00100000:1.0:1788572578.685286:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584497152 00000100:00100000:1.0:1788572578.685289:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584497152 00000100:00100000:3.0:1788572578.685296:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7940 00000100:00100000:1.0:1788572578.685302:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584498048 00000100:00100000:1.0:1788572578.685304:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584498048 00000100:00100000:1.0:1788572578.685314:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584497280 00000100:00100000:1.0:1788572578.685317:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584497280 00000100:00100000:1.0:1788572578.685325:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584497536 00000100:00100000:1.0:1788572578.685327:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584497536 00000100:00100000:1.0:1788572578.685335:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1788572578.685340:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584497408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572578.685419:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1788572578.685429:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584497152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572578.685470:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584497152:12345-0@lo:400:kworker.0 Request processed in 43us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572578.685497:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1788572578.685533:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584497408:12345-0@lo:400:kworker.0 Request processed in 192us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572578.685540:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1788572578.685556:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1788572578.685562:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584498048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572578.685590:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584498048:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572578.685595:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1788572578.685608:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1788572578.685612:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584497280:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572578.685629:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572578.685661:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584497280:12345-0@lo:38:kworker.0 Request processed in 48us (510us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572578.685667:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1788572578.685679:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1788572578.685682:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584497536:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572578.685691:0:188048:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572578.685713:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875444584497536:12345-0@lo:38:kworker.0 Request processed in 29us (531us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572578.685718:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00080000:1.0:1788572578.685749:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572578.685753:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572578.685756:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584497280:0@lo:38:kworker.0 00000100:00080000:1.0:1788572578.685764:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572578.685768:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572578.685770:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584497536:0@lo:38:kworker.0 00000100:00100000:0.0:1788572578.685855:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584497152:0@lo:400:kworker.0 00000100:00100000:0.0:1788572578.685866:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584498048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572578.685876:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584497408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572578.685891:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7941 00000100:00100000:2.0:1788572578.685900:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584497920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572578.685933:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584497920:12345-0@lo:400:kworker.0 Request processed in 36us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572578.685939:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7941 00000100:00100000:2.0:1788572578.685964:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584497920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572578.685971:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584497024:0@lo:400:kworker.0 00000100:00080000:2.0:1788572578.686007:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572578.686011:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572578.686012:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572578.686021:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584497664 00000100:00100000:2.0:1788572578.686024:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584497664 00000100:00100000:2.0:1788572578.686054:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:2.0:1788572578.686058:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584497664:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572578.686068:0:188053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572578.686096:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584497664:12345-0@lo:38:kworker.0 Request processed in 37us (865us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572578.686101:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00080000:2.0:1788572578.686121:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572578.686124:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572578.686126:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584497664:0@lo:38:kworker.0 00000100:00100000:3.0:1788572578.687262:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584497792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572578.687363:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584497792:12345-0@lo:400:kworker.0 Request processed in 2060us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572578.687372:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7940 00000100:00100000:2.0:1788572578.687768:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584497792:0@lo:400:kworker.0 00000020:01000004:3.0:1788572579.098280:0:202672:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788572579.098844:0:202672:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788572579.098846:0:202672:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788572579.099178:0:202672:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e5a372dd000 00000020:01000004:3.0:1788572579.099196:0:202672:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788572579.099211:0:202672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788572579.099225:0:202672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8e5901bfb380) 00000020:00000080:3.0:1788572579.099244:0:202672:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1788572579.179812:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572579.179896:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569585536 00000100:00100000:3.0:1788572579.179971:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569585536 00000100:00100000:3.0:1788572579.180030:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 93 00000100:00100000:3.0:1788572579.180041:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569585536:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572579.180119:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569585536:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.180127:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 93 00000100:00100000:3.0:1788572579.180230:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572579.180634:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569585664 00000100:00100000:2.0:1788572579.180639:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569585664 00000100:00100000:2.0:1788572579.180692:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 600 00000100:00100000:2.0:1788572579.180701:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569585664:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572579.180750:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569585664:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 51us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.180758:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 600 00000100:00080000:3.0:1788572579.181812:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572579.183331:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572579.183472:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569585792 00000100:00100000:2.0:1788572579.183514:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569585792 00000100:00100000:2.0:1788572579.183551:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1364 00000100:00100000:2.0:1788572579.183559:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569585792:12345-192.168.202.57@tcp:38:kworker.0 00010000:00020000:2.0:1788572579.183582:0:188049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572579.183636:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875444569585792:12345-192.168.202.57@tcp:38:kworker.0 Request processed in 76us (312us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572579.183643:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1364 00000100:00100000:2.0:1788572579.201685:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572579.201721:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584498176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572579.201818:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572579.201871:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584498176 00000100:00100000:2.0:1788572579.201880:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584498176 00000100:00100000:2.0:1788572579.201947:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6491 00000100:00100000:2.0:1788572579.201957:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584498176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572579.201999:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572579.202046:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584498176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.202053:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6491 00000100:00100000:2.0:1788572579.202107:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584498176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572579.203635:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572579.203653:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584498304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572579.203712:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572579.203765:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584498304 00000100:00100000:3.0:1788572579.203771:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584498304 00000100:00100000:3.0:1788572579.203819:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6492 00000100:00100000:3.0:1788572579.203828:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584498304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572579.203863:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142656 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572579.203915:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584498304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.203921:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6492 00000100:00100000:3.0:1788572579.205842:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584498304:0@lo:13:osp-pre-1-0.0 00100000:10000000:0.0:1788572579.328962:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788572579.335441:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.352453:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788572579.354663:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788572579.358952:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788572579.362145:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788572579.362646:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788572579.362869:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788572579.364101:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788572579.365207:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788572579.366427:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788572579.368441:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788572579.369409:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788572579.372876:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788572579.377151:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788572579.378412:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788572579.381593:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788572579.384088:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788572579.384670:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788572579.385432:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788572579.389951:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788572579.391240:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788572579.391651:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788572579.391919:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788572579.392332:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788572579.393061:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788572579.394258:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788572579.395441:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.398037:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.399161:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788572579.400552:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.400844:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788572579.404058:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.405507:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788572579.406069:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788572579.406851:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.407750:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.409180:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788572579.415877:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.416440:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788572579.416682:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788572579.417084:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.417433:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788572579.418530:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788572579.418934:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788572579.419403:0:202672:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00080000:01000000:3.0:1788572579.421069:0:202672:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788572579.421511:0:202672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788572579.421519:0:202672:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788572579.421532:0:202672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109bfbcd 00000020:01000004:3.0:1788572579.421539:0:202672:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788572579.421565:0:202672:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.157@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788572579.421568:0:202672:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788572579.421574:0:202672:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788572579.421600:0:202672:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788572579.421605:0:202672:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.157@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788572579.445738:0:202672:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.157@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788572579.445791:0:202672:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.157@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788572579.445796:0:202672:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788572579.445798:0:202672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788572579.445799:0:202672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572579.445800:0:202672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572579.445802:0:202672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572579.445803:0:202672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572579.445804:0:202672:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572579.445805:0:202672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572579.445807:0:202672:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788572579.445810:0:202672:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788572579.445812:0:202672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788572579.445813:0:202672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788572579.445814:0:202672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572579.445815:0:202672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572579.445816:0:202672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572579.445818:0:202672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572579.445819:0:202672:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572579.445820:0:202672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572579.445821:0:202672:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788572579.445847:0:202672:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788572579.445867:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498432:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788572579.448131:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572579.448252:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788572579.453008:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572579.458443:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584498432 00000100:00100000:2.0:1788572579.458459:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584498432 00000100:00100000:0.0:1788572579.458788:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788572579.458801:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:202672:x1875444584498432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788572579.458841:0:201331:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788572579.458844:0:201331:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788572579.458853:0:201331:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788572579.460125:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:202672:x1875444584498432:12345-0@lo:253:mount.lustre.0 Request processed in 1322us (11995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.460138:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788572579.460314:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498432:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788572579.460328:0:202672:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788572579.460341:0:202672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788572579.460343:0:202672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788572579.460344:0:202672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572579.460345:0:202672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572579.460347:0:202672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572579.460349:0:202672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572579.460350:0:202672:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572579.460352:0:202672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572579.460354:0:202672:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788572579.460377:0:202672:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5a372dd000 from lustre-MDT0001 10000000:01000000:1.0:1788572579.460408:0:202672:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788572579.460411:0:202672:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788572579.460420:0:202672:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e5a0efbb380 local copy 00010000:00010000:1.0:1788572579.460431:0:202672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf90a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572579.460564:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572579.460604:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572579.460633:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a126f5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.460750:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584498560 00000100:00100000:3.0:1788572579.460757:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584498560 00000100:00100000:3.0:1788572579.460813:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788572579.460822:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:202672:x1875444584498560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572579.460914:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:202672:x1875444584498560:12345-0@lo:501:mount.lustre.0 Request processed in 93us (310us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572579.460921:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788572579.461138:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498560:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788572579.461156:0:202672:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788572579.461181:0:202672:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788572579.461190:0:202672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf90a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.461200:0:202672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a3164f600/0x265cfe11109bf903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bf90a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572579.461230:0:202672:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5a372dd000 10000000:01000000:2.0:1788572579.461235:0:202672:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788572579.461241:0:202672:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e5a372dd000 10000000:01000000:2.0:1788572579.461245:0:202672:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788572579.461248:0:202672:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e5a372dd000 from 1 10000000:01000000:2.0:1788572579.461252:0:202672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788572579.461278:0:202672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a24534600/0x265cfe11109bfbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.461286:0:202672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a24534600/0x265cfe11109bfbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.461296:0:202672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a24534600/0x265cfe11109bfbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572579.461312:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572579.461361:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572579.461381:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906388780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.461515:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584498688 00000100:00100000:3.0:1788572579.461520:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584498688 00000100:00100000:3.0:1788572579.461541:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788572579.461548:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+19:202672:x1875444584498688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572579.461558:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572579.461574:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dce000/0x265cfe11109bfbdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bfbd4 expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.461597:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dce000/0x265cfe11109bfbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bfbd4 expref: 20 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.461609:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dce000/0x265cfe11109bfbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bfbd4 expref: 20 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.461618:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce000, rc 0) 00000100:00100000:3.0:1788572579.461657:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:202672:x1875444584498688:12345-0@lo:101:mount.lustre.0 Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.461662:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788572579.462613:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572579.462640:0:202672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a24534600/0x265cfe11109bfbd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfbdb expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.462651:0:202672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a24534600/0x265cfe11109bfbd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bfbdb expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572579.462670:0:202672:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788572579.462689:0:202672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a24534600/0x265cfe11109bfbd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfbdb expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.462696:0:202672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a24534600/0x265cfe11109bfbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfbdb expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572579.462702:0:202672:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788572579.462710:0:202672:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788572579.462716:0:202672:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e5a372dd000 10000000:01000000:2.0:1788572579.462720:0:202672:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788572579.462725:0:202672:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788572579.462728:0:202672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788572579.462756:0:202672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a24535400/0x265cfe11109bfbe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.462763:0:202672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a24535400/0x265cfe11109bfbe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.462772:0:202672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a24535400/0x265cfe11109bfbe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572579.462802:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572579.462851:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572579.462882:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906388780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.463686:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584498816 00000100:00100000:3.0:1788572579.463694:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584498816 00000100:00100000:3.0:1788572579.463748:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788572579.463758:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+20:202672:x1875444584498816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572579.463784:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572579.463799:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a40dcee00/0x265cfe11109bfbe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bfbe2 expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.463823:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a40dcee00/0x265cfe11109bfbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bfbe2 expref: 21 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.463834:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a40dcee00/0x265cfe11109bfbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bfbe2 expref: 21 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.463849:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcee00, rc 0) 00000100:00100000:3.0:1788572579.463912:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584498816:12345-0@lo:101:mount.lustre.0 Request processed in 155us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.463919:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788572579.464396:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572579.464414:0:202672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a24535400/0x265cfe11109bfbe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfbe9 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.464424:0:202672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a24535400/0x265cfe11109bfbe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bfbe9 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572579.464688:0:202672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 46 count 46 00000040:00080000:0.0:1788572579.471075:0:202672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572579.477867:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:0.0:1788572579.479115:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 136 off8552 00000040:00080000:0.0:1788572579.479144:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 176 off8728 00000040:00080000:0.0:1788572579.479161:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8952 00000040:00080000:0.0:1788572579.479177:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 224 off9176 00000040:00080000:0.0:1788572579.479191:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 120 off9296 00000040:00080000:0.0:1788572579.479204:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 112 off9408 00000040:00080000:0.0:1788572579.479219:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 160 off9568 00000040:00080000:0.0:1788572579.479235:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9792 00000040:00080000:0.0:1788572579.479249:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].10, 224 off10016 00000040:00080000:0.0:1788572579.479264:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].11, 88 off10104 00000040:00080000:0.0:1788572579.480076:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].12, 144 off10248 00000040:00080000:0.0:1788572579.480102:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].13, 152 off10400 00000040:00080000:0.0:1788572579.480118:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].14, 168 off10568 00000040:00080000:0.0:1788572579.480134:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].15, 224 off10792 00000040:00080000:0.0:1788572579.480150:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].16, 224 off11016 00000040:00080000:0.0:1788572579.480164:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].17, 80 off11096 00000040:00080000:0.0:1788572579.480181:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].18, 224 off11320 00000040:00080000:0.0:1788572579.480197:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].19, 224 off11544 00000040:00080000:0.0:1788572579.480213:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].20, 160 off11704 00000040:00080000:0.0:1788572579.480227:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].21, 224 off11928 00000040:00080000:0.0:1788572579.480239:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].22, 224 off12152 00000040:00080000:0.0:1788572579.480253:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].23, 80 off12232 00000040:00080000:0.0:1788572579.480269:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].24, 224 off12456 00000040:00080000:0.0:1788572579.481090:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].25, 224 off12680 00000040:00080000:0.0:1788572579.481109:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].26, 88 off12768 00000040:00080000:0.0:1788572579.481124:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].27, 144 off12912 00000040:00080000:0.0:1788572579.481140:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].28, 152 off13064 00000040:00080000:0.0:1788572579.481157:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].29, 136 off13200 00000040:00080000:0.0:1788572579.481172:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].30, 224 off13424 00000040:00080000:0.0:1788572579.481186:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].31, 224 off13648 00000040:00080000:0.0:1788572579.481199:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].32, 80 off13728 00000040:00080000:0.0:1788572579.481213:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].33, 224 off13952 00000040:00080000:0.0:1788572579.481229:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].34, 224 off14176 00000040:00080000:0.0:1788572579.481244:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].35, 88 off14264 00000040:00080000:0.0:1788572579.481259:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].36, 144 off14408 00000040:00080000:0.0:1788572579.483119:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].37, 152 off14560 00000040:00080000:0.0:1788572579.483176:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].38, 136 off14696 00000040:00080000:0.0:1788572579.483194:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].39, 224 off14920 00000040:00080000:0.0:1788572579.483214:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].40, 224 off15144 00000040:00080000:0.0:1788572579.483230:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].41, 80 off15224 00000040:00080000:0.0:1788572579.483245:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].42, 224 off15448 00000040:00080000:0.0:1788572579.483262:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].43, 224 off15672 00000040:00080000:0.0:1788572579.484602:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].44, 120 off15792 00000040:00080000:0.0:1788572579.484653:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].45, 224 off16016 00000040:00080000:0.0:1788572579.484660:0:202672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 45 count 46 00000100:00100000:0.0:1788572579.484797:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572579.484871:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.487191:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.492716:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584498944 00000100:00100000:3.0:1788572579.492735:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584498944 00000100:00100000:3.0:1788572579.492824:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788572579.492836:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584498944:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572579.493228:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584498944:12345-0@lo:501:mount.lustre.0 Request processed in 394us (8355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.493238:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788572579.502442:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584498944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572579.502564:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584499072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572579.502649:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.502698:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1f8b3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.503354:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584499072 00000100:00100000:1.0:1788572579.503363:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584499072 00000100:00100000:1.0:1788572579.503426:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788572579.503435:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584499072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572579.503600:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584499072:12345-0@lo:503:mount.lustre.0 Request processed in 166us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.503608:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788572579.503679:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584499072:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788572579.504188:0:202672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572579.504257:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584499200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572579.504301:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.504342:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.504542:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584499200 00000100:00100000:1.0:1788572579.504548:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584499200 00000100:00100000:1.0:1788572579.504584:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788572579.504603:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584499200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572579.505413:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584499200:12345-0@lo:502:mount.lustre.0 Request processed in 818us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.505421:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788572579.505589:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584499200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572579.505767:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:0.0:1788572579.505802:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 136 off8552 00000040:00080000:0.0:1788572579.505813:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 176 off8728 00000040:00080000:0.0:1788572579.505823:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8952 00000040:00080000:0.0:1788572579.505833:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 224 off9176 00000040:00080000:0.0:1788572579.505843:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 120 off9296 00000040:00080000:0.0:1788572579.505853:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 112 off9408 00000040:00080000:0.0:1788572579.505863:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 160 off9568 00000040:00080000:0.0:1788572579.505872:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9792 00000040:00080000:0.0:1788572579.505882:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].10, 224 off10016 00000040:00080000:0.0:1788572579.505892:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].11, 88 off10104 00000040:00080000:0.0:1788572579.505901:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].12, 144 off10248 00000040:00080000:0.0:1788572579.505911:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].13, 152 off10400 00000040:00080000:0.0:1788572579.505922:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].14, 168 off10568 00000040:00080000:0.0:1788572579.505932:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].15, 224 off10792 00000040:00080000:0.0:1788572579.505941:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].16, 224 off11016 00000040:00080000:0.0:1788572579.505951:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].17, 80 off11096 00000040:00080000:0.0:1788572579.505961:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].18, 224 off11320 00000040:00080000:0.0:1788572579.505970:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].19, 224 off11544 00000040:00080000:0.0:1788572579.505980:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].20, 160 off11704 00000040:00080000:0.0:1788572579.505989:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].21, 224 off11928 00000040:00080000:0.0:1788572579.505998:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].22, 224 off12152 00000040:00080000:0.0:1788572579.506008:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].23, 80 off12232 00000040:00080000:0.0:1788572579.506018:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].24, 224 off12456 00000040:00080000:0.0:1788572579.506028:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].25, 224 off12680 00000040:00080000:0.0:1788572579.506037:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].26, 88 off12768 00000040:00080000:0.0:1788572579.506048:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].27, 144 off12912 00000040:00080000:0.0:1788572579.506058:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].28, 152 off13064 00000040:00080000:0.0:1788572579.506067:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].29, 136 off13200 00000040:00080000:0.0:1788572579.506077:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].30, 224 off13424 00000040:00080000:0.0:1788572579.506087:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].31, 224 off13648 00000040:00080000:0.0:1788572579.506097:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].32, 80 off13728 00000040:00080000:0.0:1788572579.506106:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].33, 224 off13952 00000040:00080000:0.0:1788572579.506116:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].34, 224 off14176 00000040:00080000:0.0:1788572579.506128:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].35, 88 off14264 00000040:00080000:0.0:1788572579.506139:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].36, 144 off14408 00000040:00080000:0.0:1788572579.506148:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].37, 152 off14560 00000040:00080000:0.0:1788572579.506158:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].38, 136 off14696 00000040:00080000:0.0:1788572579.506170:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].39, 224 off14920 00000040:00080000:0.0:1788572579.506180:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].40, 224 off15144 00000040:00080000:0.0:1788572579.506191:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].41, 80 off15224 00000040:00080000:0.0:1788572579.506200:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].42, 224 off15448 00000040:00080000:0.0:1788572579.506211:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].43, 224 off15672 00000040:00080000:0.0:1788572579.506221:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].44, 120 off15792 00000100:00100000:0.0:1788572579.506249:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584499328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572579.506401:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.506437:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.506966:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584499328 00000100:00100000:3.0:1788572579.506972:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584499328 00000100:00100000:3.0:1788572579.507013:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788572579.507020:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584499328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572579.507124:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584499328:12345-0@lo:502:mount.lustre.0 Request processed in 104us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.507130:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788572579.507226:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584499328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572579.507393:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].45, 224 off16016 00000040:00080000:1.0:1788572579.507405:0:202672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788572579.510727:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572579.510745:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.510747:0:202677:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788572579.510755:0:202677:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788572579.510758:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572579.510783:0:202677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8e5901bf99c0) 00000020:00000080:3.0:1788572579.510809:0:202677:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:3.0:1788572579.510814:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788572579.510888:0:202677:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788572579.510894:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109bfbf7 00000020:00000080:3.0:1788572579.511124:0:202677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788572579.511129:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572579.511132:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.511134:0:202677:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788572579.511137:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572579.511140:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.511141:0:202677:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788572579.511146:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572579.511153:0:202677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8e590415b380) 00000020:00000080:3.0:1788572579.511165:0:202677:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:3.0:1788572579.511168:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788572579.511170:0:202677:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788572579.511173:0:202677:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788572579.511178:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788572579.511220:0:202677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a372dd000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788572579.511231:0:202677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8e5904158000) 00000020:00000080:3.0:1788572579.511241:0:202677:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:3.0:1788572579.511909:0:202677:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788572579.511916:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bfc0c 00000020:00000080:3.0:1788572579.512017:0:202677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788572579.512024:0:202677:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788572579.512028:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x265cfe11109bfc13 00080000:01000000:3.0:1788572579.512032:0:202677:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788572579.512035:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109bfc1a 00010000:00010000:0.0:1788572579.640210:0:202677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:0.0:1788572579.640839:0:202677:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 25769803776 lx: 0 gen 86 00000001:00080000:0.0:1788572579.640953:0:202677:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b idx: 1 lr: 21474837549 srv lr: 25769803776 lx: 0 gen 85 00000001:00000004:0.0:1788572579.641191:0:202677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 7, last_transno is 25769803776 00000001:00080000:0.0:1788572579.641295:0:202677:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788572579.642069:0:202677:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8e5a1fdbc480: xid 1875444569567616, transno 25769803846, client gen 85, slot idx 0 00000001:00080000:0.0:1788572579.642086:0:202677:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8e5a1f8b3780: xid 1875444569564032, transno 25769803845, client gen 85, slot idx 1 00000020:00000080:1.0:1788572579.644536:0:202677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788572579.644551:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572579.644557:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572579.644560:0:202677:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788572579.644563:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572579.644570:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572579.644572:0:202677:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788572579.644576:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788572579.644581:0:202677:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:00000080:1.0:1788572579.644613:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788572579.644628:0:202677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8e59028a3380) 00000020:00000080:1.0:1788572579.644655:0:202677:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788572579.645886:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572579.646010:0:202677:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788572579.646018:0:202677:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788572579.646029:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109bfc36 00010000:00080000:3.0:1788572579.646081:0:202677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e59019df000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572579.647802:0:202677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:3.0:1788572579.655856:0:202677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572579.655874:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788572579.655920:0:202677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788572579.655942:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bfc3d 00000100:00080000:3.0:1788572579.655954:0:202677:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572579.655961:0:202677:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e59019df000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572579.655999:0:202677:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eaea00 x1875444584499456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572579.656030:0:202677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788572579.656089:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572579.656093:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.656095:0:202677:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788572579.656098:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572579.656101:0:202677:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788572579.656103:0:202677:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572579.656104:0:202677:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572579.656106:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572579.656108:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.656109:0:202677:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572579.656112:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572579.656117:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.656118:0:202677:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788572579.656122:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788572579.656150:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584499456:0@lo:38:llog_process_th.0 00000004:01000000:3.0:1788572579.656152:0:202677:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788572579.656167:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572579.656170:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.656172:0:202677:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788572579.656174:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572579.656175:0:202677:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788572579.656176:0:202677:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572579.656178:0:202677:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572579.656179:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572579.656182:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.656183:0:202677:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572579.656186:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788572579.656188:0:202677:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788572579.656191:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.656193:0:202677:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788572579.656195:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572579.656199:0:202677:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:3.0:1788572579.656222:0:202677:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788572579.656225:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:1.0:1788572579.656228:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788572579.656239:0:202677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8e5905f58000) 00000020:00000080:3.0:1788572579.656253:0:202677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788572579.656258:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788572579.656291:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584499456 00000100:00100000:1.0:1788572579.656298:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584499456 00000100:00100000:1.0:1788572579.656338:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1788572579.656345:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875444584499456:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788572579.656373:0:189111:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9332 last 0 00000020:00000080:1.0:1788572579.656408:0:189111:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bfc4b 00000004:00100000:1.0:1788572579.656424:0:189111:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572579.656544:0:189111:0:(import.c:65:import_set_state_nolock()) ffff8e5906755000 : changing import state from RECOVER to FULL 00000004:00080000:3.0:1788572579.656544:0:202677:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788572579.656549:0:202677:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788572579.656555:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109bfc52 00010000:00080000:3.0:1788572579.656577:0:202677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a3f8c7000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.157@tcp at head 00000100:00100000:1.0:1788572579.656591:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584499456:12345-0@lo:38:llog_process_th.0 Request processed in 245us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.656598:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1788572579.656634:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572579.656644:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 82 00000100:00080000:1.0:1788572579.656650:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788572579.656655:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788572579.656657:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019df000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572579.656663:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584499456:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572579.656710:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584499584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572579.656733:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572579.656762:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584499584 00000100:00100000:1.0:1788572579.656780:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584499584 00010000:00010000:3.0:1788572579.656787:0:202677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000100:00100000:1.0:1788572579.656805:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1788572579.656811:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584499584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572579.656836:0:188054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1788572579.656870:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584499584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.656875:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1788572579.657103:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584499584:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788572579.657272:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572579.657277:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788572579.657279:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572579.657284:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 9331 00000100:00080000:0.0:1788572579.657287:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572579.657292:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572579.657310:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffaf800 x1875444584499840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572579.657333:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572579.657336:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788572579.657338:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572579.657341:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 9331 00000100:00080000:0.0:1788572579.657343:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572579.657347:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572579.657356:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a1ffafb80 x1875444584500096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572579.657366:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572579.657369:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788572579.657370:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572579.657373:0:105698:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 9331 00000100:00080000:0.0:1788572579.657376:0:105698:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572579.657379:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e590b16f800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572579.657389:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a31c7ed80 x1875444584500224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572579.657426:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584499968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572579.657461:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.657516:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572579.657522:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584499712:0@lo:400:kworker.0 00000040:01000000:3.0:1788572579.657529:0:202677:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788572579.657544:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1788572579.657549:0:202677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788572579.657566:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584499840:0@lo:38:kworker.0 00000100:00100000:0.0:1788572579.657587:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.657603:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584500096:0@lo:38:kworker.0 00000100:00100000:0.0:1788572579.657621:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.657637:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584500224:0@lo:38:kworker.0 00000100:00100000:0.0:1788572579.657658:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.657681:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584500352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572579.657706:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.657739:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584499968 00000100:00100000:0.0:1788572579.657744:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584499968 00000100:00100000:0.0:1788572579.657785:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584499712 00000100:00100000:0.0:1788572579.657790:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584499712 00000100:00100000:0.0:1788572579.657802:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584499840 00000100:00100000:0.0:1788572579.657804:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584499840 00000100:00100000:0.0:1788572579.657813:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584500096 00000100:00100000:0.0:1788572579.657815:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584500096 00000100:00100000:0.0:1788572579.657823:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584500352 00000100:00100000:0.0:1788572579.657825:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584500352 00000100:00100000:0.0:1788572579.657838:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1788572579.657845:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584499968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572579.657895:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875444584499968:12345-0@lo:400:kworker.0 Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.657902:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1788572579.657918:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1788572579.657924:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584499712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572579.657948:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584499712:12345-0@lo:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.658085:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1788572579.658102:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1788572579.658108:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584500352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572579.658156:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584500352:12345-0@lo:400:kworker.0 Request processed in 48us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.658162:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1788572579.658175:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1788572579.658179:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584499840:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572579.658217:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584499840:12345-0@lo:38:kworker.0 Request processed in 36us (629us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572579.658223:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1788572579.658236:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1788572579.658240:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584500096:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572579.658268:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584500096:12345-0@lo:38:kworker.0 Request processed in 26us (646us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572579.658273:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1788572579.658290:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584500224 00000100:00100000:0.0:1788572579.658293:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584500224 00000100:00100000:0.0:1788572579.658313:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1788572579.658318:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584500224:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788572579.658346:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875444584500224:12345-0@lo:38:kworker.0 Request processed in 27us (687us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788572579.658352:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1788572579.658389:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584500352:0@lo:400:kworker.0 00000100:00080000:0.0:1788572579.658414:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572579.658418:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572579.658421:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584499840:0@lo:38:kworker.0 00000100:00080000:0.0:1788572579.658430:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572579.658433:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572579.658436:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584500096:0@lo:38:kworker.0 00000100:00080000:0.0:1788572579.658444:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572579.658447:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788572579.658450:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584500224:0@lo:38:kworker.0 00000100:00100000:0.0:1788572579.658476:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584499712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572579.658509:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875444584499968:0@lo:400:kworker.0 00000040:00080000:3.0:1788572579.658647:0:202677:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 5, last_idx 6 00000040:00080000:3.0:1788572579.659468:0:202677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572579.659520:0:202677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:3.0:1788572579.659783:0:202677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].1, 64 off8256 00000040:00080000:1.0:1788572579.661588:0:202682:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:1.0:1788572579.661596:0:202682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788572579.661782:0:202682:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 6, last_idx 7 00000040:00080000:1.0:1788572579.661805:0:202682:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x18:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788572579.664102:0:202682:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788572579.664111:0:202682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1c:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788572579.668068:0:202677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572579.668084:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788572579.668133:0:202677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788572579.668154:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bfc59 00000100:00080000:3.0:1788572579.668168:0:202677:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572579.668174:0:202677:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e5a3f8c7000 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572579.668213:0:202677:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ead180 x1875444584500480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572579.668250:0:202677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788572579.668325:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572579.668329:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.668332:0:202677:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788572579.668334:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572579.668338:0:202677:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788572579.668339:0:202677:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572579.668341:0:202677:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572579.668342:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572579.668344:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.668345:0:202677:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572579.668348:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788572579.668352:0:202677:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788572579.668355:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.668356:0:202677:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788572579.668359:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572579.668363:0:202677:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.157@tcp to nid 0x20000c0a8ca9d (192.168.202.157@tcp) 00000020:01000000:3.0:1788572579.668387:0:202677:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788572579.668390:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572579.668402:0:202677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8e5905f5cd40) 00000020:00000080:3.0:1788572579.668418:0:202677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788572579.668424:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572579.668504:0:202677:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788572579.668511:0:202677:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788572579.668517:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x265cfe11109bfc67 00010000:00080000:3.0:1788572579.668547:0:202677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e59019da800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.157@tcp at head 00010000:00010000:3.0:1788572579.668734:0:202677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788572579.668814:0:202677:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788572579.668831:0:202677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788572579.669149:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584500480:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788572579.669224:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.669287:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584500480 00000100:00100000:0.0:1788572579.669294:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584500480 00000100:00100000:0.0:1788572579.669326:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22735 00000100:00100000:0.0:1788572579.669334:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875444584500480:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788572579.669362:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9332 last 0 00000020:00000080:0.0:1788572579.669386:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bfc6e 00002000:00100000:0.0:1788572579.669399:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e5a31919000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788572579.669403:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788572579.669406:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788572579.669507:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788572579.669530:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8e5a3191a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572579.669579:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584500480:12345-0@lo:8:llog_process_th.0 Request processed in 243us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.669586:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22735 00000100:00100000:0.0:1788572579.669624:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788572579.669632:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 9 00000100:00080000:0.0:1788572579.669639:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788572579.669643:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788572579.669645:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a3f8c7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788572579.669657:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788572579.669662:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584500480:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1788572579.669684:0:202682:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788572579.669735:0:202682:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 9332664255082ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788572579.669742:0:202682:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788572579.679819:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572579.679842:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584500608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572579.679990:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788572579.680508:0:202677:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 5, last_idx 6 00000100:00100000:2.0:1788572579.680859:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584500608 00000100:00100000:2.0:1788572579.680868:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584500608 00000100:00100000:2.0:1788572579.680927:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6493 00000100:00100000:2.0:1788572579.680936:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584500608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572579.680967:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572579.681020:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584500608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.681027:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6493 00000100:00080000:2.0:1788572579.681046:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572579.681096:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584500608:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788572579.685186:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788572579.685214:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:0.0:1788572579.685218:0:194757:0:(genops.c:885:class_export_put()) final put ffff8e590b8c9800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:1.0:1788572579.685285:0:105698:0:(genops.c:844:class_export_destroy()) destroying export ffff8e590b8c9800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-OST0000 00000020:00000080:1.0:1788572579.685382:0:105698:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e590b8cf000 for lustre-OST0000 00000004:00080000:2.0:1788572579.688117:0:202673:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:00080000:1.0:1788572579.688584:0:202677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572579.688627:0:202677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:1.0:1788572579.688796:0:202677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].1, 64 off8256 00000040:00080000:0.0:1788572579.689689:0:202684:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:0.0:1788572579.689696:0:202684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788572579.689896:0:202684:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 6, last_idx 7 00000040:00080000:0.0:1788572579.689913:0:202684:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788572579.690036:0:202684:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788572579.690039:0:202684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788572579.692757:0:202677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788572579.692783:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788572579.692826:0:202677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788572579.692847:0:202677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bfc75 00000100:00080000:3.0:1788572579.692858:0:202677:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572579.692864:0:202677:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e59019da800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:3.0:1788572579.694639:0:202677:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36eac380 x1875444584500736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572579.694680:0:202677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788572579.694720:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584500736:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788572579.694782:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572579.694790:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.694792:0:202677:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788572579.694795:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572579.694799:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.694800:0:202677:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788572579.694802:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788572579.694804:0:202677:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788572579.694807:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572579.694808:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.694810:0:202677:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788572579.694812:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572579.694814:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1788572579.694816:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788572579.694816:0:202677:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788572579.694819:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788572579.694862:0:202677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572579.694865:0:202677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572579.694866:0:202677:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788572579.694869:0:202677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 46 count 46 00000100:00100000:1.0:1788572579.694920:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584500736 00000100:00100000:1.0:1788572579.694928:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584500736 00000100:00100000:1.0:1788572579.694964:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22736 00000100:00100000:1.0:1788572579.694973:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875444584500736:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788572579.695004:0:8704:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 9332 last 0 00000020:00000080:1.0:1788572579.695032:0:8704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x265cfe11109bfc7c 00002000:00100000:1.0:1788572579.695045:0:8704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8e5906751800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788572579.695049:0:8704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788572579.695052:0:8704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788572579.695143:0:8704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788572579.695175:0:8704:0:(import.c:65:import_set_state_nolock()) ffff8e590b8cf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572579.695242:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3640:x1875444584500736:12345-0@lo:8:llog_process_th.0 Request processed in 269us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.695250:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22736 00000100:00100000:1.0:1788572579.695307:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572579.695317:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788572579.695324:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788572579.695329:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788572579.695331:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e59019da800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788572579.695339:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788572579.695344:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875444584500736:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788572579.695402:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572579.695411:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584500864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572579.695501:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572579.695546:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584500864 00000100:00100000:1.0:1788572579.695550:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584500864 00000100:00100000:1.0:1788572579.695585:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6494 00000100:00100000:1.0:1788572579.695604:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584500864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572579.695620:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142656 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572579.695657:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584500864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.695664:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6494 00000100:00100000:1.0:1788572579.695695:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584500864:0@lo:13:osp-pre-1-1.0 00000020:01000000:0.0:1788572579.695982:0:202672:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788572579.696017:0:202672:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788572579.696042:0:202672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a24535400/0x265cfe11109bfbe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfbe9 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572579.696054:0:202672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a24535400/0x265cfe11109bfbe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfbe9 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572579.696063:0:202672:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a372dd000 from 1 10000000:01000000:0.0:1788572579.696066:0:202672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788572579.696091:0:202672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572579.696099:0:202672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572579.696107:0:202672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572579.696122:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584500992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572579.696159:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.696179:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b60c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788572579.696199:0:202684:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788572579.696275:0:202684:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 9332690794218ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788572579.696282:0:202684:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788572579.696388:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584500992 00000100:00100000:1.0:1788572579.696393:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584500992 00000100:00100000:1.0:1788572579.696424:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788572579.696430:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+21:202672:x1875444584500992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572579.696440:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572579.696454:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bfc83 expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.696823:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bfc83 expref: 22 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.696844:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bfc83 expref: 22 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.696853:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3600, rc 0) 00000100:00100000:1.0:1788572579.696902:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:202672:x1875444584500992:12345-0@lo:101:mount.lustre.0 Request processed in 472us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.696910:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788572579.696983:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584500992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572579.696997:0:202672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572579.697006:0:202672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572579.697027:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572579.698014:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501120:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788572579.698062:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.698090:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.698145:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584501120 00000100:00100000:1.0:1788572579.698151:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584501120 00000100:00100000:1.0:1788572579.698190:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788572579.698198:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:202672:x1875444584501120:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788572579.698214:0:201331:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788572579.698231:0:201331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788572579.698235:0:201331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788572579.698237:0:201331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788572579.698240:0:201331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788572579.698242:0:201331:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 343 00000100:00100000:1.0:1788572579.698449:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:202672:x1875444584501120:12345-0@lo:256:mount.lustre.0 Request processed in 251us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.698456:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788572579.698575:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fface00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501120:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788572579.699476:0:202672:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572579.699528:0:202672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.699541:0:202672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572579.699818:0:202672:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e5a372dd000 from 1 10000000:01000000:3.0:1788572579.699822:0:202672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572579.699858:0:202672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf400/0x265cfe11109bfc91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.699867:0:202672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf400/0x265cfe11109bfc91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.701168:0:202672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf400/0x265cfe11109bfc91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572579.701232:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572579.701451:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572579.701513:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5905274180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.701622:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584501248 00000100:00100000:1.0:1788572579.701633:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584501248 00000100:00100000:1.0:1788572579.701689:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788572579.701698:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1f9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:202672:x1875444584501248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572579.701714:0:201332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572579.701731:0:201332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd3c00/0x265cfe11109bfc98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bfc91 expref: -99 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.701758:0:201332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd3c00/0x265cfe11109bfc98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bfc91 expref: 23 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.701781:0:201332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd3c00/0x265cfe11109bfc98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bfc91 expref: 23 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.701790:0:201332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3c00, rc 0) 00000100:00100000:1.0:1788572579.701839:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1f9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501248:12345-0@lo:101:mount.lustre.0 Request processed in 142us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.701845:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000004:00080000:2.0:1788572579.702198:0:202673:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788572579.703725:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572579.703754:0:202672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf400/0x265cfe11109bfc91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfc98 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.703778:0:202672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf400/0x265cfe11109bfc91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bfc98 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572579.704041:0:202672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 7 count 7 00000040:00080000:3.0:1788572579.704332:0:202672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572579.704551:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:3.0:1788572579.704578:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 112 off8528 00000040:00080000:3.0:1788572579.704593:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 224 off8752 00000040:00080000:3.0:1788572579.704608:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8976 00000040:00080000:3.0:1788572579.704622:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 112 off9088 00000040:00080000:3.0:1788572579.704641:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 224 off9312 00000040:00080000:3.0:1788572579.704646:0:202672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 6 count 7 00000100:00100000:3.0:1788572579.704724:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572579.704807:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572579.704859:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906388840 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.704929:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584501376 00000100:00100000:1.0:1788572579.704937:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584501376 00000100:00100000:1.0:1788572579.704983:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788572579.704994:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572579.705115:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501376:12345-0@lo:501:mount.lustre.0 Request processed in 123us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.705123:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788572579.705240:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572579.705288:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572579.705339:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572579.705363:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.705462:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584501504 00000100:00100000:1.0:1788572579.705466:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584501504 00000100:00100000:1.0:1788572579.705518:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788572579.705524:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572579.705594:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501504:12345-0@lo:503:mount.lustre.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.705600:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788572579.705743:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501504:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788572579.706113:0:202672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788572579.706176:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572579.706216:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572579.706288:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.706462:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584501632 00000100:00100000:1.0:1788572579.706467:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584501632 00000100:00100000:1.0:1788572579.706533:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788572579.706540:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572579.706616:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501632:12345-0@lo:502:mount.lustre.0 Request processed in 76us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.706622:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788572579.706998:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36a4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572579.707187:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:3.0:1788572579.707215:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 112 off8528 00000040:00080000:3.0:1788572579.707232:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 224 off8752 00000040:00080000:3.0:1788572579.707248:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8976 00000040:00080000:3.0:1788572579.707266:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 112 off9088 00000100:00100000:3.0:1788572579.707290:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572579.707334:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572579.707364:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906388840 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.707401:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584501760 00000100:00100000:1.0:1788572579.707406:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584501760 00000100:00100000:1.0:1788572579.707439:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788572579.707447:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501760:12345-0@lo:502:mount.lustre.0 00000001:00100000:0.0:1788572579.707495:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788572579.707504:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000020:00000080:0.0:1788572579.707507:0:9513:0:(genops.c:885:class_export_put()) final put ffff8e5a071d2800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000100:00100000:1.0:1788572579.707533:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501760:12345-0@lo:502:mount.lustre.0 Request processed in 87us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.707540:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000020:00000080:2.0:1788572579.707609:0:186041:0:(genops.c:844:class_export_destroy()) destroying export ffff8e5a071d2800/02515dca-bbf0-45e0-bd6e-e76f0c89bd0b for lustre-OST0001 00000020:00000080:2.0:1788572579.707650:0:186041:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e5a071d0000 for lustre-OST0001 00000100:00100000:3.0:1788572579.707807:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572579.707849:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 224 off9312 00000040:00080000:3.0:1788572579.707859:0:202672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1788572579.709855:0:202686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572579.709870:0:202686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572579.709873:0:202686:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788572579.709880:0:202686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a372dd000 00000020:00000080:1.0:1788572579.709883:0:202686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572579.709892:0:202686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572579.709894:0:202686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572579.709895:0:202686:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788572579.709897:0:202686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572579.709899:0:202686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572579.709900:0:202686:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788572579.709903:0:202686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5a372dd000 00000020:00000080:1.0:1788572579.709905:0:202686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572579.709971:0:202686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572579.709974:0:202686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572579.709975:0:202686:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788572579.709978:0:202686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 7 count 7 00000020:01000000:3.0:1788572579.710518:0:202672:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788572579.710549:0:202672:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572579.710572:0:202672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf400/0x265cfe11109bfc91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfc98 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.710585:0:202672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a40dcf400/0x265cfe11109bfc91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfc98 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572579.710643:0:202672:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788572579.710646:0:202672:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5a372dd000 10000000:01000000:3.0:1788572579.710650:0:202672:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5a372dd000 10000000:01000000:3.0:1788572579.710655:0:202672:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788572579.710661:0:202672:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e5a372dd000 from 1 10000000:01000000:3.0:1788572579.710664:0:202672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572579.710699:0:202672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce400/0x265cfe11109bfc9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.710707:0:202672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce400/0x265cfe11109bfc9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.710718:0:202672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce400/0x265cfe11109bfc9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572579.710744:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572579.710827:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572579.710870:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a10db2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572579.710995:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584501888 00000100:00100000:2.0:1788572579.711005:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584501888 00000100:00100000:2.0:1788572579.711058:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788572579.711067:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:202672:x1875444584501888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572579.711080:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572579.711093:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a24534c00/0x265cfe11109bfca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bfc9f expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.711117:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a24534c00/0x265cfe11109bfca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bfc9f expref: 24 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.711127:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a24534c00/0x265cfe11109bfca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bfc9f expref: 24 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.711134:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a24534c00, rc 0) 00000100:00100000:2.0:1788572579.711182:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584501888:12345-0@lo:101:mount.lustre.0 Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.711188:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788572579.712009:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584501888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572579.712025:0:202672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce400/0x265cfe11109bfc9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfca6 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.712036:0:202672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce400/0x265cfe11109bfc9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bfca6 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572579.712234:0:202672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 52 count 51 00000040:00080000:3.0:1788572579.712465:0:202672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572579.712667:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].1, 224 off8416 00000040:00080000:3.0:1788572579.712692:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].2, 120 off8536 00000040:00080000:3.0:1788572579.712708:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].3, 168 off8704 00000040:00080000:3.0:1788572579.712721:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].4, 224 off8928 00000040:00080000:3.0:1788572579.712733:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].5, 224 off9152 00000040:00080000:3.0:1788572579.712746:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].6, 120 off9272 00000040:00080000:3.0:1788572579.712760:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].7, 168 off9440 00000040:00080000:3.0:1788572579.712788:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].8, 224 off9664 00000040:00080000:3.0:1788572579.712804:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].9, 224 off9888 00000040:00080000:3.0:1788572579.712818:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].10, 120 off10008 00000040:00080000:3.0:1788572579.712833:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].11, 224 off10232 00000040:00080000:3.0:1788572579.712848:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].12, 224 off10456 00000040:00080000:3.0:1788572579.712864:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].13, 88 off10544 00000040:00080000:3.0:1788572579.712880:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].14, 128 off10672 00000040:00080000:3.0:1788572579.717774:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].15, 144 off10816 00000040:00080000:3.0:1788572579.717796:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].16, 160 off10976 00000040:00080000:3.0:1788572579.717809:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].17, 224 off11200 00000040:00080000:3.0:1788572579.717821:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].18, 224 off11424 00000040:00080000:3.0:1788572579.717833:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].19, 80 off11504 00000040:00080000:3.0:1788572579.717846:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].20, 224 off11728 00000040:00080000:3.0:1788572579.717859:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].21, 224 off11952 00000040:00080000:3.0:1788572579.717871:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].22, 88 off12040 00000040:00080000:3.0:1788572579.717896:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].23, 128 off12168 00000040:00080000:3.0:1788572579.717915:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].24, 144 off12312 00000040:00080000:3.0:1788572579.717930:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].25, 160 off12472 00000040:00080000:3.0:1788572579.717943:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].26, 224 off12696 00000040:00080000:3.0:1788572579.717955:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].27, 224 off12920 00000040:00080000:3.0:1788572579.717968:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].28, 80 off13000 00000040:00080000:3.0:1788572579.717981:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].29, 224 off13224 00000040:00080000:3.0:1788572579.717994:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].30, 224 off13448 00000040:00080000:3.0:1788572579.718007:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].31, 88 off13536 00000040:00080000:3.0:1788572579.718019:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].32, 128 off13664 00000040:00080000:3.0:1788572579.718030:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].33, 144 off13808 00000040:00080000:3.0:1788572579.718042:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].34, 128 off13936 00000040:00080000:3.0:1788572579.718054:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].35, 224 off14160 00000040:00080000:3.0:1788572579.718065:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].36, 224 off14384 00000040:00080000:3.0:1788572579.718076:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].37, 80 off14464 00000040:00080000:3.0:1788572579.718088:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].38, 224 off14688 00000040:00080000:3.0:1788572579.718101:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].39, 224 off14912 00000040:00080000:3.0:1788572579.718112:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].40, 88 off15000 00000040:00080000:3.0:1788572579.718122:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].41, 128 off15128 00000040:00080000:3.0:1788572579.718133:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].42, 144 off15272 00000040:00080000:3.0:1788572579.718144:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].43, 128 off15400 00000040:00080000:3.0:1788572579.718156:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].44, 224 off15624 00000040:00080000:3.0:1788572579.718168:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].45, 224 off15848 00000040:00080000:3.0:1788572579.718180:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].46, 80 off15928 00000040:00080000:3.0:1788572579.718192:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].47, 224 off16152 00000040:00080000:3.0:1788572579.718204:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].48, 232 off16384 00000040:00080000:3.0:1788572579.718353:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].49, 224 off16608 00000040:00080000:3.0:1788572579.718374:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].50, 120 off16728 00000040:00080000:3.0:1788572579.718392:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].51, 224 off16952 00000040:00080000:3.0:1788572579.718398:0:202672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 51 count 51 00000100:00100000:3.0:1788572579.718570:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572579.718647:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572579.718828:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a10db2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572579.719283:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584502016 00000100:00100000:2.0:1788572579.719294:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584502016 00000100:00100000:2.0:1788572579.719358:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788572579.719369:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572579.719555:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502016:12345-0@lo:501:mount.lustre.0 Request processed in 187us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.719564:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788572579.719706:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572579.719750:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572579.719802:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.719823:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.719968:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584502144 00000100:00100000:3.0:1788572579.719972:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584502144 00000100:00100000:3.0:1788572579.720006:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788572579.720014:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572579.720135:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502144:12345-0@lo:503:mount.lustre.0 Request processed in 121us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.720142:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788572579.720265:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502144:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788572579.722361:0:202672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572579.722463:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572579.722569:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.722612:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.722760:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584502272 00000100:00100000:3.0:1788572579.722777:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584502272 00000100:00100000:3.0:1788572579.722827:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788572579.722837:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572579.723070:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502272:12345-0@lo:502:mount.lustre.0 Request processed in 233us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.723078:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788572579.724583:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572579.724833:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].1, 224 off8416 00000040:00080000:0.0:1788572579.724866:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].2, 120 off8536 00000040:00080000:0.0:1788572579.724891:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].3, 168 off8704 00000040:00080000:0.0:1788572579.724905:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].4, 224 off8928 00000040:00080000:0.0:1788572579.724916:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].5, 224 off9152 00000040:00080000:0.0:1788572579.724927:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].6, 120 off9272 00000040:00080000:0.0:1788572579.724942:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].7, 168 off9440 00000040:00080000:0.0:1788572579.724954:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].8, 224 off9664 00000040:00080000:0.0:1788572579.724964:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].9, 224 off9888 00000040:00080000:0.0:1788572579.724974:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].10, 120 off10008 00000040:00080000:0.0:1788572579.724985:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].11, 224 off10232 00000040:00080000:0.0:1788572579.724999:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].12, 224 off10456 00000040:00080000:0.0:1788572579.725010:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].13, 88 off10544 00000040:00080000:0.0:1788572579.725022:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].14, 128 off10672 00000040:00080000:0.0:1788572579.725035:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].15, 144 off10816 00000040:00080000:0.0:1788572579.725046:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].16, 160 off10976 00000040:00080000:0.0:1788572579.725059:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].17, 224 off11200 00000040:00080000:0.0:1788572579.725072:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].18, 224 off11424 00000040:00080000:0.0:1788572579.725083:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].19, 80 off11504 00000040:00080000:0.0:1788572579.725095:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].20, 224 off11728 00000040:00080000:0.0:1788572579.725107:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].21, 224 off11952 00000040:00080000:0.0:1788572579.725135:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].22, 88 off12040 00000040:00080000:0.0:1788572579.725150:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].23, 128 off12168 00000040:00080000:0.0:1788572579.725163:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].24, 144 off12312 00000040:00080000:0.0:1788572579.725175:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].25, 160 off12472 00000040:00080000:0.0:1788572579.725186:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].26, 224 off12696 00000040:00080000:0.0:1788572579.725198:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].27, 224 off12920 00000040:00080000:0.0:1788572579.725209:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].28, 80 off13000 00000040:00080000:0.0:1788572579.725221:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].29, 224 off13224 00000040:00080000:0.0:1788572579.725233:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].30, 224 off13448 00000040:00080000:0.0:1788572579.725246:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].31, 88 off13536 00000040:00080000:0.0:1788572579.725258:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].32, 128 off13664 00000040:00080000:0.0:1788572579.725270:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].33, 144 off13808 00000040:00080000:0.0:1788572579.725283:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].34, 128 off13936 00000040:00080000:0.0:1788572579.725296:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].35, 224 off14160 00000040:00080000:0.0:1788572579.725308:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].36, 224 off14384 00000040:00080000:0.0:1788572579.725321:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].37, 80 off14464 00000040:00080000:0.0:1788572579.725335:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].38, 224 off14688 00000040:00080000:0.0:1788572579.725349:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].39, 224 off14912 00000040:00080000:0.0:1788572579.725364:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].40, 88 off15000 00000040:00080000:0.0:1788572579.725377:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].41, 128 off15128 00000040:00080000:0.0:1788572579.725389:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].42, 144 off15272 00000040:00080000:0.0:1788572579.725402:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].43, 128 off15400 00000040:00080000:0.0:1788572579.725415:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].44, 224 off15624 00000040:00080000:0.0:1788572579.725427:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].45, 224 off15848 00000040:00080000:0.0:1788572579.725441:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].46, 80 off15928 00000040:00080000:0.0:1788572579.725454:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].47, 224 off16152 00000040:00080000:0.0:1788572579.725468:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].48, 232 off16384 00000100:00100000:0.0:1788572579.725548:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572579.725625:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.725672:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a411b66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.725675:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584502400 00000100:00100000:1.0:1788572579.725682:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584502400 00000100:00100000:1.0:1788572579.725905:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788572579.725914:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572579.726045:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502400:12345-0@lo:502:mount.lustre.0 Request processed in 131us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.726052:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788572579.729152:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572579.729426:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].49, 224 off16608 00000040:00080000:0.0:1788572579.729459:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].50, 120 off16728 00000100:00100000:1.0:1788572579.731010:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572579.731115:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572579.731162:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a373a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.731227:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584502528 00000100:00100000:3.0:1788572579.731238:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584502528 00000100:00100000:3.0:1788572579.731303:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788572579.731312:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572579.731457:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502528:12345-0@lo:502:mount.lustre.0 Request processed in 145us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.731465:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788572579.733164:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572579.733261:0:202672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].51, 224 off16952 00000040:00080000:0.0:1788572579.733278:0:202672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788572579.734279:0:202689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788572579.734297:0:202689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8e5a413f8000) 00000020:00000080:0.0:1788572579.734322:0:202689:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788572579.734398:0:202689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5a372dd000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788572579.734402:0:202689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5a372dd000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788572579.734404:0:202689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e5a372dd000 3 00010000:00080000:0.0:1788572579.734433:0:202689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5a08d21800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.157@tcp at head 00010000:00010000:1.0:1788572579.739933:0:202689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:1.0:1788572579.740166:0:202689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788572579.740217:0:202689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788572579.740231:0:202689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x265cfe11109bfcb4 00000100:00080000:1.0:1788572579.740243:0:202689:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788572579.740249:0:202689:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e5a08d21800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:1.0:1788572579.741235:0:202689:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36ea8a80 x1875444584502656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572579.741272:0:202689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788572579.741712:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584502656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788572579.741799:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.742025:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584502656 00000100:00100000:0.0:1788572579.742033:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584502656 00000040:00080000:1.0:1788572579.742749:0:202689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 52 count 51 00000020:01000000:1.0:1788572579.742835:0:202672:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788572579.742894:0:202672:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788572579.742917:0:202672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce400/0x265cfe11109bfc9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfca6 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.742931:0:202672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce400/0x265cfe11109bfc9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfca6 expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788572579.742995:0:202672:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788572579.742997:0:202672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788572579.742998:0:202672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572579.742999:0:202672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572579.743000:0:202672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572579.743002:0:202672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572579.743003:0:202672:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572579.743005:0:202672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572579.743006:0:202672:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788572579.743010:0:202672:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788572579.743013:0:202672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788572579.743014:0:202672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788572579.743015:0:202672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572579.743016:0:202672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572579.743017:0:202672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572579.743018:0:202672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572579.743020:0:202672:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572579.743021:0:202672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572579.743022:0:202672:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788572579.743051:0:202672:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788572579.743070:0:202672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502784:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788572579.743142:0:202672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572579.743172:0:202672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a373a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572579.743196:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1788572579.743206:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875444584502656:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788572579.743245:0:188050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 9332 last 0 00000020:00000080:0.0:1788572579.743285:0:188050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x265cfe11109bfcbb 00000004:00100000:0.0:1788572579.743303:0:188050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788572579.743442:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584502784 00000100:00100000:3.0:1788572579.743448:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584502784 00000100:00100000:3.0:1788572579.743505:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788572579.743513:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788572579.743536:0:201332:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788572579.743547:0:201332:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788572579.744438:0:188050:0:(import.c:65:import_set_state_nolock()) ffff8e5a08d26800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572579.744543:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875444584502656:12345-0@lo:38:llog_process_th.0 Request processed in 1336us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.744551:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:1.0:1788572579.745444:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572579.745457:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 82 00000100:00080000:1.0:1788572579.745465:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788572579.745471:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788572579.745474:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a08d21800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572579.745495:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875444584502656:0@lo:38:llog_process_th.0 00000001:00100000:0.0:1788572579.748654:0:201325:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788572579.748687:0:201332:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788572579.748695:0:201332:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788572579.748956:0:201334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572579.748963:0:201334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572579.748985:0:201334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.749006:0:201334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb65a expref: 9 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.749015:0:201334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bf84d expref: 24 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.749021:0:201334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bfc83 expref: 24 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.749028:0:201334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.749071:0:201334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bfc83 expref: 24 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.749084:0:201334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109bfc83 expref: 24 pid: 201330 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572579.749097:0:201334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584502912:0@lo:104: 00000100:00100000:2.0:1788572579.749160:0:201334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572579.749211:0:201334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x265cfe11109bf84d expref: 24 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.749219:0:201334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x265cfe11109bf84d expref: 24 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572579.749228:0:201334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584503040:0@lo:104: 00000100:00100000:2.0:1788572579.749247:0:201334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572579.749268:0:201334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb65a expref: 9 pid: 201332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.749277:0:201334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb65a expref: 9 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572579.749285:0:201334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a411b1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584503168:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572579.749451:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:202672:x1875444584502784:12345-0@lo:253:mount.lustre.0 Request processed in 5937us (6306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.749462:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788572579.749468:0:202672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e87131b0-4a60-4def-a26d-6e23dcfe5daa:202672:1875444584502784:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788572579.749503:0:202672:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788572579.749507:0:202672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788572579.749509:0:202672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788572579.749510:0:202672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572579.749511:0:202672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572579.749512:0:202672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572579.749513:0:202672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572579.749515:0:202672:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572579.749517:0:202672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572579.749519:0:202672:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788572579.749536:0:202672:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788572579.749812:0:201334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a36d59180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572579.749838:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584502912 00000100:00100000:2.0:1788572579.749845:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584502912 00000100:00100000:2.0:1788572579.749971:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584503040 00000100:00100000:2.0:1788572579.749974:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584503040 00000100:00100000:2.0:1788572579.749994:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5406 00000100:00100000:2.0:1788572579.750004:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+4:201334:x1875444584502912:12345-0@lo:104: 00010000:00010000:2.0:1788572579.750019:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.750069:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572579.750074:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+4:201334:x1875444584502912:12345-0@lo:104: Request processed in 73us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.750081:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5406 00000100:00100000:2.0:1788572579.750095:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5407 00000100:00100000:2.0:1788572579.750103:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:201334:x1875444584503040:12345-0@lo:104: 00010000:00010000:2.0:1788572579.750111:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.750140:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788572579.750145:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+3:201334:x1875444584503040:12345-0@lo:104: Request processed in 44us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.750151:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5407 00010000:00010000:2.0:1788572579.750170:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572579.750176:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.750184:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e800 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572579.750188:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.750197:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572579.750209:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572579.750215:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572579.750247:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.750253:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572579.750272:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.750279:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a4117e800/0x265cfe11109bfc83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bfc8a expref: -99 pid: 202672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.750289:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572579.750292:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.750297:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce600 already unused, calling callback (ffffffffc11f9c20) 10000000:00010000:2.0:1788572579.750300:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.750307:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572579.750313:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572579.750318:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572579.752163:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.752175:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572579.752199:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.752207:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.157@tcp lock: ffff8e5a40dce600/0x265cfe11109bf84d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x265cfe11109bf854 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572579.752227:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572579.752229:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572579.752231:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572579.752238:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572579.752276:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584503296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572579.752369:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572579.752430:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584503424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572579.752453:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572579.752540:0:201334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a3f8f2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584502912:0@lo:104: 00000100:00100000:2.0:1788572579.752550:0:201334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584503040:0@lo:104: 00000100:00100000:1.0:1788572579.754297:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584503296 00000100:00100000:1.0:1788572579.754309:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584503296 00010000:00010000:1.0:1788572579.754357:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bfc83 expref: 24 pid: 201330 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572579.754408:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584503424 00000100:00100000:1.0:1788572579.754412:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584503424 00010000:00010000:1.0:1788572579.754425:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bf84d expref: 25 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572579.754447:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12914 00000100:00100000:1.0:1788572579.754456:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+25:3644:x1875444584503296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572579.754472:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572579.754492:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bfc83 expref: 25 pid: 201330 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.754505:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109bfc83 expref: 25 pid: 201330 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.754523:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfc8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bfc83 expref: 25 pid: 201330 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.754538:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572579.754633:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3644:x1875444584503296:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.754640:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12914 00000100:00100000:1.0:1788572579.754661:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12915 00000100:00100000:1.0:1788572579.754667:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:3641:x1875444584503424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572579.754677:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572579.754682:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x265cfe11109bf84d expref: 23 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.754964:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x265cfe11109bf84d expref: 23 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.754978:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dcf200/0x265cfe11109bf854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x265cfe11109bf84d expref: 23 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572579.754990:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572579.755022:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:3641:x1875444584503424:12345-0@lo:103:ldlm_bl.0 Request processed in 355us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.755028:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12915 00000100:00100000:1.0:1788572579.755656:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584503424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572579.755710:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3644:1875444584503296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572579.759190:0:201334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a411b1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201334:1875444584503168:192.168.202.57@tcp:104: 00010000:00010000:3.0:1788572579.759227:0:201334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572579.759377:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572579.760567:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569585920 00000100:00100000:3.0:1788572579.760577:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569585920 00010000:00010000:3.0:1788572579.760606:0:8447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb65a expref: 10 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572579.760643:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12916 00000100:00100000:3.0:1788572579.760651:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569585920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572579.760666:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572579.760671:0:8447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb65a expref: 10 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760683:0:8447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb65a expref: 10 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760709:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a40dcfc00/0x265cfe11109bf846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb65a expref: 10 pid: 201332 timeout: 9432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760726:0:8447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760735:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788572579.760750:0:8447:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028152876s 00010000:00010000:3.0:1788572579.760755:0:8447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760769:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760777:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760783:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760789:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572579.760794:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760802:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760817:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760826:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572579.760886:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f79285ed-4685-45a8-8731-5e2522a143f3+9:2397:x1875444569585920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 234us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.760894:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12916 00010000:00010000:3.0:1788572579.760924:0:201334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760932:0:201334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572579.760939:0:201334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5a24535600/0x265cfe11109bfcc2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788572579.764043:0:202672:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 17179873001 00000040:01000000:2.0:1788572579.764414:0:202672:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788572579.764867:0:202695:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000020:00080000:1.0:1788572579.765066:0:202694:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 17179873001 00000020:00080000:1.0:1788572579.765070:0:202694:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000040:01000000:2.0:1788572579.765208:0:202672:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788572579.766109:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584503552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788572579.766181:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1788572579.766184:0:202672:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1788572579.766210:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0380c0c0 going to sleep for 11 seconds 00000040:00080000:2.0:1788572579.766222:0:202672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788572579.766683:0:202672:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788572579.766777:0:202672:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1788572579.766820:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584503552 00000040:00080000:1.0:1788572579.766824:0:202672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572579.766829:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584503552 00000100:00100000:0.0:1788572579.766940:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1788572579.767005:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584503552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.767086:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584503552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 137us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.767093:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000040:00080000:1.0:1788572579.767818:0:202672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788572579.768361:0:202672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788572579.768397:0:202672:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788572579.768564:0:202672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572579.769112:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584503552:0@lo:1000:lod0001_rec0000.0 00080000:10000000:1.0:1788572579.769123:0:202672:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x34:0x0] (8/32) registered 00000040:01000000:0.0:1788572579.769152:0:202696:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788572579.769198:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584503680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.769265:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.770920:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1734c6c0 going to sleep for 11 seconds 00000040:00080000:3.0:1788572579.771809:0:202695:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000400:0x1:0x0] first idx 3, last_idx 5 00000040:00080000:3.0:1788572579.771904:0:202695:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 5 synced_idx: 0 lgh_last_idx: 5 00000040:00080000:3.0:1788572579.771908:0:202695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x24000272a:0x1:0x0] at index 4 of catalog [0x240000400:0x1:0x0] 00000100:00100000:2.0:1788572579.773798:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584503680 00000100:00100000:2.0:1788572579.773810:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584503680 00010000:00080000:1.0:1788572579.775020:0:202672:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 25769803846 00000004:00080000:2.0:1788572579.775915:0:202695:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x24000272a:0x1:0x0].3 00000020:00080000:2.0:1788572579.775923:0:202695:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179873002 transno = 0 mdt_index 1 00000040:00080000:2.0:1788572579.775933:0:202695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x24000272a:0x1:0x0] index 4 count 2 00000040:00080000:2.0:1788572579.776093:0:202695:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1788572579.776098:0:202695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002ef8:0x1:0x0] at index 5 of catalog [0x240000400:0x1:0x0] 00000004:00080000:2.0:1788572579.776180:0:202695:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002ef8:0x1:0x0].1 00000020:00080000:2.0:1788572579.776184:0:202695:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 21474837550 transno = 0 mdt_index 1 00000004:00080000:2.0:1788572579.776196:0:202695:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002ef8:0x1:0x0].2 00000020:00080000:2.0:1788572579.776203:0:202695:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 21474837551 transno = 0 mdt_index 1 00000040:00080000:2.0:1788572579.776209:0:202695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x240002ef8:0x1:0x0] index 3 count 3 00000040:00080000:2.0:1788572579.776220:0:202695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 6 count 3 00000004:00080000:2.0:1788572579.776283:0:202695:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00080000:3.0:1788572579.778020:0:202697:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 202697 00010000:02000000:3.0:1788572579.778030:0:202697:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788572579.778034:0:202697:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788572579.778037:0:202697:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1788572579.778781:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1788572579.778795:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584503680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788572579.778994:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584503680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 202us (9728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.779002:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1788572579.779059:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584503680:0@lo:1000:lod0001_rec0000.0 00000020:01000004:1.0:1788572579.779067:0:202672:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788572579.779096:0:202672:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.157@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788572579.779115:0:202672:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788572579.779132:0:202672:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:0.0:1788572579.779151:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:202696:1875444584503808:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.779193:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.779262:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a12a56180 going to sleep for 11 seconds 00000020:00000004:1.0:1788572579.780236:0:202672:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788572579.782016:0:202672:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788572579.787917:0:188059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584503808 00000100:00100000:2.0:1788572579.787937:0:188059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584503808 00000100:00100000:2.0:1788572579.788135:0:188060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572579.788148:0:188060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a2735c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202696:x1875444584503808:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788572579.788276:0:188060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a2735c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202696:x1875444584503808:12345-0@lo:900:lod0001_rec0000.0 Request processed in 131us (9082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.788284:0:188060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572579.788408:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:202696:1875444584503808:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788572579.788538:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584503936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788572579.792288:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572579.792337:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584503936 00000100:00100000:2.0:1788572579.792345:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584503936 00000100:00100000:2.0:1788572579.792406:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1788572579.792418:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584503936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788572579.792534:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584503936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 118us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.792542:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1788572579.792572:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0a3080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572579.792601:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584503936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788572579.792719:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504064:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788572579.792796:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572579.792819:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584504064 00000100:00100000:2.0:1788572579.792823:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584504064 00000100:00100000:2.0:1788572579.792849:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1788572579.792857:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504064:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788572579.795332:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a0a308cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.807031:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504064:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 14167us (14226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.807046:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1788572579.809050:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504064:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788572579.809114:0:202696:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 10 00000100:00100000:0.0:1788572579.809247:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.809335:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.809374:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.809528:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584504192 00000100:00100000:3.0:1788572579.809535:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584504192 00000100:00100000:3.0:1788572579.809577:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1788572579.809586:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a72050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504192:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788572579.809751:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a72050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504192:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 165us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.809758:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1788572579.811887:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504192:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788572579.811940:0:202696:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 10 synced_idx: 0 lgh_last_idx: 10 00000040:00080000:0.0:1788572579.811945:0:202696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200027502:0x1:0x0] at index 7 of catalog [0x200000401:0x1:0x0] 00000100:00100000:0.0:1788572579.812935:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504320:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.813023:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.813054:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.813129:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584504320 00000100:00100000:3.0:1788572579.813136:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584504320 00000100:00100000:3.0:1788572579.813183:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1788572579.813192:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504320:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788572579.813275:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504320:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.813281:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1788572579.815161:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504320:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.815270:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504448:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.815348:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.815386:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.815530:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584504448 00000100:00100000:3.0:1788572579.815536:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584504448 00000100:00100000:3.0:1788572579.815576:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1788572579.815586:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504448:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788572579.815801:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504448:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 217us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.815809:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1788572579.816873:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504448:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.817032:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504576:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.817093:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.817122:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.818833:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584504576 00000100:00100000:3.0:1788572579.818852:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584504576 00000100:00100000:3.0:1788572579.818926:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1788572579.818936:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504576:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788572579.819157:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504576:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 221us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.819165:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1788572579.819785:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504576:0@lo:1000:lod0001_rec0000.0 00000004:00080000:0.0:1788572579.819837:0:202696:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200027502:0x1:0x0].2 00000020:00080000:0.0:1788572579.819844:0:202696:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179873001 transno = 21474837548 mdt_index 0 00000100:00100000:0.0:1788572579.819969:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504704:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.820039:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.820063:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.820149:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584504704 00000100:00100000:3.0:1788572579.820154:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584504704 00000100:00100000:3.0:1788572579.820189:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1788572579.820198:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504704:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788572579.820327:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504704:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 130us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.820335:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1788572579.820413:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffafb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504704:0@lo:1000:lod0001_rec0000.0 00000004:00080000:0.0:1788572579.820439:0:202696:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200027502:0x1:0x0].3 00000020:00080000:0.0:1788572579.820443:0:202696:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179873002 transno = 21474837549 mdt_index 0 00000040:00080000:0.0:1788572579.820453:0:202696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x200027502:0x1:0x0] index 4 count 3 00000040:00080000:0.0:1788572579.820476:0:202696:0:(llog.c:805:llog_process_thread()) index: 9, lh_last_idx: 10 synced_idx: 0 lgh_last_idx: 10 00000040:00080000:0.0:1788572579.820953:0:202696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200027cd1:0x1:0x0] at index 9 of catalog [0x200000401:0x1:0x0] 00000100:00100000:0.0:1788572579.821124:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504832:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.821157:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.821177:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.821252:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584504832 00000100:00100000:3.0:1788572579.821257:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584504832 00000100:00100000:3.0:1788572579.821293:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1788572579.821301:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504832:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788572579.821361:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504832:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.821367:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1788572579.823039:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504832:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.823137:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504960:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.823217:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.823239:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572579.823509:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584504960 00000100:00100000:3.0:1788572579.823516:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584504960 00000100:00100000:3.0:1788572579.823554:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1788572579.823563:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504960:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788572579.823796:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584504960:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 232us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.823804:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1788572579.826372:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584504960:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.826515:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505088:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.826605:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.826644:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584505088 00000100:00100000:0.0:1788572579.826651:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584505088 00000100:00100000:0.0:1788572579.826697:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1788572579.826707:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505088:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.828243:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505088:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1533us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.828255:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1788572579.828295:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572579.828317:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505088:0@lo:1000:lod0001_rec0000.0 00000004:00080000:0.0:1788572579.828362:0:202696:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200027cd1:0x1:0x0].1 00000020:00080000:0.0:1788572579.828368:0:202696:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 21474837550 transno = 25769803845 mdt_index 0 00000100:00100000:0.0:1788572579.828421:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505216:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.828473:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.828518:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.828796:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584505216 00000100:00100000:1.0:1788572579.828803:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584505216 00000100:00100000:1.0:1788572579.828841:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:1.0:1788572579.828848:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505216:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788572579.829050:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505216:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 202us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.829058:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1788572579.830214:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505216:0@lo:1000:lod0001_rec0000.0 00000004:00080000:0.0:1788572579.830268:0:202696:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200027cd1:0x1:0x0].2 00000020:00080000:0.0:1788572579.830274:0:202696:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 21474837551 transno = 25769803846 mdt_index 0 00000040:00080000:0.0:1788572579.830284:0:202696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x200027cd1:0x1:0x0] index 3 count 3 00000100:00100000:0.0:1788572579.830351:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505344:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.830421:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.830457:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.830508:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584505344 00000100:00100000:1.0:1788572579.830514:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584505344 00000100:00100000:1.0:1788572579.830556:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1788572579.830565:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505344:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788572579.830694:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505344:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 130us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.830700:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1788572579.832978:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505344:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788572579.833037:0:202696:0:(llog.c:805:llog_process_thread()) index: 10, lh_last_idx: 10 synced_idx: 10 lgh_last_idx: 10 00000040:00080000:0.0:1788572579.833042:0:202696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200027cd1:0x2:0x0] at index 10 of catalog [0x200000401:0x1:0x0] 00000100:00100000:0.0:1788572579.833122:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505472:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.833187:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.833229:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.833298:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584505472 00000100:00100000:1.0:1788572579.833305:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584505472 00000100:00100000:1.0:1788572579.833362:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1788572579.833370:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505472:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788572579.833437:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505472:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.833444:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1788572579.834989:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505472:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788572579.835061:0:202696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572579.835137:0:202696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505600:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788572579.835187:0:202696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.835222:0:202696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.835408:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584505600 00000100:00100000:1.0:1788572579.835415:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584505600 00000100:00100000:1.0:1788572579.835464:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1788572579.835475:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505600:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788572579.835621:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202696:x1875444584505600:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 148us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.835628:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1788572579.835831:0:202696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202696:1875444584505600:0@lo:1000:lod0001_rec0000.0 00000004:00080000:0.0:1788572579.835870:0:202696:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e59061c7240 with version 1 00000040:00080000:0.0:1788572579.836600:0:202696:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 10 00000004:00080000:0.0:1788572579.836616:0:202696:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e59061c7540 with version 2 00000004:00080000:2.0:1788572579.843314:0:202679:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5905274300 version 1 rpc_version 1 00000020:00100000:3.0:1788572579.843656:0:202679:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572579.843671:0:202679:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36eaca80 x1875444584505856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572579.843700:0:202679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584505856:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572579.843832:0:202679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572579.843895:0:202679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906388780 going to sleep for 11 seconds 00000040:00080000:0.0:1788572579.844198:0:202696:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200027cd1:0x2:0x0] at index 10 of catalog [0x200000401:0x1:0x0] 00000040:00080000:0.0:1788572579.844222:0:202696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 11 count 3 00000004:00080000:0.0:1788572579.844298:0:202696:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788572579.844303:0:202696:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:0.0:1788572579.844365:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584505856 00000100:00100000:0.0:1788572579.844373:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584505856 00000100:00100000:0.0:1788572579.844427:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1788572579.844437:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202679:x1875444584505856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788572579.844697:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:202679:x1875444584505856:12345-0@lo:1000:osp_up0-1.0 Request processed in 261us (865us total) trans 352187318274 rc 0/0 00000100:00100000:0.0:1788572579.844705:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00010000:00080000:3.0:1788572579.845030:0:202697:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1788572579.845086:0:202679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584505856:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788572579.845098:0:202679:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5905274300 version 2 rpc_version 2 00000020:00100000:3.0:1788572579.845115:0:202679:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788572579.845121:0:202679:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a36eaf480 x1875444584506112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572579.845149:0:202679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584506112:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572579.845182:0:202679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572579.845207:0:202679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906388780 going to sleep for 11 seconds 00000100:00100000:1.0:1788572579.845223:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584506112 00000100:00100000:1.0:1788572579.845227:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584506112 00000100:00100000:1.0:1788572579.845266:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1788572579.845274:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202679:x1875444584506112:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788572579.845448:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202679:x1875444584506112:12345-0@lo:1000:osp_up0-1.0 Request processed in 176us (265us total) trans 352187318275 rc 0/0 00000100:00100000:1.0:1788572579.845456:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1788572579.845695:0:202679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584506112:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1788572580.476711:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572581.102996:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572581.103195:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569586048 00000100:00100000:1.0:1788572581.103206:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569586048 00000100:00100000:1.0:1788572581.103271:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 116 00000100:00100000:1.0:1788572581.103283:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+9:160932:x1875444569586048:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572581.103302:0:201331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572581.103329:0:201331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfcc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb668 expref: -99 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572581.103361:0:201331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfcc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb668 expref: 10 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572581.103374:0:201331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a1fcd3600/0x265cfe11109bfcc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb668 expref: 10 pid: 201331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572581.103384:0:201331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3600, rc 0) 00000100:00100000:1.0:1788572581.103448:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569586048:12345-192.168.202.57@tcp:101:ll_cfg_requeue.0 Request processed in 168us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572581.103455:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 116 00000100:00100000:2.0:1788572581.106820:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572581.106894:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569586176 00000100:00100000:3.0:1788572581.106912:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569586176 00000100:00100000:3.0:1788572581.106967:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 117 00000100:00100000:3.0:1788572581.106977:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569586176:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572581.107004:0:201332:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788572581.107028:0:201332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572581.107031:0:201332:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 344 00000100:00100000:3.0:1788572581.108910:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:160932:x1875444569586176:12345-192.168.202.57@tcp:256:ll_cfg_requeue.0 Request processed in 1917us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572581.108925:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 117 00000100:00100000:2.0:1788572581.138195:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572581.138608:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569586304 00000100:00100000:0.0:1788572581.138618:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569586304 00000100:00100000:0.0:1788572581.138660:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1368 00000100:00100000:0.0:1788572581.138668:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1875444569586304:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1788572581.138699:0:196070:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '02515dca-bbf0-45e0-bd6e-e76f0c89bd0b' at ffff8e5904e04800, cookie 0x265cfe11109bfc28 00010000:00080000:0.0:1788572581.138705:0:196070:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp recovering/t25769803846 exp ffff8e5904e04800 cur 9334 last 1788572579 00010000:02000400:0.0:1788572581.138723:0:196070:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788572581.138730:0:196070:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788572581.138758:0:196070:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788572581.138905:0:196070:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f311000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572581.138980:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569586304:12345-192.168.202.57@tcp:38:ll_cfg_requeue.0 Request processed in 310us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572581.138988:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1368 00000100:00100000:2.0:1788572581.153919:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572581.154022:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569586432 00000100:00100000:3.0:1788572581.154036:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569586432 00000100:00100000:3.0:1788572581.154105:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 604 00000100:00100000:3.0:1788572581.154116:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569586432:12345-192.168.202.57@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788572581.154148:0:188048:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e590a84ea00 x1875444569586432/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:242/0 lens 224/0 e 0 to 0 dl 1788572592 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572581.154176:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569586432:12345-192.168.202.57@tcp:400:ldlm_lock_repla.0 Request processed in 63us (271us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572581.154184:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 604 00010000:00080000:1.0:1788572581.154277:0:202697:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788572581.500766:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788572581.765711:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788572581.765720:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a372dd000 from 344 10000000:01000000:1.0:1788572581.765725:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788572581.765774:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bfcd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572581.765786:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bfcd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572581.765798:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bfcd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572581.766012:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584506240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572581.766082:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572581.766125:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1886a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572581.767403:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584506240 00000100:00100000:2.0:1788572581.767416:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584506240 00000100:00100000:2.0:1788572581.767466:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788572581.767476:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+22:6515:x1875444584506240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572581.767521:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572581.767539:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a24535c00/0x265cfe11109bfcd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bfcd0 expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572581.767568:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a24535c00/0x265cfe11109bfcd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bfcd0 expref: 23 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572581.767585:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a24535c00/0x265cfe11109bfcd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bfcd0 expref: 23 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572581.767595:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a24535c00, rc 0) 00000100:00100000:2.0:1788572581.767666:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584506240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572581.767673:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788572581.768360:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584506240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572581.768377:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bfcd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfcd7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572581.768386:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bfcd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bfcd7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572581.768460:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584506368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788572581.768523:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572581.768557:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e59061c7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572581.769338:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584506368 00000100:00100000:2.0:1788572581.769346:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584506368 00000100:00100000:2.0:1788572581.769400:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788572581.769409:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584506368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788572581.769432:0:201332:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788572581.769451:0:201332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788572581.769454:0:201332:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 344 00000100:00100000:2.0:1788572581.769578:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584506368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572581.769585:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788572581.770068:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584506368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788572581.770130:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788572581.770138:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bfcd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfcd7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572581.770148:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2800/0x265cfe11109bfcd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfcd7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572581.770158:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788572581.770160:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e5a41346800 from 344 10000000:01000000:1.0:1788572581.770164:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788572581.770190:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2e00/0x265cfe11109bfcde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572581.770197:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2e00/0x265cfe11109bfcde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572581.770205:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2e00/0x265cfe11109bfcde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572581.770221:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584506496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572581.770840:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572581.771340:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584506496 00000100:00100000:0.0:1788572581.771347:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584506496 00000100:00100000:0.0:1788572581.771388:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788572581.771396:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+23:6515:x1875444584506496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572581.771408:0:201330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572581.771423:0:201330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5a4117e600/0x265cfe11109bfce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x265cfe11109bfcde expref: -99 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572581.771448:0:201330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5a4117e600/0x265cfe11109bfce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bfcde expref: 24 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572581.771458:0:201330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5a4117e600/0x265cfe11109bfce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bfcde expref: 24 pid: 201330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572581.771467:0:201330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e600, rc 0) 00000100:00100000:0.0:1788572581.771518:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584506496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572581.771525:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788572581.771963:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1886ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572581.771985:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584506496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572581.772001:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2e00/0x265cfe11109bfcde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfce5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572581.772012:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2e00/0x265cfe11109bfcde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x265cfe11109bfce5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572581.772071:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584506624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788572581.772107:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572581.772121:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1886ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572581.772221:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584506624 00000100:00100000:0.0:1788572581.772226:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584506624 00000100:00100000:0.0:1788572581.772588:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788572581.772597:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584506624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788572581.772615:0:201330:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788572581.772633:0:201330:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788572581.772636:0:201330:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 344 00000100:00100000:0.0:1788572581.773388:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:6515:x1875444584506624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 788us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572581.773397:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788572581.773771:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e87131b0-4a60-4def-a26d-6e23dcfe5daa:6515:1875444584506624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788572581.774373:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572581.774385:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2e00/0x265cfe11109bfcde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfce5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572581.774396:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.157@tcp lock: ffff8e5a1fcd2e00/0x265cfe11109bfcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfce5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572582.524684:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572583.553901:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572584.306001:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572584.306041:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572584.306070:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569586560 00000100:00100000:0.0:1788572584.306080:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569586560 00000100:00100000:0.0:1788572584.306132:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 122 00000100:00100000:0.0:1788572584.306143:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569586560:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572584.306225:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569586560:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.306234:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 122 00000100:00100000:0.0:1788572584.306270:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569586688 00000100:00100000:0.0:1788572584.306274:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569586688 00000100:00100000:0.0:1788572584.306316:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 605 00000100:00100000:0.0:1788572584.306323:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569586688:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572584.306355:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569586688:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 32us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.306361:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 605 00000100:00080000:0.0:1788572584.306462:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572584.316751:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572584.316779:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584506752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572584.316857:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572584.316906:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584506752 00000100:00100000:3.0:1788572584.316914:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584506752 00000100:00100000:3.0:1788572584.316974:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6495 00000100:00100000:3.0:1788572584.316985:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584506752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572584.317016:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142656 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572584.317065:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875444584506752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.317072:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6495 00000100:00080000:3.0:1788572584.317097:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572584.317132:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584506752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572584.319682:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584506880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572584.319747:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572584.319806:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584506880 00000100:00100000:3.0:1788572584.319813:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584506880 00000100:00100000:3.0:1788572584.319863:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6496 00000100:00100000:3.0:1788572584.319872:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584506880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572584.319902:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572584.319943:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584506880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.319950:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6496 00000100:00080000:3.0:1788572584.319972:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572584.320002:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584506880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572584.574127:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572584.829920:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584507008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572584.829991:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.830053:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584507008 00000100:00100000:0.0:1788572584.830061:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584507008 00000100:00100000:0.0:1788572584.830109:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1788572584.830118:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1875444584507008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572584.830159:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1788572584.830204:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1875444584507008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.830211:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1788572584.830256:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584507008:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788572584.833256:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572584.833263:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788572584.833267:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572584.833281:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e5901975800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572584.833300:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a40520380 x1875444584507392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572584.833331:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572584.833334:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788572584.833336:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572584.833340:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e5a40ddc800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572584.833350:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5a36947480 x1875444584507648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572584.833359:0:105698:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572584.833362:0:105698:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788572584.833364:0:105698:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572584.833368:0:105698:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e590b16f800 using connection 192.168.202.157@tcp/0@lo 00000100:00100000:0.0:1788572584.833381:0:105698:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e590a2d0380 x1875444584507776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572584.833436:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584507136:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.833540:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.833599:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584508032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.833628:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.833665:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572584.833671:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584507264:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.833703:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.833724:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584508160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.833749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.833791:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584507136 00000100:00100000:0.0:1788572584.833802:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584507136 00000100:00100000:0.0:1788572584.833857:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788572584.833867:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584507136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.833917:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3641:x1875444584507136:12345-0@lo:400:kworker.0 Request processed in 52us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.833925:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788572584.833959:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584508032 00000100:00100000:0.0:1788572584.833963:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584508032 00000100:00100000:0.0:1788572584.834003:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584508160 00000100:00100000:0.0:1788572584.834006:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584508160 00000100:00100000:0.0:1788572584.834027:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7942 00000100:00100000:0.0:1788572584.834033:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584508032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834065:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584508032:12345-0@lo:400:kworker.0 Request processed in 32us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.834075:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7942 00000100:00100000:0.0:1788572584.834085:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7943 00000100:00100000:0.0:1788572584.834091:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584508160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834117:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1875444584508160:12345-0@lo:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.834135:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7943 00000100:00100000:0.0:1788572584.834152:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584507264 00000100:00100000:0.0:1788572584.834155:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584507264 00000100:00100000:0.0:1788572584.834183:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1788572584.834189:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584507264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834219:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875444584507264:12345-0@lo:400:kworker.0 Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.834225:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00080000:0.0:1788572584.834246:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572584.834250:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572584.834252:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572584.834273:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584507520:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834299:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.834317:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584508288:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834336:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.834353:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572584.834359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584507904:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834378:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.834400:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584507520 00000100:00100000:0.0:1788572584.834403:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584507520 00000100:00100000:0.0:1788572584.834428:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584508288 00000100:00100000:0.0:1788572584.834431:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584508288 00000100:00100000:0.0:1788572584.834443:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584507904 00000100:00100000:0.0:1788572584.834446:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584507904 00000100:00100000:0.0:1788572584.834460:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1788572584.834465:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584507520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834517:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875444584507520:12345-0@lo:400:kworker.0 Request processed in 52us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.834523:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1788572584.834536:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1788572584.834542:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584508288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834579:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875444584508288:12345-0@lo:400:kworker.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.834585:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1788572584.834597:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1788572584.834603:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584507904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834628:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875444584507904:12345-0@lo:400:kworker.0 Request processed in 26us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.834634:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00080000:0.0:1788572584.834660:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572584.834692:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875444584507904:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834703:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875444584507520:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834711:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875444584508288:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834752:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875444584507264:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834762:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584508160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834772:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3641:1875444584507136:0@lo:400:kworker.0 00000100:00100000:0.0:1788572584.834783:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584508032:0@lo:400:kworker.0 00000100:00100000:1.0:1788572584.834964:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584507392:0@lo:38:kworker.0 00000100:00100000:1.0:1788572584.835003:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.835031:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584507648:0@lo:38:kworker.0 00000100:00100000:1.0:1788572584.835051:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.835068:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584507776:0@lo:38:kworker.0 00000100:00100000:1.0:1788572584.835090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.835131:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584507776 00000100:00100000:1.0:1788572584.835136:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584507776 00000100:00100000:1.0:1788572584.835161:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1788572584.835166:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875444584507776:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572584.835191:0:188053:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8e5904e06000, cookie 0x265cfe11109bfc21 00010000:00080000:1.0:1788572584.835196:0:188053:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8e5904e06000 cur 9337 last 1788572579 00000004:00100000:1.0:1788572584.835216:0:188053:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572584.835351:0:188053:0:(import.c:65:import_set_state_nolock()) ffff8e590cc73800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572584.835393:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584507776:12345-0@lo:38:kworker.0 Request processed in 226us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572584.835400:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00010000:00080000:1.0:1788572584.835420:0:202697:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788572584.835425:0:202697:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 25769803847 00000020:00080000:1.0:1788572584.835431:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 21474837548 00010000:00080000:1.0:1788572584.835434:0:202697:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 25769803847 00010000:00080000:1.0:1788572584.835437:0:202697:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (25769803847) 00000020:00080000:1.0:1788572584.835440:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 21474837548 00000020:00080000:1.0:1788572584.835450:0:202697:0:(update_records.c:53:update_records_dump()) master transno = 21474837548 batchid = 17179873001 flags = 0 ops = 7 params = 4 00000020:00080000:1.0:1788572584.835453:0:202697:0:(update_records.c:72:update_records_dump()) update 0th [0x200027501:0x2:0x0] delete params_count = 1 00000020:00080000:1.0:1788572584.835456:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a1d6a5cc4 0th off = 0 size = 11 00000020:00080000:1.0:1788572584.835459:0:202697:0:(update_records.c:72:update_records_dump()) update 1th [0x200027501:0x2:0x0] ref_del params_count = 0 00000020:00080000:1.0:1788572584.835461:0:202697:0:(update_records.c:72:update_records_dump()) update 2th [0x240002729:0x1:0x0] ref_del params_count = 0 00000020:00080000:1.0:1788572584.835463:0:202697:0:(update_records.c:72:update_records_dump()) update 3th [0x240002729:0x1:0x0] ref_del params_count = 0 00000020:00080000:1.0:1788572584.835466:0:202697:0:(update_records.c:72:update_records_dump()) update 4th [0x200027501:0x2:0x0] attr_set params_count = 1 00000020:00080000:1.0:1788572584.835468:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a1d6a5cdc 0th off = 1 size = 208 00000020:00080000:1.0:1788572584.835470:0:202697:0:(update_records.c:72:update_records_dump()) update 5th [0x240002729:0x1:0x0] destroy params_count = 0 00000020:00080000:1.0:1788572584.835473:0:202697:0:(update_records.c:72:update_records_dump()) update 6th [0x200000001:0x15:0x0] write params_count = 2 00000020:00080000:1.0:1788572584.835476:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a1d6a5db4 0th off = 2 size = 32 00000020:00080000:1.0:1788572584.835499:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a1d6a5ddc 1th off = 3 size = 8 00000100:00100000:1.0:1788572584.835592:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584508416:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.835622:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.835641:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572584.835657:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584508416 00000100:00100000:1.0:1788572584.835661:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584508416 00000100:00100000:1.0:1788572584.835688:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1788572584.835694:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202697:x1875444584508416:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.835802:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202697:x1875444584508416:12345-0@lo:1000:tgt_recover_1.0 Request processed in 108us (179us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572584.835809:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1788572584.835830:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584507392 00000100:00100000:1.0:1788572584.835834:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584507392 00000100:00100000:1.0:1788572584.835852:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584507648 00000100:00100000:1.0:1788572584.835855:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584507648 00000100:00100000:1.0:1788572584.835870:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1788572584.835875:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584507392:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572584.835889:0:188049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9337 last 0 00000020:00000080:1.0:1788572584.835927:0:188049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x265cfe11109bfcec 00000004:00100000:1.0:1788572584.835935:0:188049:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572584.835960:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e590cc71800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572584.835990:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875444584507392:12345-0@lo:38:kworker.0 Request processed in 113us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572584.835997:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1788572584.836010:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:1.0:1788572584.836014:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875444584507648:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572584.836027:0:188049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 9337 last 0 00000020:00000080:1.0:1788572584.836049:0:188049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x265cfe11109bfcf3 00000004:00100000:1.0:1788572584.836056:0:188049:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572584.836071:0:188049:0:(import.c:65:import_set_state_nolock()) ffff8e5a071d0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572584.836098:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875444584507648:12345-0@lo:38:kworker.0 Request processed in 82us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572584.836104:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00010000:00080000:1.0:1788572584.836146:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a40520380 x1875444584507392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572584.836163:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 7 00000100:00080000:1.0:1788572584.837072:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff8e5a40520380 x1875444584507392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572609 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572584.837082:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572584.837086:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5901975800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572584.837089:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572584.837095:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875444584507392:0@lo:38:kworker.0 00010000:00080000:1.0:1788572584.837118:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a36947480 x1875444584507648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572584.837129:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 7 00000100:00080000:1.0:1788572584.837991:0:3640:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff8e5a36947480 x1875444584507648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572609 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572584.838002:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572584.838005:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e5a40ddc800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572584.838010:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572584.838016:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875444584507648:0@lo:38:kworker.0 00000100:00080000:1.0:1788572584.838040:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 7 00000100:00080000:1.0:1788572584.838048:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788572584.838052:0:3640:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00080000:1.0:1788572584.838055:0:3640:0:(recover.c:53:ptlrpc_replay_next()) import ffff8e590b16f800 from lustre-MDT0001_UUID committed 0 last 0 00000100:00080000:1.0:1788572584.838058:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1788572584.838250:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584508416:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.838359:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584508544:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.852620:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.852669:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572584.852798:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584508544 00000100:00100000:0.0:1788572584.852809:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584508544 00000100:00100000:0.0:1788572584.852866:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1788572584.852876:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202697:x1875444584508544:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1788572584.853028:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202697:x1875444584508544:12345-0@lo:1000:tgt_recover_1.0 Request processed in 153us (417us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572584.853036:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1788572584.853152:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584508544:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.853286:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584508672:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.853318:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.853342:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572584.853447:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584508672 00000100:00100000:0.0:1788572584.853452:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584508672 00000100:00100000:0.0:1788572584.853506:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1788572584.853513:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202697:x1875444584508672:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1788572584.853589:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202697:x1875444584508672:12345-0@lo:1000:tgt_recover_1.0 Request processed in 75us (269us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572584.853595:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1788572584.855545:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584507776:0@lo:38:kworker.0 00010000:00080000:0.0:1788572584.855676:0:202897:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00010000:00010000:0.0:1788572584.855682:0:202897:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-osp-MDT0000 (0) 00010000:00010000:0.0:1788572584.855689:0:202897:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-osp-MDT0000 00000100:00080000:0.0:1788572584.856171:0:202897:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788572584.856435:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584508800:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788572584.856542:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.857237:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584508800 00000100:00100000:1.0:1788572584.857246:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584508800 00000100:00100000:1.0:1788572584.857304:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1788572584.857314:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584508800:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788572584.857334:0:188054:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8e590a84df80 x1875444584508800/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:245/0 lens 224/0 e 0 to 0 dl 1788572595 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572584.857346:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875444584508800:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 35us (805us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572584.857353:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1788572584.857394:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36ea8700 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584508672:0@lo:1000:tgt_recover_1.0 00000020:00080000:1.0:1788572584.857541:0:202694:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000004:00080000:1.0:1788572584.857602:0:202694:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e590a0010c0 with version 3 00000020:00080000:1.0:1788572584.857614:0:202694:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17179873001 cancel update log [0x200027502:0x1:0x0].2: rc = 0 00000020:00080000:1.0:1788572584.857618:0:202694:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000004:00080000:1.0:1788572584.857626:0:202679:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5905274300 version 3 rpc_version 3 00000020:00100000:1.0:1788572584.857652:0:202679:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572584.857659:0:202679:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a31cd3100 x1875444584509056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572584.857675:0:202679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584509056:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788572584.857716:0:202679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.857738:0:202679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572584.857752:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584509056 00000100:00100000:1.0:1788572584.857755:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584509056 00000100:00100000:1.0:1788572584.857775:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1788572584.857781:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202679:x1875444584509056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788572584.857940:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202679:x1875444584509056:12345-0@lo:1000:osp_up0-1.0 Request processed in 159us (223us total) trans 352187318276 rc 0/0 00000100:00100000:1.0:1788572584.857948:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1788572584.859112:0:202679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584509056:0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1788572584.859162:0:202697:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 66 seconds 00000020:00080000:1.0:1788572584.859167:0:202697:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474837548 00000020:00080000:1.0:1788572584.859175:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 21474837549 00010000:00080000:1.0:1788572584.859178:0:202697:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769803847 00010000:00080000:1.0:1788572584.859182:0:202697:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (25769803847) 00000020:00080000:1.0:1788572584.859184:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 21474837549 00000020:00080000:1.0:1788572584.859198:0:202697:0:(update_records.c:53:update_records_dump()) master transno = 21474837549 batchid = 17179873002 flags = 0 ops = 12 params = 20 00000020:00080000:1.0:1788572584.859202:0:202697:0:(update_records.c:72:update_records_dump()) update 0th [0x240002729:0x16:0x0] create params_count = 2 00000020:00080000:1.0:1788572584.859206:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313154 0th off = 0 size = 208 00000020:00080000:1.0:1788572584.859209:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f31322c 1th off = 1 size = 16 00000020:00080000:1.0:1788572584.859211:0:202697:0:(update_records.c:72:update_records_dump()) update 1th [0x240002729:0x16:0x0] ref_add params_count = 0 00000020:00080000:1.0:1788572584.859214:0:202697:0:(update_records.c:72:update_records_dump()) update 2th [0x240002729:0x16:0x0] insert params_count = 3 00000020:00080000:1.0:1788572584.859217:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313244 0th off = 2 size = 2 00000020:00080000:1.0:1788572584.859219:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313254 1th off = 3 size = 16 00000020:00080000:1.0:1788572584.859221:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f31326c 2th off = 4 size = 4 00000020:00080000:1.0:1788572584.859224:0:202697:0:(update_records.c:72:update_records_dump()) update 3th [0x240002729:0x16:0x0] insert params_count = 3 00000020:00080000:1.0:1788572584.859226:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f31327c 0th off = 5 size = 3 00000020:00080000:1.0:1788572584.859229:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f31322c 1th off = 1 size = 16 00000020:00080000:1.0:1788572584.859231:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f31326c 2th off = 4 size = 4 00000020:00080000:1.0:1788572584.859233:0:202697:0:(update_records.c:72:update_records_dump()) update 4th [0x240002729:0x16:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1788572584.859235:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f31328c 0th off = 6 size = 12 00000020:00080000:1.0:1788572584.859237:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3132a4 1th off = 7 size = 48 00000020:00080000:1.0:1788572584.859239:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3132dc 2th off = 8 size = 4 00000020:00080000:1.0:1788572584.859241:0:202697:0:(update_records.c:72:update_records_dump()) update 5th [0x240002729:0x16:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1788572584.859244:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3132ec 0th off = 9 size = 9 00000020:00080000:1.0:1788572584.859246:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313304 1th off = 10 size = 5 00000020:00080000:1.0:1788572584.859248:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3132dc 2th off = 8 size = 4 00000020:00080000:1.0:1788572584.859250:0:202697:0:(update_records.c:72:update_records_dump()) update 6th [0x200027501:0x4:0x0] insert params_count = 3 00000020:00080000:1.0:1788572584.859253:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313314 0th off = 11 size = 11 00000020:00080000:1.0:1788572584.859255:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313254 1th off = 3 size = 16 00000020:00080000:1.0:1788572584.859257:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f31332c 2th off = 12 size = 4 00000020:00080000:1.0:1788572584.859259:0:202697:0:(update_records.c:72:update_records_dump()) update 7th [0x200027501:0x4:0x0] ref_add params_count = 0 00000020:00080000:1.0:1788572584.859261:0:202697:0:(update_records.c:72:update_records_dump()) update 8th [0x240002729:0x16:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1788572584.859264:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f31333c 0th off = 13 size = 13 00000020:00080000:1.0:1788572584.859266:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313354 1th off = 14 size = 52 00000020:00080000:1.0:1788572584.859269:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3132dc 2th off = 8 size = 4 00000020:00080000:1.0:1788572584.859271:0:202697:0:(update_records.c:72:update_records_dump()) update 9th [0x200027501:0x4:0x0] attr_set params_count = 1 00000020:00080000:1.0:1788572584.859273:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313394 0th off = 15 size = 208 00000020:00080000:1.0:1788572584.859275:0:202697:0:(update_records.c:72:update_records_dump()) update 10th [0x240002729:0x16:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1788572584.859278:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f31346c 0th off = 16 size = 16 00000020:00080000:1.0:1788572584.859280:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313484 1th off = 17 size = 8 00000020:00080000:1.0:1788572584.859282:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3132dc 2th off = 8 size = 4 00000020:00080000:1.0:1788572584.859284:0:202697:0:(update_records.c:72:update_records_dump()) update 11th [0x200000001:0x15:0x0] write params_count = 2 00000020:00080000:1.0:1788572584.859287:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f313494 0th off = 18 size = 32 00000020:00080000:1.0:1788572584.859289:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3134bc 1th off = 19 size = 8 00000100:00100000:1.0:1788572584.859410:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509184:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.859453:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.859506:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001840 going to sleep for 11 seconds 00000001:00080000:1.0:1788572584.861769:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318276 is committed 00000100:00100000:0.0:1788572584.863277:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584509184 00000100:00100000:0.0:1788572584.863294:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584509184 00000100:00100000:0.0:1788572584.863383:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1788572584.863397:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509184:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1788572584.863638:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509184:12345-0@lo:1000:tgt_recover_1.0 Request processed in 242us (4182us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572584.863646:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1788572584.868653:0:202697:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318276 gen 2 00000004:00080000:1.0:1788572584.868669:0:202697:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318274 committed transno 352187318276 00000004:00080000:1.0:1788572584.868695:0:202697:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318275 committed transno 352187318276 00000004:00080000:1.0:1788572584.868705:0:202697:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318276 committed transno 352187318276 00000100:00100000:1.0:1788572584.868725:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509184:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.868842:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509312:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.868909:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.868950:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572584.869016:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584509312 00000100:00100000:0.0:1788572584.869023:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584509312 00000100:00100000:0.0:1788572584.869078:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1788572584.869088:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509312:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1788572584.869218:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509312:12345-0@lo:1000:tgt_recover_1.0 Request processed in 131us (309us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572584.869227:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:1.0:1788572584.869381:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509312:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.869446:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509440:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.869470:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.869521:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572584.869793:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584509440 00000100:00100000:0.0:1788572584.869799:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584509440 00000100:00100000:0.0:1788572584.869834:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1788572584.869842:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509440:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1788572584.869915:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509440:12345-0@lo:1000:tgt_recover_1.0 Request processed in 74us (444us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572584.869922:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1788572584.869996:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509440:0@lo:1000:tgt_recover_1.0 00010000:00080000:1.0:1788572584.870069:0:202697:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 66 seconds 00000020:00080000:1.0:1788572584.870073:0:202697:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474837549 00000020:00080000:1.0:1788572584.870087:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 25769803845 00010000:00080000:1.0:1788572584.870090:0:202697:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769803847 00010000:00080000:1.0:1788572584.870093:0:202697:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (25769803847) 00000020:00080000:1.0:1788572584.870096:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 25769803845 00000020:00080000:1.0:1788572584.870107:0:202697:0:(update_records.c:53:update_records_dump()) master transno = 25769803845 batchid = 21474837550 flags = 0 ops = 7 params = 4 00000020:00080000:1.0:1788572584.870110:0:202697:0:(update_records.c:72:update_records_dump()) update 0th [0x200027501:0x4:0x0] delete params_count = 1 00000020:00080000:1.0:1788572584.870114:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a1d6a5ac4 0th off = 0 size = 11 00000020:00080000:1.0:1788572584.870116:0:202697:0:(update_records.c:72:update_records_dump()) update 1th [0x200027501:0x4:0x0] ref_del params_count = 0 00000020:00080000:1.0:1788572584.870118:0:202697:0:(update_records.c:72:update_records_dump()) update 2th [0x240002729:0x16:0x0] ref_del params_count = 0 00000020:00080000:1.0:1788572584.870131:0:202697:0:(update_records.c:72:update_records_dump()) update 3th [0x240002729:0x16:0x0] ref_del params_count = 0 00000020:00080000:1.0:1788572584.870134:0:202697:0:(update_records.c:72:update_records_dump()) update 4th [0x200027501:0x4:0x0] attr_set params_count = 1 00000020:00080000:1.0:1788572584.870136:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a1d6a5adc 0th off = 1 size = 208 00000020:00080000:1.0:1788572584.870139:0:202697:0:(update_records.c:72:update_records_dump()) update 5th [0x240002729:0x16:0x0] destroy params_count = 0 00000020:00080000:1.0:1788572584.870141:0:202697:0:(update_records.c:72:update_records_dump()) update 6th [0x200000001:0x15:0x0] write params_count = 2 00000020:00080000:1.0:1788572584.870143:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a1d6a5bb4 0th off = 2 size = 32 00000020:00080000:1.0:1788572584.870145:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a1d6a5bdc 1th off = 3 size = 8 00000100:00100000:1.0:1788572584.870177:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509568:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.870204:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.870227:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584509568 00000100:00100000:1.0:1788572584.870230:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584509568 00000100:00100000:1.0:1788572584.870255:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1788572584.870262:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509568:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.870319:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509568:12345-0@lo:1000:tgt_recover_1.0 Request processed in 57us (113us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572584.870329:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1788572584.870346:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572584.870357:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509568:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.870395:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509696:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.870417:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.870434:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584509696 00000100:00100000:1.0:1788572584.870438:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584509696 00000100:00100000:1.0:1788572584.870457:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1788572584.870463:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509696:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.870545:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509696:12345-0@lo:1000:tgt_recover_1.0 Request processed in 81us (126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572584.870552:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1788572584.870578:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572584.870590:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cd1500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509696:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.870652:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c83b80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509824:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.870676:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.870693:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584509824 00000100:00100000:1.0:1788572584.870696:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584509824 00000100:00100000:1.0:1788572584.870716:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1788572584.870733:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509824:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.870788:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509824:12345-0@lo:1000:tgt_recover_1.0 Request processed in 66us (111us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572584.870795:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1788572584.870812:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572584.870824:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c83b80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509824:0@lo:1000:tgt_recover_1.0 00010000:00080000:1.0:1788572584.870864:0:202697:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 66 seconds 00000020:00080000:1.0:1788572584.870867:0:202697:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t25769803845 00000020:00080000:1.0:1788572584.870873:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 25769803846 00010000:00080000:1.0:1788572584.870876:0:202697:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769803847 00010000:00080000:1.0:1788572584.870878:0:202697:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (25769803847) 00000020:00080000:1.0:1788572584.870880:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 25769803846 00000020:00080000:1.0:1788572584.870888:0:202697:0:(update_records.c:53:update_records_dump()) master transno = 25769803846 batchid = 21474837551 flags = 0 ops = 10 params = 16 00000020:00080000:1.0:1788572584.870890:0:202697:0:(update_records.c:72:update_records_dump()) update 0th [0x240002729:0x2b:0x0] create params_count = 2 00000020:00080000:1.0:1788572584.870893:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7922 0th off = 0 size = 208 00000020:00080000:1.0:1788572584.870896:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c79fa 1th off = 1 size = 16 00000020:00080000:1.0:1788572584.870898:0:202697:0:(update_records.c:72:update_records_dump()) update 1th [0x240002729:0x2b:0x0] ref_add params_count = 0 00000020:00080000:1.0:1788572584.870900:0:202697:0:(update_records.c:72:update_records_dump()) update 2th [0x240002729:0x2b:0x0] insert params_count = 3 00000020:00080000:1.0:1788572584.870902:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7a12 0th off = 2 size = 2 00000020:00080000:1.0:1788572584.870904:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7a22 1th off = 3 size = 16 00000020:00080000:1.0:1788572584.870905:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7a3a 2th off = 4 size = 4 00000020:00080000:1.0:1788572584.870907:0:202697:0:(update_records.c:72:update_records_dump()) update 3th [0x240002729:0x2b:0x0] insert params_count = 3 00000020:00080000:1.0:1788572584.870909:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7a4a 0th off = 5 size = 3 00000020:00080000:1.0:1788572584.870911:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c79fa 1th off = 1 size = 16 00000020:00080000:1.0:1788572584.870912:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7a3a 2th off = 4 size = 4 00000020:00080000:1.0:1788572584.870914:0:202697:0:(update_records.c:72:update_records_dump()) update 4th [0x240002729:0x2b:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1788572584.870916:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7a5a 0th off = 6 size = 12 00000020:00080000:1.0:1788572584.870918:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7a72 1th off = 7 size = 48 00000020:00080000:1.0:1788572584.870919:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7aaa 2th off = 8 size = 4 00000020:00080000:1.0:1788572584.870921:0:202697:0:(update_records.c:72:update_records_dump()) update 5th [0x240002729:0x2b:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1788572584.870923:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7aba 0th off = 9 size = 9 00000020:00080000:1.0:1788572584.870925:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7ad2 1th off = 10 size = 5 00000020:00080000:1.0:1788572584.870927:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7aaa 2th off = 8 size = 4 00000020:00080000:1.0:1788572584.870929:0:202697:0:(update_records.c:72:update_records_dump()) update 6th [0x200027501:0x7:0x0] insert params_count = 3 00000020:00080000:1.0:1788572584.870933:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7ae2 0th off = 11 size = 11 00000020:00080000:1.0:1788572584.870935:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7a22 1th off = 3 size = 16 00000020:00080000:1.0:1788572584.870937:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7afa 2th off = 12 size = 4 00000020:00080000:1.0:1788572584.870939:0:202697:0:(update_records.c:72:update_records_dump()) update 7th [0x200027501:0x7:0x0] ref_add params_count = 0 00000020:00080000:1.0:1788572584.870942:0:202697:0:(update_records.c:72:update_records_dump()) update 8th [0x240002729:0x2b:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1788572584.870944:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7b0a 0th off = 13 size = 13 00000020:00080000:1.0:1788572584.870946:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7b22 1th off = 14 size = 52 00000020:00080000:1.0:1788572584.870949:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7aaa 2th off = 8 size = 4 00000020:00080000:1.0:1788572584.870951:0:202697:0:(update_records.c:72:update_records_dump()) update 9th [0x200027501:0x7:0x0] attr_set params_count = 1 00000020:00080000:1.0:1788572584.870953:0:202697:0:(update_records.c:87:update_records_dump()) param = ffff8e5a0f3c7b62 0th off = 15 size = 208 00000100:00100000:1.0:1788572584.871046:0:202697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c83b80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509952:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.871070:0:202697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.871089:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584509952 00000100:00100000:1.0:1788572584.871093:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584509952 00000100:00100000:1.0:1788572584.871113:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1788572584.871119:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509952:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1788572584.871166:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202697:x1875444584509952:12345-0@lo:1000:tgt_recover_1.0 Request processed in 47us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572584.871173:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1788572584.871189:0:202697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001780 going to sleep for 11 seconds 00000100:00100000:1.0:1788572584.871201:0:202697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c83b80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202697:1875444584509952:0@lo:1000:tgt_recover_1.0 00010000:00080000:1.0:1788572584.871234:0:202697:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 66 seconds 00000020:00080000:1.0:1788572584.871237:0:202697:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t25769803846 00000020:00080000:1.0:1788572584.871244:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1788572584.871246:0:202697:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769803847 00010000:00080000:1.0:1788572584.871249:0:202697:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788572584.871251:0:202697:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1788572584.871259:0:202697:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788572584.871262:0:202697:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000020:00080000:0.0:1788572584.872015:0:202694:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00000001:00100000:1.0:1788572584.879610:0:202673:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00000004:0.0:1788572584.883358:0:202697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 7, last_transno is 30064771072 00000001:00100000:0.0:1788572584.885113:0:202673:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788572584.885340:0:202697:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788572584.885391:0:202697:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:1.0:1788572584.885408:0:202697:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.202.57@tcp: req@ffff8e590a84ea00 x1875444569586432/t0(0) o400->02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp:242/0 lens 224/0 e 0 to 0 dl 1788572592 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788572584.885599:0:202697:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8e590a84df80 x1875444584508800/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:245/0 lens 224/0 e 0 to 0 dl 1788572595 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788572584.885672:0:202697:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1788572584.892792:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788572584.892811:0:3640:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8e5905a9f100 x1875444584508800/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572600 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572584.892821:0:3640:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8e5905a9f100 x1875444584508800/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572600 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572584.892827:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8e590b16f800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788572584.892846:0:3640:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1788572584.892853:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cc74e409): req@ffff8e5a36944e00 x1875444584491008/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572574 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572584.892868:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875444584508800:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788572584.892951:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584510080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572584.893024:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.893076:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.893136:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584510080 00000100:00100000:0.0:1788572584.893144:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584510080 00000100:00100000:0.0:1788572584.893191:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584491008 00000100:00100000:0.0:1788572584.893195:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584491008 00000100:00100000:0.0:1788572584.893207:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1788572584.893216:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1875444584510080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572584.893253:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445986304 avail 1299746816 00000100:00100000:0.0:1788572584.893297:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1875444584510080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.893304:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1788572584.893323:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1788572584.893328:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584491008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572584.893338:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445986304 avail 1299746816 00000100:00100000:0.0:1788572584.893358:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875444584491008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 30us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.893364:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1788572584.893389:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584510080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572584.893398:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584491008:0@lo:41:osp-pre-1-0.0 00000004:00000080:1.0:1788572584.940033:0:202697:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaac7886dfe10 00100000:10000000:1.0:1788572584.940052:0:202697:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:1.0:1788572584.947651:0:202683:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x26b:0x0] 00000100:00100000:1.0:1788572584.947712:0:202683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c83b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:202683:1875444584510208:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788572584.947782:0:202683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.947820:0:202683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001780 going to sleep for 11 seconds 00000004:00080000:1.0:1788572584.947834:0:202685:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x26b:0x0] 00000100:00100000:1.0:1788572584.947852:0:202685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c81c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:202685:1875444584510336:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788572584.947886:0:202685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572584.947906:0:202685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572584.947930:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584510208 00000100:00100000:1.0:1788572584.947937:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584510208 00000100:00100000:1.0:1788572584.947984:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584510336 00000100:00100000:1.0:1788572584.947987:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584510336 00000100:00100000:1.0:1788572584.948015:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22737 00000100:00100000:1.0:1788572584.948024:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:202683:x1875444584510208:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788572584.948062:0:41719:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 641 -> diff = -22 00002000:02000040:1.0:1788572584.948067:0:41719:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:620 to 0x280000400:641) 00000100:00100000:2.0:1788572584.948368:0:43924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22738 00000100:00100000:2.0:1788572584.948383:0:43924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:202685:x1875444584510336:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788572584.948404:0:43924:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 641 -> diff = -22 00002000:02000040:2.0:1788572584.948408:0:43924:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:620 to 0x2c0000400:641) 00002000:00010000:1.0:1788572584.969023:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x281:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572584.969038:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.969056:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x281:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:1.0:1788572584.969061:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572584.969067:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.969085:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.969097:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.969106:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970285:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572584.970604:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572584.970613:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970624:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572584.970630:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970648:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970673:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970681:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f22be55/0x265cfe11109bfcfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970707:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.970709:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.970711:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572584.970848:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572584.970855:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970866:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x280:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:1.0:1788572584.970871:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x280:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572584.970878:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970889:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970897:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970906:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970924:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572584.970932:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572584.970936:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970943:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572584.970947:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970954:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970964:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970971:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b19748/0x265cfe11109bfd01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.970984:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.970986:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.970988:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572584.971028:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572584.971034:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.971042:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27f:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:1.0:1788572584.971045:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572584.971050:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.971058:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.971066:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.971073:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.971088:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572584.971095:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572584.971100:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.971108:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572584.971111:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.974719:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.974754:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.974763:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d833cd/0x265cfe11109bfd08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.974800:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.974803:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.974806:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572584.974958:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572584.974965:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.974977:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27e:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:1.0:1788572584.974981:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572584.974988:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.974999:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975009:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975019:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975050:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572584.975059:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572584.975064:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975072:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572584.975076:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975084:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975096:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975104:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd45f9c/0x265cfe11109bfd0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975503:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.975506:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.975508:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572584.975574:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572584.975580:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975589:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27d:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:1.0:1788572584.975592:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572584.975597:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975606:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975614:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975622:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975639:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572584.975646:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572584.975650:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975657:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572584.975660:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975668:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975678:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975689:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c54f98/0x265cfe11109bfd16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975702:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.975703:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.975704:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572584.975748:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572584.975753:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975761:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27c:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:1.0:1788572584.975764:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572584.975768:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975776:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975783:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975790:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975804:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572584.975812:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572584.975816:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975823:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572584.975826:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975833:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975843:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975850:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000369c866/0x265cfe11109bfd1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975863:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.975865:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.975866:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572584.975907:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572584.975912:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975920:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27b:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:1.0:1788572584.975924:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572584.975928:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975943:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975951:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975960:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975973:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572584.975980:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572584.975985:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.975992:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572584.975995:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.976003:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.976014:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.976021:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000648acb57/0x265cfe11109bfd24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.976034:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.976036:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572584.976038:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572584.976079:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572584.976085:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.976093:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27a:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:1.0:1788572584.976096:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572584.976100:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.976109:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.977542:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572584.977568:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987492:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572584.987653:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x279:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.987664:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987682:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x279:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.987687:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x279:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.987694:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987711:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987722:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987732:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987751:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572584.987761:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572584.987768:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987777:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572584.987782:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987798:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987816:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987825:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109bfd2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987855:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572584.987859:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987866:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572584.987870:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987878:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987887:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987895:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbf22cf/0x265cfe11109bfd32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987913:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572584.987915:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572584.987917:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572584.987958:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.987963:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987972:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x278:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.987976:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x278:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.987980:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987990:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.987998:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.988006:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.988019:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572584.988025:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572584.988029:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.988042:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572584.988045:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.988054:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.988063:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.988071:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109bfd39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.988083:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572584.988085:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572584.988086:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.988232:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572584.990980:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x281:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572584.990994:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991011:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x281:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572584.991016:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572584.991022:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991040:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991050:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991057:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991084:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572584.991098:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.991104:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991112:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.991192:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991204:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991220:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991229:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882df698/0x265cfe11109bfd40 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991249:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.991251:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.991253:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572584.991375:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572584.991380:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991389:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x280:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572584.991394:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x280:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572584.991398:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991408:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991416:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991423:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991437:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572584.991444:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.991448:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991455:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.991459:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991468:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991499:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991513:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098438f09/0x265cfe11109bfd47 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991527:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.991529:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.991531:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572584.991589:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572584.991595:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991603:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27f:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572584.991606:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572584.991610:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991619:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991627:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991635:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991651:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572584.991660:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.991665:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991673:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.991676:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991684:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991695:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991703:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c1de08/0x265cfe11109bfd4e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991715:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.991717:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.991719:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572584.991758:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572584.991763:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991770:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27e:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572584.991773:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572584.991777:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991789:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991797:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991805:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991818:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572584.991825:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.991829:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991836:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.991839:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991848:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991858:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991865:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df48b94/0x265cfe11109bfd55 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991879:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.991881:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.991883:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572584.991923:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572584.991928:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991936:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27d:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572584.991940:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572584.991944:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991953:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991962:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991971:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.991983:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572584.991991:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.991996:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.992009:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.992012:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.992020:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.992030:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.992037:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109bfd5c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.992049:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.992051:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.992053:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572584.992094:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572584.992099:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.992108:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27c:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572584.992110:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572584.992114:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572584.992252:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x277:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.992261:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992270:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x277:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.992273:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x277:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.992277:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992287:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992297:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992304:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992324:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572584.992383:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x276:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.992387:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992394:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x276:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.992396:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x276:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.992400:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992408:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992415:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992421:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992437:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788572584.992471:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.992492:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992500:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x275:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.992503:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x275:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.992507:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992515:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992522:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992529:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992542:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788572584.992589:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x274:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.992594:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992602:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x274:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.992606:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.992610:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992619:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992628:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992636:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992649:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788572584.992685:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x273:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.992690:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992698:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x273:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.992702:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x273:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.992706:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992715:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992723:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992732:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992744:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788572584.992830:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x272:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.992835:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992843:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x272:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.992846:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.992850:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992859:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992866:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992873:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992883:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788572584.992921:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x271:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.992926:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992934:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x271:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.992937:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x271:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.992941:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992948:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992956:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992963:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.992972:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788572584.993006:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x270:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.993011:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993019:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x270:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.993022:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x270:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.993026:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993035:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993048:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993056:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993064:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788572584.993098:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.993104:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993112:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26f:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.993115:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.993132:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993142:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993151:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993159:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993174:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788572584.993208:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.993213:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993222:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26e:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.993225:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.993229:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993238:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993246:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993255:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993262:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1788572584.993292:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.993296:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993303:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26d:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.993307:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.993311:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993319:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993326:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993333:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993342:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1788572584.993373:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572584.993378:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993385:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26c:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:0.0:1788572584.993387:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572584.993391:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993400:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993408:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993416:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572584.993426:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00080000:0.0:1788572584.993451:0:41719:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:619 00000100:00100000:0.0:1788572584.993626:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:202683:x1875444584510208:12345-0@lo:5:osp-pre-0-1.0 Request processed in 45597us (45838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.993639:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22737 00000100:00100000:0.0:1788572584.993733:0:202683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c83b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:202683:1875444584510208:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788572584.993756:0:202683:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x281:0x0] from OST, last_created [0x280000400:0x281:0x0]last_used is [0x280000400:0x26b:0x0] 00000100:00100000:0.0:1788572584.993850:0:202683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:202683:1875444584510592:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788572584.993901:0:202683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.993927:0:202683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5901082900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572584.993950:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584510464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572584.993977:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572584.994024:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584510592 00000100:00100000:0.0:1788572584.994033:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584510592 00000100:00100000:0.0:1788572584.994083:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22739 00000100:00100000:0.0:1788572584.994093:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:202683:x1875444584510592:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788572584.994144:0:43931:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 642 00010000:00010000:3.0:1788572584.997316:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.997340:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.997350:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.997372:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1788572584.997383:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.997392:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.997397:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998198:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998222:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998230:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ec085e9/0x265cfe11109bfd6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998255:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1788572584.998260:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998267:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998270:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998277:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998286:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998292:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000369485c5/0x265cfe11109bfd71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998304:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788572584.998308:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998314:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998317:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998324:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998331:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998338:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109bfd78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998348:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788572584.998352:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998357:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998360:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998368:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998376:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998385:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109bfd7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998396:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788572584.998399:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998406:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998409:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998417:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998426:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998433:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000158e06e6/0x265cfe11109bfd86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998444:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788572584.998448:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998454:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998456:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998463:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998472:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998506:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e146b85/0x265cfe11109bfd8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998521:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572584.998524:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998531:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998534:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998542:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998551:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998569:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000264b752f/0x265cfe11109bfd94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998582:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572584.998586:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998592:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998595:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998610:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998620:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998628:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f09fca3/0x265cfe11109bfd9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998639:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572584.998643:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998649:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998652:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998660:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998668:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998675:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd40334/0x265cfe11109bfda2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998691:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572584.998694:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998701:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998704:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998712:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998720:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998728:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7775266/0x265cfe11109bfda9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998739:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572584.998743:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998750:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998753:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998766:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998776:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998784:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000486d357c/0x265cfe11109bfdb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998798:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.998802:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998809:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.998812:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998821:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998830:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998838:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f35faf6/0x265cfe11109bfdb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.998856:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.998858:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.998861:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.998875:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.998882:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.998888:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.998894:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572584.998916:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584510464 00000100:00100000:3.0:1788572584.998925:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584510464 00000100:00100000:3.0:1788572584.998985:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6497 00000100:00100000:3.0:1788572584.998995:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584510464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572584.999024:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 896 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572584.999185:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584510464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (5138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.999194:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6497 00000100:00100000:3.0:1788572584.999260:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584510464:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788572584.999297:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572584.999311:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.999315:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999323:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.999327:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999336:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999350:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999358:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109bfd63 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999375:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.999377:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.999379:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572584.999520:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572584.999526:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999538:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27b:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572584.999542:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572584.999549:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999569:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999578:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999587:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999604:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572584.999611:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.999615:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999622:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.999626:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999634:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999645:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999653:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041ff25cc/0x265cfe11109bfdbe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999666:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.999668:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.999669:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572584.999707:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572584.999713:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999721:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27a:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572584.999724:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572584.999729:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999738:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999746:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999753:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999765:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572584.999771:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.999775:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999781:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.999785:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999792:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999802:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999814:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109bfdc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999830:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.999831:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.999832:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572584.999873:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x279:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572584.999879:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999886:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x279:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572584.999889:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x279:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572584.999893:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999903:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999909:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999916:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999930:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572584.999938:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572584.999941:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999947:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572584.999951:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999958:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999967:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999975:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109bfdcc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572584.999986:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.999988:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572584.999989:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.000028:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.000034:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.000041:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x278:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572585.000043:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x278:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.000047:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.000060:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.000069:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.000076:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.000089:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.000096:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.000100:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.000106:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.000109:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.000116:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572585.001769:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+6:202683:x1875444584510592:12345-0@lo:5:osp-pre-0-1.0 Request processed in 7670us (7861us total) trans 38654705691 rc 0/0 00000100:00100000:0.0:1788572585.001782:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22739 00010000:00010000:3.0:1788572585.005780:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.005791:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021141236/0x265cfe11109bfdd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.005826:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.005828:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.005832:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.005968:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x277:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.005975:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.005990:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x277:0x0].0x0 since=9337s v=(0 0) 00010000:00010000:3.0:1788572585.005995:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x277:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.006003:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.006017:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.006029:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.006038:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.006062:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.006071:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.006076:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.006090:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.006095:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.006105:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007220:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007237:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005596a00/0x265cfe11109bfdda lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007259:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.007261:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.007263:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.007348:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x276:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.007355:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007367:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x276:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.007370:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x276:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.007376:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007389:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007399:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007407:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007424:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.007432:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.007437:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007444:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfc00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.007449:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007458:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007469:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007492:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdb9d8c/0x265cfe11109bfde1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.007506:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.007508:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.007510:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.007550:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.007555:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008216:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x275:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.008220:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x275:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.008225:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008236:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008245:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008253:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008269:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.008280:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.008284:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008291:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.008295:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008308:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008317:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008325:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000051222cf/0x265cfe11109bfde8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008340:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.008342:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.008344:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.008394:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x274:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.008399:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008408:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x274:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.008411:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.008416:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008425:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008432:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008440:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008454:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.008461:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.008466:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008472:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.008476:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008508:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008519:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008526:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d191e09f/0x265cfe11109bfdef lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008539:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.008541:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.008543:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.008592:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x273:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.008598:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008606:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x273:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.008609:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x273:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.008614:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008623:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008632:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008639:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008652:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.008659:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.008663:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008671:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.008674:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008683:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008693:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008701:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001220ef24/0x265cfe11109bfdf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008713:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.008715:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.008717:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.008755:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x272:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.008761:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008769:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x272:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.008772:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.008776:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008785:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008793:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008801:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008818:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.008825:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.008829:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008836:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.008839:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008848:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008859:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008867:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f944a62c/0x265cfe11109bfdfd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008882:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.008884:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.008886:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.008927:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x271:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.008932:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008941:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x271:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.008945:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x271:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.008949:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008958:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008967:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008975:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.008986:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.008992:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.008996:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.009003:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.009006:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.009014:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.009025:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.009038:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69f87b3/0x265cfe11109bfe04 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.009051:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.009052:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.009054:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.009093:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x270:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.009099:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.009106:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x270:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.009109:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x270:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.009114:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.010431:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.010446:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.010455:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.011220:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572585.011340:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.011348:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.011363:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26f:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.011367:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.011374:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.011384:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.011393:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.011402:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020593:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572585.020611:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020626:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcea00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572585.020633:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020646:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020675:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020684:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d3cc035/0x265cfe11109bfe0b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020727:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572585.020733:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020740:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572585.020744:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020751:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020761:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572585.020768:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572585.020770:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572585.020771:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.021866:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572585.021877:0:43924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000111bc2ec/0x265cfe11109bfe12 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572585.022029:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.022036:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022051:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26e:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.022055:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.022062:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022075:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022084:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022093:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022167:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.022179:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.022185:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022194:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.022199:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022209:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022222:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022236:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b7063fd/0x265cfe11109bfe19 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022253:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.022255:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.022257:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.022300:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.022306:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022314:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26d:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.022318:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.022322:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022332:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022341:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022349:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022361:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.022368:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.022373:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022380:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.022383:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022392:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022403:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022411:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f8f5cad/0x265cfe11109bfe20 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022424:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.022426:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.022428:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572585.022467:0:43924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572585.022473:0:43924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022507:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26c:0x0].0x0 since=9338s v=(0 0) 00010000:00010000:3.0:1788572585.022510:0:43924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572585.022514:0:43924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022529:0:43924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022537:0:43924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022544:0:43924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022568:0:43924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572585.022575:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572585.022580:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022588:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572585.022591:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022599:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022610:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022617:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef90a3a5/0x265cfe11109bfe27 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572585.022634:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.022635:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572585.022637:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788572585.022670:0:43924:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:619 00000100:00100000:3.0:1788572585.022772:0:43924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:202685:x1875444584510336:12345-0@lo:5:osp-pre-1-1.0 Request processed in 74389us (74885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572585.022783:0:43924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22738 00000100:00100000:3.0:1788572585.022849:0:202685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c81c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:202685:1875444584510336:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788572585.022866:0:202685:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x281:0x0] from OST, last_created [0x2c0000400:0x281:0x0]last_used is [0x2c0000400:0x26b:0x0] 00000100:00100000:3.0:1788572585.022927:0:202685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:202685:1875444584510848:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788572585.022965:0:202685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572585.022987:0:202685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906388000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572585.023002:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572585.023011:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584510720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572585.023036:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572585.023062:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584510848 00000100:00100000:3.0:1788572585.023068:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584510848 00000100:00100000:3.0:1788572585.023111:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22740 00000100:00100000:0.0:1788572585.025067:0:202683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:202683:1875444584510592:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788572585.025091:0:202683:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x281:0x0]-[0x280000400:0x2a1:0x0] 00000100:00100000:0.0:1788572585.025163:0:202683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:202683:1875444584510976:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788572585.025226:0:202683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572585.025254:0:202683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5901082900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572585.025272:0:188060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584510976 00000100:00100000:0.0:1788572585.025278:0:188060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584510976 00000100:00100000:0.0:1788572585.025321:0:188060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572585.025330:0:188060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202683:x1875444584510976:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788572585.025384:0:188060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202683:x1875444584510976:12345-0@lo:900:osp-pre-0-1.0 Request processed in 54us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.025392:0:188060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572585.025427:0:202683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:202683:1875444584510976:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788572585.028744:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:202685:x1875444584510848:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788572585.028822:0:43918:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 642 00010000:00010000:2.0:1788572585.029291:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572585.040513:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:202685:x1875444584510848:12345-0@lo:5:osp-pre-1-1.0 Request processed in 17361us (17515us total) trans 4294975700 rc 0/0 00000100:00100000:3.0:1788572585.040529:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22740 00000100:00100000:3.0:1788572585.040582:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584510720 00000100:00100000:3.0:1788572585.040592:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584510720 00000100:00100000:3.0:1788572585.040632:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6498 00000100:00100000:3.0:1788572585.040642:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584510720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572585.040676:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572585.040718:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584510720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (17681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572585.040723:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6498 00000100:00100000:3.0:1788572585.040794:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584510720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572585.045739:0:202685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36eaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:202685:1875444584510848:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788572585.045763:0:202685:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x281:0x0]-[0x2c0000400:0x2a1:0x0] 00000100:00100000:1.0:1788572585.045821:0:202685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c81c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:202685:1875444584511104:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788572585.045891:0:202685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572585.045925:0:202685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572585.047241:0:188060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584511104 00000100:00100000:0.0:1788572585.047252:0:188060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584511104 00000100:00100000:0.0:1788572585.047305:0:188060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572585.047315:0:188060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202685:x1875444584511104:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788572585.047396:0:188060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202685:x1875444584511104:12345-0@lo:900:osp-pre-1-1.0 Request processed in 82us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.047404:0:188060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788572585.047640:0:202685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c81c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:202685:1875444584511104:0@lo:900:osp-pre-1-1.0 00000001:02000400:0.0:1788572585.577717:0:202940:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788572585.596935:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572586.347624:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572586.347675:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572586.347703:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572586.347732:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569586816 00000100:00100000:2.0:1788572586.347742:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569586816 00000100:00100000:2.0:1788572586.347797:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 124 00000100:00100000:2.0:1788572586.347808:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569586816:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572586.347884:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569586816:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572586.347896:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 124 00000100:00100000:2.0:1788572586.347932:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569586944 00000100:00100000:2.0:1788572586.347936:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569586944 00000100:00100000:2.0:1788572586.347974:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569587072 00000100:00100000:2.0:1788572586.347977:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569587072 00000100:00100000:2.0:1788572586.348000:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 610 00000100:00100000:2.0:1788572586.348020:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569586944:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572586.348049:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569586944:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572586.348055:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 610 00000100:00100000:2.0:1788572586.348067:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 611 00000100:00100000:2.0:1788572586.348073:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569587072:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572586.348095:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569587072:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 22us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572586.348100:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 611 00000100:00080000:2.0:1788572586.348246:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572586.348250:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788572586.620829:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788572586.844789:0:202993:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572586.845467:0:202993:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788572587.646657:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788572588.189600:0:203043:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788572588.189830:0:203043:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788572588.669017:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572589.437265:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584511232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572589.437398:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572589.437633:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584511232 00000100:00100000:2.0:1788572589.437644:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584511232 00000100:00100000:2.0:1788572589.437726:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6499 00000100:00100000:2.0:1788572589.437740:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584511232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572589.437782:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572589.437859:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584511232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572589.437867:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6499 00000100:00080000:1.0:1788572589.438023:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572589.438078:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584511232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572589.439791:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572589.439819:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584511360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572589.440181:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572589.440952:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584511360 00000100:00100000:2.0:1788572589.440965:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584511360 00000100:00100000:2.0:1788572589.441557:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6500 00000100:00100000:2.0:1788572589.441575:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584511360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572589.441632:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788572589.441752:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584511360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572589.441760:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6500 00000100:00080000:1.0:1788572589.441922:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572589.442653:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584511360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572589.696137:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572589.949076:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572589.949114:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584511488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572589.949226:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.949527:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584511872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.949567:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.949588:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584512384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.949611:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.949628:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788572589.949633:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584511744:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.949654:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.949669:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584512256:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.949693:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.949714:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584512768:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.949743:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.949781:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584511872 00000100:00100000:3.0:1788572589.949791:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584511872 00000100:00100000:3.0:1788572589.949862:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584511744 00000100:00100000:3.0:1788572589.949866:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584511744 00000100:00100000:3.0:1788572589.949884:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584512256 00000100:00100000:3.0:1788572589.949886:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584512256 00000100:00100000:3.0:1788572589.949899:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584512768 00000100:00100000:3.0:1788572589.949901:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584512768 00000100:00100000:3.0:1788572589.949917:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1788572589.949941:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584511872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950010:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875444584511872:12345-0@lo:400:kworker.0 Request processed in 83us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572589.950018:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1788572589.950041:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1788572589.950047:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584511744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950077:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584511744:12345-0@lo:400:kworker.0 Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572589.950082:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1788572589.950093:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1788572589.950098:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584512256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950122:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a3f8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875444584512256:12345-0@lo:400:kworker.0 Request processed in 24us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572589.950128:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1788572589.950137:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1788572589.950142:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584512768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950166:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5906a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875444584512768:12345-0@lo:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572589.950176:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1788572589.950206:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584511616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950241:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.950267:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584512128:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950294:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.950311:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584512640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950337:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.950358:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788572589.950364:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584512000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950401:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.950417:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590d8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584512512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950439:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572589.950462:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584512128 00000100:00100000:3.0:1788572589.950466:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584512128 00000100:00100000:3.0:1788572589.950533:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584512000 00000100:00100000:3.0:1788572589.950537:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584512000 00000100:00100000:3.0:1788572589.950553:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1788572589.950559:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584512128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950596:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584512128:12345-0@lo:400:kworker.0 Request processed in 37us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572589.950602:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1788572589.950615:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1788572589.950621:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584512000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950650:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584512000:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572589.950659:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1788572589.950707:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584511744:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875444584512256:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950731:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875444584512768:0@lo:400:kworker.0 00010000:00080000:3.0:1788572589.950746:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5905f6ea00 x1875444584511872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572589.950758:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875444584511872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572589.950799:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584512000:0@lo:400:kworker.0 00010000:00080000:3.0:1788572589.950810:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a40f30380 x1875444584512128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572589.950819:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584512128:0@lo:400:kworker.0 00000100:00100000:0.0:1788572589.951434:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584511488 00000100:00100000:0.0:1788572589.951442:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584511488 00000100:00100000:0.0:1788572589.951522:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584512384 00000100:00100000:0.0:1788572589.951527:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584512384 00000100:00100000:0.0:1788572589.951546:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1788572589.951553:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584511488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572589.951592:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445986304 avail 1299746816 00000100:00100000:0.0:1788572589.951668:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584511488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572589.951675:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1788572589.951695:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1788572589.951700:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584512384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572589.951737:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a411b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584512384:12345-0@lo:400:kworker.0 Request processed in 37us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572589.951744:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1788572589.951774:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584511616 00000100:00100000:0.0:1788572589.951779:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584511616 00000100:00100000:0.0:1788572589.951806:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788572589.951814:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584511616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572589.951845:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584511616:12345-0@lo:400:kworker.0 Request processed in 32us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572589.951852:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788572589.951887:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584512640 00000100:00100000:0.0:1788572589.951891:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584512640 00000100:00100000:0.0:1788572589.951922:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584512512 00000100:00100000:0.0:1788572589.951939:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584512512 00000100:00100000:0.0:1788572589.951963:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7944 00000100:00100000:0.0:1788572589.951971:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584512640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572589.952003:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584512640:12345-0@lo:400:kworker.0 Request processed in 34us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572589.952014:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7944 00000100:00100000:0.0:1788572589.952025:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7945 00000100:00100000:0.0:1788572589.952031:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584512512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572589.952059:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584512512:12345-0@lo:400:kworker.0 Request processed in 29us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572589.952064:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7945 00000100:00100000:0.0:1788572589.952113:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584512384:0@lo:400:kworker.0 00000100:00100000:0.0:1788572589.952149:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590d8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584512512:0@lo:400:kworker.0 00000100:00100000:0.0:1788572589.952160:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584511616:0@lo:400:kworker.0 00000100:00100000:0.0:1788572589.952171:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590cb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584512640:0@lo:400:kworker.0 00000100:00100000:0.0:1788572589.952191:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584511488:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788572589.953543:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572589.953550:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572589.953555:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572589.953558:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572589.953566:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572589.953586:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584512896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572589.953651:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572589.953702:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584512896 00000100:00100000:1.0:1788572589.953710:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584512896 00000100:00100000:1.0:1788572589.953755:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1788572589.953764:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584512896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572589.953800:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1788572589.953846:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584512896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572589.953852:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1788572589.953903:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584512896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572590.462516:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584513024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572590.462623:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572590.462785:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584513024 00000100:00100000:0.0:1788572590.462797:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584513024 00000100:00100000:0.0:1788572590.462868:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6501 00000100:00100000:0.0:1788572590.462878:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584513024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572590.462921:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572590.462978:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584513024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.462985:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6501 00000100:00100000:2.0:1788572590.464123:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584513024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572590.465511:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584513152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572590.465621:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572590.466044:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584513152 00000100:00100000:0.0:1788572590.466054:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584513152 00000100:00100000:0.0:1788572590.466128:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6502 00000100:00100000:0.0:1788572590.466140:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584513152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572590.466177:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572590.466263:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875444584513152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.466271:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6502 00000100:00100000:3.0:1788572590.466395:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584513152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572590.552199:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572590.552308:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569587200 00000100:00100000:3.0:1788572590.552323:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569587200 00000100:00100000:3.0:1788572590.552466:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1371 00000100:00100000:3.0:1788572590.552522:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:166192:x1875444569587200:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572590.552582:0:198183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1788572590.552680:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:166192:x1875444569587200:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 203us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572590.552691:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1371 00000100:00080000:1.0:1788572590.552768:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572590.558666:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572590.558857:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569587328 00000100:00100000:3.0:1788572590.558871:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569587328 00000100:00100000:3.0:1788572590.559581:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1372 00000100:00100000:3.0:1788572590.559601:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:166192:x1875444569587328:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572590.559671:0:196070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445986304 avail 1299746816 00000100:00100000:3.0:1788572590.559820:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:166192:x1875444569587328:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 223us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572590.559829:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1372 00000100:00080000:1.0:1788572590.560715:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572590.574108:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572590.574514:0:43928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569587456 00000100:00100000:0.0:1788572590.574589:0:43928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569587456 00000100:00100000:0.0:1788572590.574688:0:43928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22741 00000100:00100000:0.0:1788572590.574699:0:43928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2396:x1875444569587456:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:0.0:1788572590.574751:0:43928:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9343 last 0 00000020:00000080:0.0:1788572590.574799:0:43928:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109bfe2e 00002000:00100000:0.0:1788572590.574818:0:43928:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e5a0f315800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572590.574834:0:43928:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572590.574961:0:43928:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788572590.575001:0:43928:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f317000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572590.575115:0:43928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569587456:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 416us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.575132:0:43928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22741 00000001:00100000:0.0:1788572590.580257:0:194757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:0.0:1788572590.580287:0:194757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705691 is committed 00000100:00100000:2.0:1788572590.583082:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572590.583330:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569587584 00000100:00100000:3.0:1788572590.583414:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569587584 00000100:00100000:3.0:1788572590.583605:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6503 00000100:00100000:3.0:1788572590.583618:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:166192:x1875444569587584:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:3.0:1788572590.583653:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572590.583744:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:166192:x1875444569587584:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 127us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572590.583752:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6503 00000100:00080000:1.0:1788572590.583801:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572590.599813:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572590.600323:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569587712 00000100:00100000:2.0:1788572590.600356:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569587712 00000100:00100000:2.0:1788572590.600431:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 22742 00000100:00100000:2.0:1788572590.600442:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2396:x1875444569587712:12345-192.168.202.57@tcp:8:lfs.0 00010000:00080000:2.0:1788572590.600554:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b@192.168.202.57@tcp t0 exp 0000000000000000 cur 9343 last 0 00000020:00000080:2.0:1788572590.600599:0:8431:0:(genops.c:1385:class_connect()) connect: client 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b, cookie 0x265cfe11109bfe35 00002000:00100000:2.0:1788572590.600616:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b/ffff8e5a0f3c7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788572590.600631:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788572590.600754:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788572590.600806:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8e5a0f3c1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572590.601245:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2396:x1875444569587712:12345-192.168.202.57@tcp:8:lfs.0 Request processed in 798us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572590.601256:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 22742 00000100:00100000:2.0:1788572590.604874:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572590.605809:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569587840 00000100:00100000:0.0:1788572590.605826:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569587840 00000100:00100000:0.0:1788572590.605940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6504 00000100:00100000:0.0:1788572590.605954:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:166192:x1875444569587840:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572590.605994:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572590.606102:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:166192:x1875444569587840:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 151us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.606111:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6504 00000100:00080000:1.0:1788572590.606629:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788572590.622849:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02515dca-bbf0-45e0-bd6e-e76f0c89bd0b 00000001:00080000:2.0:1788572590.622875:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975700 is committed 00010000:00010000:2.0:1788572590.721273:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572591.470181:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572591.470234:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572591.470282:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572591.470323:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572591.470350:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572591.470388:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569587968 00000100:00100000:3.0:1788572591.470401:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569587968 00000100:00100000:3.0:1788572591.470468:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 126 00000100:00100000:3.0:1788572591.470526:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a0ef25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569587968:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572591.470618:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a0ef25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f79285ed-4685-45a8-8731-5e2522a143f3+10:2399:x1875444569587968:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 140us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572591.470627:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 126 00000100:00100000:3.0:1788572591.470671:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569588352 00000100:00100000:3.0:1788572591.470676:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569588352 00000100:00100000:3.0:1788572591.470706:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569588480 00000100:00100000:3.0:1788572591.470708:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569588480 00000100:00100000:3.0:1788572591.470732:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7946 00000100:00100000:3.0:1788572591.470739:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569588352:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572591.470771:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569588352:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572591.470778:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7946 00000100:00100000:3.0:1788572591.470790:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7947 00000100:00100000:3.0:1788572591.470797:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569588480:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572591.470822:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2399:x1875444569588480:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 25us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572591.470828:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7947 00000100:00100000:1.0:1788572591.471014:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569588096 00000100:00100000:1.0:1788572591.471020:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569588096 00000100:00100000:1.0:1788572591.471063:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569588224 00000100:00100000:1.0:1788572591.471066:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569588224 00000100:00100000:1.0:1788572591.471103:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 618 00000100:00100000:1.0:1788572591.471111:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569588096:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572591.471146:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2399:x1875444569588096:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 37us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.471153:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 618 00000100:00100000:1.0:1788572591.471168:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 619 00000100:00100000:1.0:1788572591.471174:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569588224:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572591.471205:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2399:x1875444569588224:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 31us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.471211:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 619 00010000:00010000:2.0:1788572591.749368:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572592.769699:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572593.788679:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572594.558212:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584513280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572594.558287:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572594.558427:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584513280 00000100:00100000:0.0:1788572594.558436:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584513280 00000100:00100000:0.0:1788572594.558516:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6505 00000100:00100000:0.0:1788572594.558526:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584513280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572594.558558:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572594.558605:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584513280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572594.558612:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6505 00000100:00080000:1.0:1788572594.559175:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572594.559228:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584513280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572594.561202:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584513408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572594.561262:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572594.562082:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584513408 00000100:00100000:0.0:1788572594.562090:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584513408 00000100:00100000:0.0:1788572594.562159:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6506 00000100:00100000:0.0:1788572594.562171:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584513408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572594.562214:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923492864 avail 3691970560 00000100:00080000:2.0:1788572594.562290:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572594.565397:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584513408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3220us (4126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572594.565411:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6506 00000100:00100000:3.0:1788572594.569923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584513408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572594.812724:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572595.068754:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572595.068777:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584513536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572595.068853:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572595.068913:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584513664:0@lo:400:kworker.0 00000100:00100000:3.0:1788572595.068952:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.068955:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584513792:0@lo:400:kworker.0 00000100:00100000:3.0:1788572595.068982:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584514176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.068996:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.069018:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584514304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.069043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.069060:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584514816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.069084:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572595.069096:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584514048:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.069104:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788572595.069112:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584513920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572595.069137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.069154:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584513664 00000100:00100000:2.0:1788572595.069161:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584513664 00000100:00100000:0.0:1788572595.069181:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a4143aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584514560:0@lo:400:kworker.0 00000100:00100000:0.0:1788572595.069205:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572595.069221:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584515072:0@lo:400:kworker.0 00000100:00100000:0.0:1788572595.069239:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572595.069260:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572595.069266:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584514688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.069279:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788572595.069292:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590c4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584513664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572595.069293:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572595.069325:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584513792 00000100:00100000:0.0:1788572595.069330:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584513792 00000100:00100000:2.0:1788572595.069344:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590c4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3642:x1875444584513664:12345-0@lo:400:kworker.0 Request processed in 56us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572595.069368:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584514048 00000100:00100000:0.0:1788572595.069371:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584514048 00000100:00100000:0.0:1788572595.069388:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584514560 00000100:00100000:0.0:1788572595.069391:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584514560 00000100:00100000:0.0:1788572595.069402:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584515072 00000100:00100000:0.0:1788572595.069404:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584515072 00000100:00100000:2.0:1788572595.069413:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788572595.069418:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1788572595.069426:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584513792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.069457:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1788572595.069467:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875444584513792:12345-0@lo:400:kworker.0 Request processed in 41us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572595.069468:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584514048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572595.069516:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1788572595.069529:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875444584514048:12345-0@lo:400:kworker.0 Request processed in 64us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572595.069537:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1788572595.069550:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584514560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572595.069581:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875444584514560:12345-0@lo:400:kworker.0 Request processed in 37us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572595.069605:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:2.0:1788572595.069623:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1788572595.069628:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584515072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.069654:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875444584515072:12345-0@lo:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572595.069660:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1788572595.069676:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584514304 00000100:00100000:2.0:1788572595.069679:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584514304 00000100:00100000:2.0:1788572595.069700:0:43923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584514816 00000100:00100000:2.0:1788572595.069702:0:43923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584514816 00000100:00100000:2.0:1788572595.069718:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7948 00000100:00100000:2.0:1788572595.069843:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584514304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.069871:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584514304:12345-0@lo:400:kworker.0 Request processed in 31us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572595.069876:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7948 00000100:00100000:2.0:1788572595.069886:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7949 00000100:00100000:2.0:1788572595.069892:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584514816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.069909:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584514816:12345-0@lo:400:kworker.0 Request processed in 18us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572595.069914:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7949 00000100:00080000:2.0:1788572595.069932:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572595.069936:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572595.069949:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.069964:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a41439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584514432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.069982:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.069995:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584514944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.070013:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.070044:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875444584513792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.070055:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584514304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.070062:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705691 gen 2 00000100:00100000:2.0:1788572595.070075:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584514816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.070094:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584514432 00000100:00100000:2.0:1788572595.070096:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584514432 00000100:00100000:2.0:1788572595.070116:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584514944 00000100:00100000:2.0:1788572595.070118:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584514944 00000100:00100000:2.0:1788572595.070136:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7950 00000100:00100000:2.0:1788572595.070141:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584514432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572595.070812:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584513536 00000100:00100000:1.0:1788572595.070817:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584513536 00000100:00100000:1.0:1788572595.070843:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584514688 00000100:00100000:1.0:1788572595.070846:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584514688 00000100:00100000:1.0:1788572595.070859:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1788572595.070867:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584513536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572595.070892:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445986304 avail 1299746816 00000100:00100000:0.0:1788572595.071355:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1788572595.071373:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584513920 00000100:00100000:0.0:1788572595.071376:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584513920 00000100:00100000:0.0:1788572595.071407:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1788572595.071414:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584513920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.072570:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584514432:12345-0@lo:400:kworker.0 Request processed in 2423us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572595.072582:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7950 00000100:00100000:3.0:1788572595.072588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.072609:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7951 00000100:00100000:2.0:1788572595.072620:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584514944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572595.072629:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584515200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572595.072672:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584514944:12345-0@lo:400:kworker.0 Request processed in 52us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572595.072673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.072683:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7951 00000100:00100000:3.0:1788572595.072707:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3642:1875444584513664:0@lo:400:kworker.0 00000100:00080000:2.0:1788572595.072718:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572595.072740:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584515200 00000100:00100000:3.0:1788572595.072745:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584515200 00000100:00100000:3.0:1788572595.072765:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1788572595.072772:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584514688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572595.072805:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875444584514688:12345-0@lo:400:kworker.0 Request processed in 33us (3516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572595.072811:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1788572595.072824:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1788572595.072830:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584515200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572595.072850:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1788572595.072888:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584515200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572595.072894:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1788572595.072927:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590542c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584515200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572595.072960:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584514176 00000100:00100000:3.0:1788572595.072964:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584514176 00000100:00100000:3.0:1788572595.072986:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1788572595.072992:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584514176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572595.073122:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875444584514176:12345-0@lo:400:kworker.0 Request processed in 129us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572595.073129:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1788572595.073160:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584514688:0@lo:400:kworker.0 00000100:00100000:3.0:1788572595.073185:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875444584514048:0@lo:400:kworker.0 00000100:00100000:3.0:1788572595.073196:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875444584514560:0@lo:400:kworker.0 00000100:00100000:3.0:1788572595.073208:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875444584515072:0@lo:400:kworker.0 00010000:00080000:3.0:1788572595.073237:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a41438e00 x1875444584514176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572595.073241:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572595.073249:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572595.073252:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875444584514176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.073282:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a41439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584514432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572595.073297:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975700 gen 2 00000100:00100000:2.0:1788572595.073311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584514944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572595.074202:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875444584513536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3332us (5348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572595.074212:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1788572595.074283:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a24c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584513536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572595.074456:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875444584513920:12345-0@lo:400:kworker.0 Request processed in 3042us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572595.074464:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00010000:00080000:3.0:1788572595.074830:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e5a4143b100 x1875444584513920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572595.074842:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a4143b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875444584513920:0@lo:400:kworker.0 00000001:02000400:1.0:1788572595.544097:0:203236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 00000100:00100000:2.0:1788572595.582262:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584515328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572595.582361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572595.582420:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572595.582427:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584515456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572595.582454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572595.583091:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584515328 00000100:00100000:1.0:1788572595.583100:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584515328 00000100:00100000:1.0:1788572595.583214:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584515456 00000100:00100000:1.0:1788572595.583218:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584515456 00000100:00100000:1.0:1788572595.583238:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6507 00000100:00100000:1.0:1788572595.583247:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584515328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572595.583270:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572595.583320:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584515328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572595.583327:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6507 00000100:00100000:1.0:1788572595.583343:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6508 00000100:00100000:1.0:1788572595.583350:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584515456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572595.583361:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788572595.583389:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584515456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572595.583395:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6508 00000100:00100000:1.0:1788572595.583688:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584515456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572595.583704:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584515328:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572595.837250:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572596.330107:0:203284:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1788572596.589227:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572596.589272:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572596.589316:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569588736 00000100:00100000:0.0:1788572596.589325:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572596.589327:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569588736 00000100:00100000:0.0:1788572596.589361:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572596.589395:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569588864 00000100:00100000:3.0:1788572596.589399:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569588864 00000100:00100000:0.0:1788572596.589412:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572596.589431:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 626 00000100:00100000:0.0:1788572596.589441:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569588992 00000100:00100000:3.0:1788572596.589443:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569588736:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572596.589446:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569588992 00000100:00100000:0.0:1788572596.589525:0:43931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569589120 00000100:00100000:0.0:1788572596.589529:0:43931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569589120 00000100:00100000:3.0:1788572596.589563:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:2400:x1875444569588736:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 122us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572596.589570:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7952 00000100:00100000:3.0:1788572596.589575:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 626 00000100:00100000:0.0:1788572596.589582:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569588992:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572596.589620:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569588992:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 42us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572596.589627:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7952 00000100:00100000:0.0:1788572596.589642:0:43931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7953 00000100:00100000:0.0:1788572596.589649:0:43931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569589120:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572596.589672:0:43931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2400:x1875444569589120:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572596.589679:0:43931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7953 00000100:00100000:1.0:1788572596.589716:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 627 00000100:00100000:1.0:1788572596.589736:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590d8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569588864:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1788572596.589769:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590d8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:2400:x1875444569588864:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 36us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572596.589775:0:201331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569588608 00000100:00100000:1.0:1788572596.589776:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 627 00000100:00100000:2.0:1788572596.589790:0:201331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569588608 00000100:00100000:2.0:1788572596.589827:0:201331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 128 00000100:00100000:2.0:1788572596.589836:0:201331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569588608:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572596.589867:0:201331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f79285ed-4685-45a8-8731-5e2522a143f3+10:2400:x1875444569588608:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 34us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572596.589875:0:201331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 128 00000100:00080000:2.0:1788572596.589905:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572596.589908:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572596.589911:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572596.589912:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788572596.860716:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572597.674952:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.675014:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569589248 00000100:00100000:3.0:1788572597.675024:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569589248 00000100:00100000:3.0:1788572597.675111:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1373 00000100:00100000:3.0:1788572597.675122:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:166659:x1875444569589248:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572597.675161:0:188049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1788572597.675224:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:166659:x1875444569589248:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.675232:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1373 00000100:00100000:1.0:1788572597.676251:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.676298:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569589376 00000100:00100000:3.0:1788572597.676303:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569589376 00000100:00100000:3.0:1788572597.676339:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1374 00000100:00100000:3.0:1788572597.676347:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:166659:x1875444569589376:12345-192.168.202.57@tcp:41:lfs.0 00000004:00000024:3.0:1788572597.676369:0:188050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445986304 avail 1299746816 00000100:00100000:3.0:1788572597.676414:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:166659:x1875444569589376:12345-192.168.202.57@tcp:41:lfs.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.676421:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1374 00000100:00100000:0.0:1788572597.677947:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.678011:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569589504 00000100:00100000:1.0:1788572597.678019:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569589504 00000100:00100000:1.0:1788572597.678079:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6509 00000100:00100000:1.0:1788572597.678091:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:166659:x1875444569589504:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:1.0:1788572597.678117:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572597.678176:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:166659:x1875444569589504:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572597.678192:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6509 00000100:00100000:2.0:1788572597.678936:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.678987:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569589632 00000100:00100000:0.0:1788572597.678992:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569589632 00000100:00100000:0.0:1788572597.679026:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6510 00000100:00100000:0.0:1788572597.679034:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:166659:x1875444569589632:12345-192.168.202.57@tcp:13:lfs.0 00002000:00000024:0.0:1788572597.679053:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788572597.679105:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:166659:x1875444569589632:12345-192.168.202.57@tcp:13:lfs.0 Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572597.679116:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6510 00000100:00100000:3.0:1788572597.693339:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.693431:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569589760 00000100:00100000:2.0:1788572597.693442:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569589760 00000100:00100000:2.0:1788572597.693517:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1375 00000100:00100000:2.0:1788572597.693527:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:166675:x1875444569589760:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572597.693556:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572597.693581:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535200/0x265cfe11109bfe3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb66f expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693664:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693686:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693701:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693713:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693718:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693722:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693814:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693822:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693828:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572597.693862:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1788572597.693865:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572597.693884:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693895:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693899:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693903:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693908:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693911:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.693914:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693921:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693932:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:2.0:1788572597.693935:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.693939:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693945:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534a00/0x265cfe11109bfe43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693958:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693969:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693975:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693980:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.693983:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693989:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.693996:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e590d91e700) 00010000:00010000:2.0:1788572597.693998:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.694000:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.694004:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535a00/0x265cfe11109bfe4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.694028:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24535200/0x265cfe11109bfe3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb66f expref: 9 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.694037:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb66f expref: 8 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.694044:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:2.0:1788572597.694046:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572597.694049:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a24534800, rc 0) 00000100:00100000:2.0:1788572597.694123:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:166675:x1875444569589760:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 597us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572597.694137:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1375 00000100:00100000:3.0:1788572597.696653:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.696722:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569590016 00000100:00100000:0.0:1788572597.696731:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569590016 00000100:00100000:0.0:1788572597.696793:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1376 00000100:00100000:0.0:1788572597.696805:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a24c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:166675:x1875444569590016:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572597.696833:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.696849:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fe00/0x265cfe11109bfe58 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb676 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.696909:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 3/1,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.696919:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.696927:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.696940:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.696944:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.696948:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.697028:0:196070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40522d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:196070:1875444584515584:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788572597.697094:0:196070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.697124:0:196070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a060240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572597.697142:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584515584 00000100:00100000:3.0:1788572597.697148:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584515584 00000100:00100000:3.0:1788572597.697188:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1788572597.697196:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:196070:x1875444584515584:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788572597.697275:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:196070:x1875444584515584:12345-0@lo:1000:mdt00_004.0 Request processed in 79us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.697283:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1788572597.697316:0:196070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40522d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:196070:1875444584515584:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788572597.697358:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109bfe6d lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697366:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109bfe6d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697371:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109bfe6d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697381:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 4/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697385:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 4/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697389:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697393:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697398:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.697402:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697408:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 5/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697419:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:0.0:1788572597.697422:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.697428:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 3/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697435:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe5f lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697447:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697451:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697455:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697458:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.697459:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697463:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697467:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0xf7117594 (ffff8e5a0a4b7400) 00010000:00010000:0.0:1788572597.697468:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.697470:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697473:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f600/0x265cfe11109bfe66 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697536:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fe00/0x265cfe11109bfe58 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb676 expref: 10 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697556:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109bfe6d lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb676 expref: 9 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.697573:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7c00) 00010000:00010000:0.0:1788572597.697575:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572597.697577:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117f800, rc 0) 00000100:00100000:0.0:1788572597.697620:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a24c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:166675:x1875444569590016:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 818us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572597.697628:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1376 00000100:00100000:0.0:1788572597.702163:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.702242:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569590272 00000100:00100000:1.0:1788572597.702251:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569590272 00000100:00100000:1.0:1788572597.702313:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1377 00000100:00100000:1.0:1788572597.702321:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+6:166675:x1875444569590272:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572597.702338:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572597.702358:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bfe74 lrc: 2/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb67d expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572597.702969:0:198183:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 572us 00000004:00200000:0.0:1788572597.708750:0:198183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x2b:0x0]: returning size 4096 00010000:00010000:0.0:1788572597.708883:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bfe74 lrc: 1/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb67d expref: 8 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.708897:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a039c6900) 00010000:00010000:0.0:1788572597.708899:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572597.708903:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3200/0x265cfe11109bfe74 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb67d expref: 8 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.708919:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3200, rc 0) 00000100:00100000:0.0:1788572597.708972:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:166675:x1875444569590272:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6652us (6819us total) trans 30064771073 rc 301/301 00000100:00100000:0.0:1788572597.708980:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1377 00000100:00100000:3.0:1788572597.710551:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.710604:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569590528 00000100:00100000:0.0:1788572597.710613:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569590528 00000100:00100000:0.0:1788572597.710660:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 65 00000100:00100000:0.0:1788572597.710671:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a274a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+7:166675:x1875444569590528:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:0.0:1788572597.710833:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a274a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:166675:x1875444569590528:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 164us (285us total) trans 30064771074 rc 0/0 00000100:00100000:0.0:1788572597.710839:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 65 00000100:00100000:2.0:1788572597.718704:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.718794:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569590784 00000100:00100000:0.0:1788572597.718804:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569590784 00000100:00100000:0.0:1788572597.718897:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1378 00000100:00100000:0.0:1788572597.718907:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:166681:x1875444569590784:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.718928:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.718963:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bfe82 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb684 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.719077:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:188833:1875444584515712:0@lo:900:mdt00_003.0 00000100:00100000:0.0:1788572597.719126:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.719157:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a060c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572597.719165:0:188059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584515712 00000100:00100000:2.0:1788572597.719169:0:188059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584515712 00000100:00100000:2.0:1788572597.719205:0:188059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572597.719213:0:188059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:188833:x1875444584515712:12345-0@lo:900:mdt00_003.0 00000100:00100000:2.0:1788572597.719271:0:188059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:188833:x1875444584515712:12345-0@lo:900:mdt00_003.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572597.719279:0:188059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788572597.719293:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:188833:1875444584515712:0@lo:900:mdt00_003.0 00000100:00100000:0.0:1788572597.719342:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584515840:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572597.719364:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.719379:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a060e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572597.719407:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584515840 00000100:00100000:1.0:1788572597.719412:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584515840 00000100:00100000:1.0:1788572597.719451:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1788572597.719458:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:188833:x1875444584515840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788572597.719542:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:188833:x1875444584515840:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572597.719547:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1788572597.719569:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a40523480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584515840:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788572597.719621:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117f600/0x265cfe11109bfe89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.719628:0:188833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117f600/0x265cfe11109bfe89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.719638:0:188833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117f600/0x265cfe11109bfe89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.719646:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584515968:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1788572597.719669:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.719695:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a060c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572597.719741:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584515968 00000100:00100000:3.0:1788572597.719744:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584515968 00000100:00100000:3.0:1788572597.719772:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1788572597.719780:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:188833:x1875444584515968:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1788572597.719789:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.719802:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109bfe90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109bfe89 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.719823:0:188053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109bfe90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109bfe89 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.719837:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce200/0x265cfe11109bfe90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109bfe89 expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.719846:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:3.0:1788572597.719848:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788572597.719852:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffce200, rc 0) 00000100:00100000:3.0:1788572597.719928:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584515968:12345-0@lo:101:mdt00_003.0 Request processed in 149us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.719934:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1788572597.719983:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584515968:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788572597.719993:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117f600/0x265cfe11109bfe89 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfe90 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720002:0:188833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117f600/0x265cfe11109bfe89 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109bfe90 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.720012:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788572597.720017:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117f600/0x265cfe11109bfe89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfe90 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720022:0:188833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117f600/0x265cfe11109bfe89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109bfe90 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720096:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720105:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720116:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720133:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720139:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720146:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.720225:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a2d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516096:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572597.720243:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.720276:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a060e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572597.720338:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584516096 00000100:00100000:1.0:1788572597.720343:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584516096 00000100:00100000:1.0:1788572597.720370:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1788572597.720377:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584516096:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788572597.720428:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584516096:12345-0@lo:1000:mdt00_003.0 Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572597.720433:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1788572597.720468:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a2d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516096:0@lo:1000:mdt00_003.0 00000004:00080000:0.0:1788572597.720721:0:188833:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x26c:0x0], count =22 00000004:00080000:0.0:1788572597.720727:0:188833:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x26c:0x0]+22 in llog 00000004:00080000:0.0:1788572597.720739:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x282:0x0], index 0: 0 00010000:00010000:0.0:1788572597.720874:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bfea5 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720881:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bfea5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720886:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bfea5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720905:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720910:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720914:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720919:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720922:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.720925:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720929:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720936:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7400) 00010000:00010000:0.0:1788572597.720937:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.720940:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720943:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfe97 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.720953:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af38e30b reply state 000000006a3b87ea transno 30064771075 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720959:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720963:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x679fc7b1 (ffff8e5a0a4b7f00) 00010000:00010000:0.0:1788572597.720964:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.720965:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.720985:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bfe82 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb684 expref: 11 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.720997:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bfea5 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb684 expref: 10 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.721001:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2c:0x0].0x0 (ffff8e5a0a4b7e00) 00010000:00010000:0.0:1788572597.721003:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.721004:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e200, rc 0) 00000100:00100000:0.0:1788572597.721046:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:166681:x1875444569590784:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 2142us (2350us total) trans 30064771075 rc 0/0 00000100:00100000:0.0:1788572597.721051:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1378 00000100:00100000:2.0:1788572597.722541:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.722644:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569591040 00000100:00100000:1.0:1788572597.722651:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569591040 00000100:00100000:1.0:1788572597.722691:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 66 00000100:00100000:1.0:1788572597.722701:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:166681:x1875444569591040:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572597.722935:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:166681:x1875444569591040:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 235us (395us total) trans 30064771076 rc 0/0 00000100:00100000:1.0:1788572597.722942:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 66 00000100:00100000:3.0:1788572597.724217:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.724312:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569591296 00000100:00100000:1.0:1788572597.724318:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569591296 00000100:00100000:1.0:1788572597.724353:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1379 00000100:00100000:1.0:1788572597.724359:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:166681:x1875444569591296:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:1.0:1788572597.724371:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572597.724385:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bfeb3 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb68b expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724446:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724458:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724467:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724475:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724508:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724512:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572597.724751:0:188049:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x26c:0x0], count =22 00000004:00080000:1.0:1788572597.724759:0:188049:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x26c:0x0]+22 in llog 00000004:00080000:1.0:1788572597.724768:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x282:0x0], index 1: 0 00010000:00010000:1.0:1788572597.724878:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bfec8 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724887:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bfec8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724895:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bfec8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724918:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724923:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724928:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724932:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572597.724935:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724940:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724947:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a039c6600) 00010000:00010000:1.0:1788572597.724949:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572597.724951:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724955:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3800/0x265cfe11109bfeba lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572597.724964:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a48e2e87 reply state 000000004f446799 transno 30064771077 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724971:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.724975:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x94c295fa (ffff8e5a039c6b00) 00010000:00010000:1.0:1788572597.724977:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572597.724978:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788572597.724995:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2400/0x265cfe11109bfeb3 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb68b expref: 15 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.725011:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bfec8 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb68b expref: 14 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.725017:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2d:0x0].0x0 (ffff8e5a039c6400) 00010000:00010000:1.0:1788572597.725018:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572597.725020:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd2000, rc 0) 00000100:00100000:1.0:1788572597.725059:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:166681:x1875444569591296:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 699us (847us total) trans 30064771077 rc 0/0 00000100:00100000:1.0:1788572597.725076:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1379 00000100:00100000:2.0:1788572597.726461:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.726524:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569591552 00000100:00100000:0.0:1788572597.726530:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569591552 00000100:00100000:0.0:1788572597.726573:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 67 00000100:00100000:0.0:1788572597.726582:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:166681:x1875444569591552:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572597.726758:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+16:166681:x1875444569591552:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 177us (301us total) trans 30064771078 rc 0/0 00000100:00100000:0.0:1788572597.726763:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 67 00000100:00100000:2.0:1788572597.727817:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.727867:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569591808 00000100:00100000:3.0:1788572597.727874:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569591808 00000100:00100000:3.0:1788572597.727911:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1380 00000100:00100000:3.0:1788572597.727922:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+16:166681:x1875444569591808:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572597.727936:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.727957:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bfed6 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb692 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728037:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728051:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728072:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728098:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728106:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728113:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572597.728367:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x283:0x0], index 0: 0 00010000:00010000:3.0:1788572597.728508:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109bfeeb lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728518:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109bfeeb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728542:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109bfeeb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728573:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728580:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728586:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728601:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728607:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.728611:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728617:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728628:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a16354200) 00010000:00010000:3.0:1788572597.728632:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.728636:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728642:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bfedd lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.728653:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebbf7d18 reply state 00000000515c0113 transno 30064771079 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728664:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728671:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xc1e56442 (ffff8e5a16354c00) 00010000:00010000:3.0:1788572597.728674:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.728676:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572597.728711:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bfed6 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb692 expref: 19 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728730:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109bfeeb lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb692 expref: 18 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.728737:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2e:0x0].0x0 (ffff8e5a16354600) 00010000:00010000:3.0:1788572597.728739:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572597.728742:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf200, rc 0) 00000100:00100000:3.0:1788572597.728795:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+19:166681:x1875444569591808:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 875us (980us total) trans 30064771079 rc 0/0 00000100:00100000:3.0:1788572597.728802:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1380 00000100:00100000:3.0:1788572597.730053:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.730142:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569592064 00000100:00100000:0.0:1788572597.730149:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569592064 00000100:00100000:0.0:1788572597.730183:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 68 00000100:00100000:0.0:1788572597.730193:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+19:166681:x1875444569592064:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572597.730371:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+20:166681:x1875444569592064:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 179us (320us total) trans 30064771080 rc 0/0 00000100:00100000:0.0:1788572597.730379:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 68 00000100:00100000:2.0:1788572597.731412:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.731452:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569592320 00000100:00100000:3.0:1788572597.731457:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569592320 00000100:00100000:3.0:1788572597.731515:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1381 00000100:00100000:3.0:1788572597.731522:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+20:166681:x1875444569592320:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572597.731532:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.731546:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bfef9 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb699 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.731624:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.731637:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.731647:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.731656:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xef08328a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.731661:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.731671:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572597.731916:0:188048:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x283:0x0], index 1: 0 00010000:00010000:3.0:1788572597.732023:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109bff0e lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732033:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109bff0e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732040:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109bff0e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732080:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732091:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732097:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732104:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732110:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.732114:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732121:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732138:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a16354d00) 00010000:00010000:3.0:1788572597.732141:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.732145:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732152:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff00 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.732163:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e51782a0 reply state 00000000cf169ec7 transno 30064771081 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732172:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732178:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xef08328a (ffff8e5a16354b00) 00010000:00010000:3.0:1788572597.732181:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.732183:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572597.732205:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bfef9 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb699 expref: 23 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732220:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109bff0e lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb699 expref: 22 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.732227:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2f:0x0].0x0 (ffff8e5a16354000) 00010000:00010000:3.0:1788572597.732229:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572597.732231:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcee00, rc 0) 00000100:00100000:3.0:1788572597.732283:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+23:166681:x1875444569592320:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 761us (874us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1788572597.732290:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1381 00000100:00100000:2.0:1788572597.735382:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.735445:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569592576 00000100:00100000:1.0:1788572597.735454:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569592576 00000100:00100000:1.0:1788572597.735536:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 69 00000100:00100000:1.0:1788572597.735547:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+23:166681:x1875444569592576:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572597.735791:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+24:166681:x1875444569592576:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 245us (414us total) trans 30064771082 rc 0/0 00000100:00100000:1.0:1788572597.735800:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 69 00000100:00100000:1.0:1788572597.737204:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.737248:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569592832 00000100:00100000:0.0:1788572597.737255:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569592832 00000100:00100000:0.0:1788572597.737299:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1382 00000100:00100000:0.0:1788572597.737308:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+24:166681:x1875444569592832:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.737323:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.737341:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bff1c lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6a0 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737420:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737433:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737445:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737457:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737464:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737470:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.737778:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x284:0x0], index 0: 0 00010000:00010000:0.0:1788572597.737878:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bff31 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737887:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bff31 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737895:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bff31 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737930:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737942:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737949:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737956:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737962:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.737966:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737974:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737984:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7400) 00010000:00010000:0.0:1788572597.737987:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.737991:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.737998:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff23 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.738009:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004291e5b0 reply state 00000000276bdc3b transno 30064771083 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.738024:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.738030:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x1c2b00d3 (ffff8e5a0a4b7900) 00010000:00010000:0.0:1788572597.738032:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.738035:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.738056:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bff1c lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6a0 expref: 27 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.738094:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bff31 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6a0 expref: 26 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.738102:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x30:0x0].0x0 (ffff8e5a0a4b7200) 00010000:00010000:0.0:1788572597.738104:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.738107:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117fa00, rc 0) 00000100:00100000:0.0:1788572597.738163:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+27:166681:x1875444569592832:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 856us (972us total) trans 30064771083 rc 0/0 00000100:00100000:0.0:1788572597.738170:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1382 00000100:00100000:2.0:1788572597.740898:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.740949:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569593088 00000100:00100000:0.0:1788572597.740956:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569593088 00000100:00100000:0.0:1788572597.741010:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 70 00000100:00100000:0.0:1788572597.741021:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+27:166681:x1875444569593088:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572597.741303:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+28:166681:x1875444569593088:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 283us (411us total) trans 30064771084 rc 0/0 00000100:00100000:0.0:1788572597.741311:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 70 00000100:00100000:2.0:1788572597.745729:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.745803:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569593344 00000100:00100000:0.0:1788572597.745814:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569593344 00000100:00100000:0.0:1788572597.745877:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1383 00000100:00100000:0.0:1788572597.745890:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+28:166681:x1875444569593344:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.745914:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.745933:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bff3f lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6a7 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746031:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746045:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746057:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746083:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746091:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746097:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.746409:0:198183:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x284:0x0], index 1: 0 00010000:00010000:0.0:1788572597.746592:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bff54 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746602:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bff54 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746625:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bff54 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746658:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746665:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746671:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746676:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.746681:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746689:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746700:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7400) 00010000:00010000:0.0:1788572597.746703:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.746708:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746714:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff46 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.746726:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d2428e1 reply state 00000000195d12e6 transno 30064771085 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746736:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746743:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x494dcf1b (ffff8e5a0a4b7800) 00010000:00010000:0.0:1788572597.746745:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.746747:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.746776:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bff3f lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6a7 expref: 31 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746796:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bff54 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6a7 expref: 30 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.746804:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x31:0x0].0x0 (ffff8e5a0a4b7600) 00010000:00010000:0.0:1788572597.746806:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.746808:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117ec00, rc 0) 00000100:00100000:0.0:1788572597.746872:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+31:166681:x1875444569593344:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 985us (1152us total) trans 30064771085 rc 0/0 00000100:00100000:0.0:1788572597.746881:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1383 00000100:00100000:1.0:1788572597.752470:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.752547:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569593600 00000100:00100000:0.0:1788572597.752557:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569593600 00000100:00100000:0.0:1788572597.752611:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 71 00000100:00100000:0.0:1788572597.752621:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a274a5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+31:166681:x1875444569593600:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572597.752891:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a274a5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+32:166681:x1875444569593600:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 271us (429us total) trans 30064771086 rc 0/0 00000100:00100000:0.0:1788572597.752908:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 71 00000100:00100000:2.0:1788572597.757194:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.760788:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569593856 00000100:00100000:0.0:1788572597.760803:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569593856 00000100:00100000:0.0:1788572597.760868:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1384 00000100:00100000:0.0:1788572597.760877:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+32:166681:x1875444569593856:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.760899:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.760919:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bff62 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6ae expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761015:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761029:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761040:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761053:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761060:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761079:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.761360:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x285:0x0], index 0: 0 00010000:00010000:0.0:1788572597.761473:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f000/0x265cfe11109bff77 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761512:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f000/0x265cfe11109bff77 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761521:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f000/0x265cfe11109bff77 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761555:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761563:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761569:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761576:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761582:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.761587:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761594:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761604:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7400) 00010000:00010000:0.0:1788572597.761606:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.761610:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761617:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bff69 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.761628:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001071a76c reply state 0000000013814547 transno 30064771087 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761639:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761646:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x76709d63 (ffff8e5a0a4b7b00) 00010000:00010000:0.0:1788572597.761648:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.761650:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.761672:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bff62 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6ae expref: 35 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761690:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f000/0x265cfe11109bff77 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6ae expref: 34 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.761697:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x32:0x0].0x0 (ffff8e5a0a4b7100) 00010000:00010000:0.0:1788572597.761700:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.761702:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117f000, rc 0) 00000100:00100000:0.0:1788572597.761761:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+35:166681:x1875444569593856:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 885us (4574us total) trans 30064771087 rc 0/0 00000100:00100000:0.0:1788572597.761768:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1384 00000100:00100000:2.0:1788572597.763566:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.763649:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569594112 00000100:00100000:3.0:1788572597.763656:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569594112 00000100:00100000:3.0:1788572597.763746:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 72 00000100:00100000:3.0:1788572597.763756:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+35:166681:x1875444569594112:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572597.763957:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+36:166681:x1875444569594112:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 202us (394us total) trans 30064771088 rc 0/0 00000100:00100000:3.0:1788572597.763965:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 72 00000100:00100000:1.0:1788572597.765390:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.765449:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569594368 00000100:00100000:3.0:1788572597.765456:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569594368 00000100:00100000:3.0:1788572597.765514:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1385 00000100:00100000:3.0:1788572597.765522:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+36:166681:x1875444569594368:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572597.765536:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.765566:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bff85 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6b5 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.765659:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.765670:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.765678:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.765689:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.765695:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.765702:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572597.765959:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x285:0x0], index 1: 0 00010000:00010000:3.0:1788572597.766049:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bff9a lrc: 3/1,0 mode: --/PR res: [0x240002729:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766056:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bff9a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766075:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bff9a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766103:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766115:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766122:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766128:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.766132:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766139:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766160:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a16354d00) 00010000:00010000:3.0:1788572597.766163:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.766167:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766174:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109bff8c lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.766186:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ced1c92 reply state 00000000069e55a1 transno 30064771089 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766196:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766203:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xa3936bac (ffff8e5a16354200) 00010000:00010000:3.0:1788572597.766205:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.766208:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572597.766251:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109bff85 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6b5 expref: 39 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766270:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bff9a lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6b5 expref: 38 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.766275:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x33:0x0].0x0 (ffff8e5a16354e00) 00010000:00010000:3.0:1788572597.766276:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572597.766278:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf800, rc 0) 00000100:00100000:3.0:1788572597.766323:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+39:166681:x1875444569594368:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 802us (937us total) trans 30064771089 rc 0/0 00000100:00100000:3.0:1788572597.766335:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1385 00000100:00100000:2.0:1788572597.767897:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.767947:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569594624 00000100:00100000:0.0:1788572597.767955:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569594624 00000100:00100000:0.0:1788572597.767999:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 73 00000100:00100000:0.0:1788572597.768009:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+39:166681:x1875444569594624:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:0.0:1788572597.768266:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+40:166681:x1875444569594624:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 259us (372us total) trans 30064771090 rc 0/0 00000100:00100000:0.0:1788572597.768275:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 73 00000100:00100000:2.0:1788572597.769673:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.769716:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569594880 00000100:00100000:3.0:1788572597.769724:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569594880 00000100:00100000:3.0:1788572597.769782:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1386 00000100:00100000:3.0:1788572597.769794:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+40:166681:x1875444569594880:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572597.769812:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.769834:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfc00/0x265cfe11109bffa8 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6bc expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.769921:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.769935:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.769947:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.769965:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.769972:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.769979:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572597.770272:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x286:0x0], index 0: 0 00010000:00010000:3.0:1788572597.770391:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcec00/0x265cfe11109bffbd lrc: 3/1,0 mode: --/PR res: [0x240002729:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770408:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcec00/0x265cfe11109bffbd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770417:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcec00/0x265cfe11109bffbd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770444:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770450:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770457:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770463:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770472:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.770476:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770517:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770529:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4400) 00010000:00010000:3.0:1788572597.770533:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.770537:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770544:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109bffaf lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.770559:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094475c18 reply state 000000001af99d3a transno 30064771091 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770569:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770575:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xd0b639f4 (ffff8e590b3b4b00) 00010000:00010000:3.0:1788572597.770577:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.770579:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572597.770602:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfc00/0x265cfe11109bffa8 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6bc expref: 43 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770619:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcec00/0x265cfe11109bffbd lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6bc expref: 42 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.770631:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x34:0x0].0x0 (ffff8e590b3b4a00) 00010000:00010000:3.0:1788572597.770633:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572597.770635:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcec00, rc 0) 00000100:00100000:3.0:1788572597.770690:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+43:166681:x1875444569594880:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 901us (1019us total) trans 30064771091 rc 0/0 00000100:00100000:3.0:1788572597.770697:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1386 00000100:00100000:1.0:1788572597.772183:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.772259:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569595136 00000100:00100000:3.0:1788572597.772266:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569595136 00000100:00100000:3.0:1788572597.772308:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 74 00000100:00100000:3.0:1788572597.772316:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+43:166681:x1875444569595136:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572597.772499:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+44:166681:x1875444569595136:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 183us (319us total) trans 30064771092 rc 0/0 00000100:00100000:3.0:1788572597.772504:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 74 00000100:00100000:2.0:1788572597.773608:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.773650:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569595392 00000100:00100000:3.0:1788572597.773657:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569595392 00000100:00100000:3.0:1788572597.773702:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1387 00000100:00100000:3.0:1788572597.773712:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+44:166681:x1875444569595392:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572597.773728:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.773749:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109bffcb lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6c3 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.773832:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.773845:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.773858:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.773872:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.773879:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.773886:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572597.774152:0:188048:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x286:0x0], index 1: 0 00010000:00010000:3.0:1788572597.774270:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109bffe0 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774279:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109bffe0 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774287:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109bffe0 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774316:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774323:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774329:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774336:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774343:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.774347:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774354:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774364:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:3.0:1788572597.774367:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.774372:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774378:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109bffd2 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.774389:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f07d3a9 reply state 00000000aa1dc1f3 transno 30064771093 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774398:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774404:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xfdd9083c (ffff8e590b3b4200) 00010000:00010000:3.0:1788572597.774407:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.774409:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572597.774432:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109bffcb lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6c3 expref: 47 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774451:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109bffe0 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6c3 expref: 46 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.774465:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x35:0x0].0x0 (ffff8e590b3b4e00) 00010000:00010000:3.0:1788572597.774467:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572597.774469:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dce600, rc 0) 00000100:00100000:3.0:1788572597.774546:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+47:166681:x1875444569595392:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 836us (941us total) trans 30064771093 rc 0/0 00000100:00100000:3.0:1788572597.774555:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1387 00000100:00100000:2.0:1788572597.778270:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.778329:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569595648 00000100:00100000:0.0:1788572597.778338:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569595648 00000100:00100000:0.0:1788572597.778388:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 75 00000100:00100000:0.0:1788572597.778395:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+47:166681:x1875444569595648:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572597.778744:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+48:166681:x1875444569595648:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 348us (480us total) trans 30064771094 rc 0/0 00000100:00100000:1.0:1788572597.778751:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 75 00000100:00100000:2.0:1788572597.780023:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.780097:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569595904 00000100:00100000:0.0:1788572597.780104:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569595904 00000100:00100000:0.0:1788572597.780157:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1388 00000100:00100000:0.0:1788572597.780166:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+48:166681:x1875444569595904:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.780182:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.780212:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bffee lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6ca expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780296:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780310:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780321:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780335:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780341:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780348:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.780650:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x287:0x0], index 0: 0 00010000:00010000:0.0:1788572597.780771:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109c0003 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780784:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109c0003 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780792:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109c0003 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780821:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780826:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780830:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780835:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780838:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.780841:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780846:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780854:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7400) 00010000:00010000:0.0:1788572597.780856:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.780859:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780863:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109bfff5 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.780881:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf1820b8 reply state 00000000b7cde19e transno 30064771095 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780893:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780899:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x1b7026cc (ffff8e5a03b22100) 00010000:00010000:0.0:1788572597.780902:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.780905:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.780929:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109bffee lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6ca expref: 51 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780943:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109c0003 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6ca expref: 50 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.780948:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x36:0x0].0x0 (ffff8e5a03b22f00) 00010000:00010000:0.0:1788572597.780949:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.780951:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117ee00, rc 0) 00000100:00100000:0.0:1788572597.780991:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+51:166681:x1875444569595904:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 829us (971us total) trans 30064771095 rc 0/0 00000100:00100000:0.0:1788572597.780996:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1388 00000100:00100000:2.0:1788572597.785511:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.785552:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569596160 00000100:00100000:3.0:1788572597.785563:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569596160 00000100:00100000:3.0:1788572597.785615:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 76 00000100:00100000:3.0:1788572597.785625:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+51:166681:x1875444569596160:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572597.785889:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+52:166681:x1875444569596160:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 264us (415us total) trans 30064771096 rc 0/0 00000100:00100000:3.0:1788572597.785897:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 76 00000100:00100000:2.0:1788572597.789605:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.789667:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569596416 00000100:00100000:0.0:1788572597.789679:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569596416 00000100:00100000:0.0:1788572597.789740:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1389 00000100:00100000:0.0:1788572597.789759:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+52:166681:x1875444569596416:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.789787:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.789812:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c0011 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6d1 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.789911:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.789923:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.789931:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.789939:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.789943:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.789947:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.790259:0:198183:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x287:0x0], index 1: 0 00010000:00010000:0.0:1788572597.790391:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109c0026 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790398:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109c0026 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790403:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109c0026 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790434:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790445:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790452:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790458:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.790462:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790467:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790476:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a03b22d00) 00010000:00010000:0.0:1788572597.790516:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.790521:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790525:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c0018 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.790535:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097c0c7d2 reply state 0000000077ad3b52 transno 30064771097 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790542:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790547:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x3e3e6f26 (ffff8e5a03b22400) 00010000:00010000:0.0:1788572597.790548:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.790550:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.790577:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c0011 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6d1 expref: 55 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790619:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109c0026 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6d1 expref: 54 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.790628:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x37:0x0].0x0 (ffff8e5a03b22700) 00010000:00010000:0.0:1788572597.790630:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.790633:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164fa00, rc 0) 00000100:00100000:0.0:1788572597.790695:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+55:166681:x1875444569596416:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 945us (1098us total) trans 30064771097 rc 0/0 00000100:00100000:0.0:1788572597.790702:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1389 00000100:00100000:2.0:1788572597.792387:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.792455:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569596672 00000100:00100000:1.0:1788572597.792464:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569596672 00000100:00100000:3.0:1788572597.792552:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 77 00000100:00100000:3.0:1788572597.792569:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a274a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+55:166681:x1875444569596672:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572597.793008:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a274a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+56:166681:x1875444569596672:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 442us (622us total) trans 30064771098 rc 0/0 00000100:00100000:3.0:1788572597.793018:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 77 00000100:00100000:2.0:1788572597.794254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.794295:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569596928 00000100:00100000:0.0:1788572597.794303:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569596928 00000100:00100000:0.0:1788572597.794347:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1390 00000100:00100000:0.0:1788572597.794357:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+56:166681:x1875444569596928:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.794378:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.794400:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ea00/0x265cfe11109c0034 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6d8 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.794514:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.794528:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.794541:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.794556:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.794563:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.794570:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.794852:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x288:0x0], index 0: 0 00010000:00010000:0.0:1788572597.794975:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109c0049 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.794984:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109c0049 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.794991:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109c0049 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795020:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795026:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795032:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795038:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795047:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.795050:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795057:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795082:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7400) 00010000:00010000:0.0:1788572597.795085:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.795089:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795095:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c003b lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.795107:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b1b74bd reply state 0000000074a18a67 transno 30064771099 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795116:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795122:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x610cb780 (ffff8e5903395800) 00010000:00010000:0.0:1788572597.795124:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.795126:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.795149:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ea00/0x265cfe11109c0034 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6d8 expref: 59 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795166:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109c0049 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6d8 expref: 58 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.795190:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x38:0x0].0x0 (ffff8e5903395600) 00010000:00010000:0.0:1788572597.795192:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.795195:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164fc00, rc 0) 00000100:00100000:0.0:1788572597.795252:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+59:166681:x1875444569596928:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 897us (1000us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1788572597.795259:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1390 00000100:00100000:2.0:1788572597.798711:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.798771:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569597184 00000100:00100000:1.0:1788572597.798781:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569597184 00000100:00100000:1.0:1788572597.798833:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 78 00000100:00100000:1.0:1788572597.798843:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+59:166681:x1875444569597184:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572597.799115:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+60:166681:x1875444569597184:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 273us (412us total) trans 30064771100 rc 0/0 00000100:00100000:1.0:1788572597.799122:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 78 00000100:00100000:2.0:1788572597.800790:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.800856:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569597440 00000100:00100000:3.0:1788572597.800864:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569597440 00000100:00100000:3.0:1788572597.800916:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1391 00000100:00100000:3.0:1788572597.800926:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+60:166681:x1875444569597440:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572597.800943:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.800961:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf200/0x265cfe11109c0057 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6df expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801046:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801057:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801082:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801096:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801103:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801110:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572597.801383:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x288:0x0], index 1: 0 00010000:00010000:3.0:1788572597.801533:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c006c lrc: 3/1,0 mode: --/PR res: [0x240002729:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801543:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c006c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801551:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c006c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801593:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801600:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801608:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801614:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.801618:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801626:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801636:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:3.0:1788572597.801639:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.801644:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801650:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c005e lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.801663:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a515341b reply state 0000000039e393ad transno 30064771101 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801674:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801678:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x83daffd9 (ffff8e590b3b4400) 00010000:00010000:3.0:1788572597.801680:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.801682:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572597.801703:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf200/0x265cfe11109c0057 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6df expref: 63 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801716:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c006c lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6df expref: 62 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.801721:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x39:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572597.801722:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572597.801724:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcfc00, rc 0) 00000100:00100000:3.0:1788572597.801781:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a4143a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+63:166681:x1875444569597440:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 857us (998us total) trans 30064771101 rc 0/0 00000100:00100000:3.0:1788572597.801788:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1391 00000100:00100000:2.0:1788572597.803198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.803239:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569597696 00000100:00100000:3.0:1788572597.803252:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569597696 00000100:00100000:3.0:1788572597.803292:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 79 00000100:00100000:3.0:1788572597.803302:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+63:166681:x1875444569597696:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572597.803449:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+64:166681:x1875444569597696:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 148us (255us total) trans 30064771102 rc 0/0 00000100:00100000:3.0:1788572597.803453:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 79 00000100:00100000:2.0:1788572597.805744:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.805785:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569597952 00000100:00100000:3.0:1788572597.805796:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569597952 00000100:00100000:3.0:1788572597.805849:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1392 00000100:00100000:3.0:1788572597.805859:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+64:166681:x1875444569597952:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572597.805879:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.805900:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c007a lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6e6 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806002:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806017:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806028:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806042:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806048:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806055:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572597.806348:0:188050:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x289:0x0], index 0: 0 00010000:00010000:3.0:1788572597.806497:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfc00/0x265cfe11109c008f lrc: 3/1,0 mode: --/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806507:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfc00/0x265cfe11109c008f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806515:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfc00/0x265cfe11109c008f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806559:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806571:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806577:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806585:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806591:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.806595:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806604:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806613:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.806615:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.806618:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806625:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0081 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.806637:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6d54cab reply state 000000001f056a3d transno 30064771103 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806647:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806664:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xa6a94833 (ffff8e590b3b4300) 00010000:00010000:3.0:1788572597.806670:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.806673:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572597.806696:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c007a lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6e6 expref: 67 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806711:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfc00/0x265cfe11109c008f lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6e6 expref: 66 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.806715:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3a:0x0].0x0 (ffff8e590b3b4100) 00010000:00010000:3.0:1788572597.806716:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572597.806718:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcfc00, rc 0) 00000100:00100000:3.0:1788572597.806776:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+67:166681:x1875444569597952:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 918us (1036us total) trans 30064771103 rc 0/0 00000100:00100000:3.0:1788572597.806783:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1392 00000100:00100000:2.0:1788572597.808977:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.809037:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569598208 00000100:00100000:1.0:1788572597.809046:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569598208 00000100:00100000:1.0:1788572597.809110:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 80 00000100:00100000:1.0:1788572597.809120:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+67:166681:x1875444569598208:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572597.809446:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+68:166681:x1875444569598208:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 326us (475us total) trans 30064771104 rc 0/0 00000100:00100000:1.0:1788572597.809454:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 80 00000100:00100000:2.0:1788572597.810884:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.811090:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569598464 00000100:00100000:3.0:1788572597.811098:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569598464 00000100:00100000:3.0:1788572597.811158:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1393 00000100:00100000:3.0:1788572597.811168:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+68:166681:x1875444569598464:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572597.811188:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.811210:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c009d lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6ed expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811324:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811339:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811350:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811362:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xc977908d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811369:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811376:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572597.811693:0:188048:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x289:0x0], index 1: 0 00010000:00010000:3.0:1788572597.811807:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf200/0x265cfe11109c00b2 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811816:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf200/0x265cfe11109c00b2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811823:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf200/0x265cfe11109c00b2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811852:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811860:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811866:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811873:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811883:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.811887:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811895:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811905:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:3.0:1788572597.811907:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.811911:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811917:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c00a4 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.811929:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a184ab9a reply state 00000000ba46234f transno 30064771105 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811939:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811945:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xc977908d (ffff8e590b3b4d00) 00010000:00010000:3.0:1788572597.811947:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.811949:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572597.811972:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c009d lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6ed expref: 71 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.811992:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf200/0x265cfe11109c00b2 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6ed expref: 70 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.812004:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3b:0x0].0x0 (ffff8e590b3b4000) 00010000:00010000:3.0:1788572597.812006:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572597.812009:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcf200, rc 0) 00000100:00100000:3.0:1788572597.812077:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+71:166681:x1875444569598464:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 911us (1198us total) trans 30064771105 rc 0/0 00000100:00100000:3.0:1788572597.812084:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1393 00000100:00100000:2.0:1788572597.813860:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.813920:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569598720 00000100:00100000:3.0:1788572597.813928:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569598720 00000100:00100000:3.0:1788572597.813976:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 81 00000100:00100000:3.0:1788572597.813986:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+71:166681:x1875444569598720:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572597.814230:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+72:166681:x1875444569598720:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 245us (378us total) trans 30064771106 rc 0/0 00000100:00100000:3.0:1788572597.814237:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 81 00000100:00100000:2.0:1788572597.816368:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.816446:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569598976 00000100:00100000:0.0:1788572597.816454:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569598976 00000100:00100000:0.0:1788572597.816536:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1394 00000100:00100000:0.0:1788572597.816547:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+72:166681:x1875444569598976:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.816569:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.816593:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ea00/0x265cfe11109c00c0 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6f4 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.816688:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.816702:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.816712:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.816725:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.816731:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.816738:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.817020:0:196070:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x28a:0x0], index 0: 0 00010000:00010000:0.0:1788572597.817151:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c00d5 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817161:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c00d5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817168:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c00d5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817199:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817205:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817210:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817216:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817221:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.817224:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817231:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817245:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5903395100) 00010000:00010000:0.0:1788572597.817248:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.817252:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817258:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e000/0x265cfe11109c00c7 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.817270:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6a6c6cc reply state 000000004931dfce transno 30064771107 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817281:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817287:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xec45d8e7 (ffff8e5a0a4b7400) 00010000:00010000:0.0:1788572597.817289:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.817291:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.817318:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164ea00/0x265cfe11109c00c0 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6f4 expref: 75 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817344:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c00d5 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6f4 expref: 74 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.817352:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3c:0x0].0x0 (ffff8e5a03b22d00) 00010000:00010000:0.0:1788572597.817354:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.817357:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a3164f000, rc 0) 00000100:00100000:0.0:1788572597.817418:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+75:166681:x1875444569598976:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 873us (1058us total) trans 30064771107 rc 0/0 00000100:00100000:0.0:1788572597.817426:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1394 00000100:00100000:2.0:1788572597.819779:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.819891:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569599232 00000100:00100000:1.0:1788572597.819901:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569599232 00000100:00100000:1.0:1788572597.819952:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 82 00000100:00100000:1.0:1788572597.819963:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+75:166681:x1875444569599232:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572597.820231:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+76:166681:x1875444569599232:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 269us (460us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1788572597.820239:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 82 00000100:00100000:2.0:1788572597.821468:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.821615:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569599488 00000100:00100000:0.0:1788572597.821627:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569599488 00000100:00100000:0.0:1788572597.821715:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1395 00000100:00100000:0.0:1788572597.821725:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+76:166681:x1875444569599488:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.821742:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.821764:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c00e3 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb6fb expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.821853:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.821867:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.821878:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.821892:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xf142140 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.821899:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.821906:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.822212:0:198183:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x28a:0x0], index 1: 0 00010000:00010000:0.0:1788572597.822327:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a600/0x265cfe11109c00f8 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822337:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a600/0x265cfe11109c00f8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822345:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a600/0x265cfe11109c00f8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822379:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822387:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822394:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822400:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.822405:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822412:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822423:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a02ffb000) 00010000:00010000:0.0:1788572597.822425:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.822430:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822437:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c00ea lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.822450:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b336513c reply state 000000002296b3fd transno 30064771109 ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822460:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822466:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xf142140 (ffff8e5a02ffba00) 00010000:00010000:0.0:1788572597.822469:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.822471:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.822516:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c00e3 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6fb expref: 79 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822536:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a600/0x265cfe11109c00f8 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6fb expref: 78 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.822544:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3d:0x0].0x0 (ffff8e5a02ffb300) 00010000:00010000:0.0:1788572597.822546:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.822548:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14a600, rc 0) 00000100:00100000:0.0:1788572597.822602:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+79:166681:x1875444569599488:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 879us (1138us total) trans 30064771109 rc 0/0 00000100:00100000:0.0:1788572597.822610:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1395 00000100:00100000:2.0:1788572597.824188:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.824296:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569599744 00000100:00100000:3.0:1788572597.824303:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569599744 00000100:00100000:3.0:1788572597.824354:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 83 00000100:00100000:3.0:1788572597.824364:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a274a6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+79:166681:x1875444569599744:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572597.824613:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a274a6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+80:166681:x1875444569599744:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 248us (428us total) trans 30064771110 rc 0/0 00000100:00100000:3.0:1788572597.824632:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 83 00000100:00100000:2.0:1788572597.826181:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.826230:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569600000 00000100:00100000:0.0:1788572597.826236:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569600000 00000100:00100000:0.0:1788572597.826282:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1396 00000100:00100000:0.0:1788572597.826292:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+80:166681:x1875444569600000:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:0.0:1788572597.826310:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.826328:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14aa00/0x265cfe11109c0106 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb702 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826414:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826424:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826434:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826441:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826446:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826450:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.826753:0:188833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x28b:0x0], index 0: 0 00010000:00010000:0.0:1788572597.826881:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c011b lrc: 3/1,0 mode: --/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826890:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c011b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826898:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c011b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826927:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826933:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826939:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826945:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826951:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.826955:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826972:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826984:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a02ffbf00) 00010000:00010000:0.0:1788572597.826987:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.826991:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.826996:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c010d lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.827007:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082de80f6 reply state 000000007b6e8795 transno 30064771111 ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.827013:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.827017:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x31e2699a (ffff8e5a02ffb200) 00010000:00010000:0.0:1788572597.827019:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.827020:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.827039:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14aa00/0x265cfe11109c0106 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb702 expref: 83 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.827051:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c011b lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb702 expref: 82 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.827074:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3e:0x0].0x0 (ffff8e5a02ffb500) 00010000:00010000:0.0:1788572597.827076:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572597.827079:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14ba00, rc 0) 00000100:00100000:0.0:1788572597.827137:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+83:166681:x1875444569600000:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 847us (962us total) trans 30064771111 rc 0/0 00000100:00100000:0.0:1788572597.827142:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1396 00000100:00100000:2.0:1788572597.828819:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.828881:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569600256 00000100:00100000:1.0:1788572597.828889:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569600256 00000100:00100000:1.0:1788572597.828936:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 84 00000100:00100000:1.0:1788572597.828945:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+83:166681:x1875444569600256:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:1.0:1788572597.829187:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+84:166681:x1875444569600256:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 242us (371us total) trans 30064771112 rc 0/0 00000100:00100000:1.0:1788572597.829195:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 84 00000100:00100000:2.0:1788572597.832290:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.832347:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569600512 00000100:00100000:3.0:1788572597.832356:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569600512 00000100:00100000:3.0:1788572597.832424:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1397 00000100:00100000:3.0:1788572597.832434:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+84:166681:x1875444569600512:12345-192.168.202.57@tcp:101:createmany.0 00010000:00010000:3.0:1788572597.832456:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.832503:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c0129 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb709 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.832601:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.832624:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.832637:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833161:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833172:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833182:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572597.833519:0:188049:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x28b:0x0], index 1: 0 00010000:00010000:2.0:1788572597.833661:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535000/0x265cfe11109c013e lrc: 3/1,0 mode: --/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833671:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535000/0x265cfe11109c013e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833680:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535000/0x265cfe11109c013e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833711:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833717:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833724:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833730:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.833734:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833742:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833769:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4500) 00010000:00010000:2.0:1788572597.833773:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.833778:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833784:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c0130 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572597.833797:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000121e9a53 reply state 000000002223c9bf transno 30064771113 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833808:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833815:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x54b0b1f4 (ffff8e590d91e700) 00010000:00010000:2.0:1788572597.833817:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572597.833820:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572597.833851:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c0129 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb709 expref: 87 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833870:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535000/0x265cfe11109c013e lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb709 expref: 86 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.833878:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3f:0x0].0x0 (ffff8e590d91ed00) 00010000:00010000:2.0:1788572597.833880:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572597.833882:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a24535000, rc 0) 00000100:00100000:2.0:1788572597.834462:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+87:166681:x1875444569600512:12345-192.168.202.57@tcp:101:createmany.0 Request processed in 2027us (2177us total) trans 30064771113 rc 0/0 00000100:00100000:2.0:1788572597.834470:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1397 00000100:00100000:2.0:1788572597.836139:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.836270:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569600768 00000100:00100000:3.0:1788572597.836278:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569600768 00000100:00100000:3.0:1788572597.836324:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 85 00000100:00100000:3.0:1788572597.836334:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+87:166681:x1875444569600768:12345-192.168.202.57@tcp:35:createmany.0 00000100:00100000:3.0:1788572597.836635:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+88:166681:x1875444569600768:12345-192.168.202.57@tcp:35:createmany.0 Request processed in 302us (501us total) trans 30064771114 rc 0/0 00000100:00100000:3.0:1788572597.836643:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 85 00000100:00100000:0.0:1788572597.845039:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.845116:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569601024 00000100:00100000:3.0:1788572597.845127:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569601024 00000100:00100000:3.0:1788572597.845189:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1398 00000100:00100000:3.0:1788572597.845200:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+88:166687:x1875444569601024:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572597.845223:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.845248:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c014c lrc: 2/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb710 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572597.845361:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x2b:0x0]: returning size 4096 00010000:00010000:3.0:1788572597.845470:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c014c lrc: 1/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb710 expref: 90 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.845511:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.845515:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572597.845521:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c014c lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb710 expref: 90 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.845538:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a40dcec00, rc 0) 00000100:00100000:3.0:1788572597.845604:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+89:166687:x1875444569601024:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 406us (573us total) trans 30064771115 rc 301/301 00000100:00100000:3.0:1788572597.845612:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1398 00000100:00100000:2.0:1788572597.846974:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.847018:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569601280 00000100:00100000:3.0:1788572597.847025:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569601280 00000100:00100000:3.0:1788572597.847079:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1399 00000100:00100000:3.0:1788572597.847089:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+89:166687:x1875444569601280:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572597.847104:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.847119:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c015a lrc: 2/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb717 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.847194:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c0161 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.847208:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c0161 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.847225:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c0161 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572597.847235:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x2d:0x0]: returning size 0 00010000:00010000:3.0:1788572597.847325:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c015a lrc: 0/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb717 expref: 92 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.847358:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c0161 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb717 expref: 91 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.847366:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2d:0x0].0x0 (ffff8e5a039c6400) 00010000:00010000:3.0:1788572597.847370:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572597.847373:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcfa00, rc 0) 00000100:00100000:3.0:1788572597.847414:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+91:166687:x1875444569601280:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 327us (455us total) trans 30064771116 rc 0/0 00000100:00100000:3.0:1788572597.847422:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1399 00000100:00100000:2.0:1788572597.849107:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.849151:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.849195:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569601664 00000100:00100000:1.0:1788572597.849203:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569601408 00000100:00100000:3.0:1788572597.849207:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569601664 00000100:00100000:1.0:1788572597.849219:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569601408 00000100:00100000:3.0:1788572597.849253:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 86 00000100:00100000:3.0:1788572597.849265:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:166687:x1875444569601664:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:1.0:1788572597.849273:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4691 00000100:00100000:1.0:1788572597.849284:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:2397:x1875444569601408:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572597.849297:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572597.849317:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c0161 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb717 expref: 92 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.849334:0:152004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2d:0x0].0x0 (ffff8e5a039c6400) 00010000:00010000:1.0:1788572597.849338:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572597.849384:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:2397:x1875444569601408:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 102us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572597.849392:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4691 00000100:00100000:3.0:1788572597.849413:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+91:166687:x1875444569601664:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 150us (260us total) trans 30064771117 rc 0/0 00000100:00100000:3.0:1788572597.849421:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 86 00000100:00100000:0.0:1788572597.850374:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.850411:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569601920 00000100:00100000:3.0:1788572597.850417:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569601920 00000100:00100000:3.0:1788572597.850455:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 87 00000100:00100000:3.0:1788572597.850465:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+91:166687:x1875444569601920:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1788572597.850633:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:166687:x1875444569601920:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 169us (258us total) trans 30064771118 rc 0/0 00000100:00100000:3.0:1788572597.850640:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 87 00000100:00100000:2.0:1788572597.856241:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.856339:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569602176 00000100:00100000:0.0:1788572597.856350:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569602176 00000100:00100000:0.0:1788572597.856456:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1400 00000100:00100000:0.0:1788572597.856467:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:166688:x1875444569602176:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:0.0:1788572597.856513:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.856538:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109c016f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb71e expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572597.856640:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1788572597.856858:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109c016f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb71e expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.856879:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:0.0:1788572597.856883:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572597.856890:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109c016f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb71e expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.856910:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14a400, rc 0) 00000100:00100000:0.0:1788572597.857008:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:166688:x1875444569602176:12345-192.168.202.57@tcp:101:rm.0 Request processed in 542us (778us total) trans 352187318277 rc 301/301 00000100:00100000:0.0:1788572597.857018:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1400 00000100:00100000:2.0:1788572597.859172:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.859235:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569602304 00000100:00100000:1.0:1788572597.859247:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569602304 00000100:00100000:1.0:1788572597.859322:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 88 00000100:00100000:1.0:1788572597.859333:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:166688:x1875444569602304:12345-192.168.202.57@tcp:37:rm.0 00000100:00100000:3.0:1788572597.862077:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:166688:x1875444569602304:12345-192.168.202.57@tcp:37:rm.0 Request processed in 2722us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.862092:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 88 00000100:00100000:2.0:1788572597.867333:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.867400:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569602560 00000100:00100000:3.0:1788572597.867427:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569602560 00000100:00100000:1.0:1788572597.867541:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 89 00000100:00100000:1.0:1788572597.867570:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a274a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:166688:x1875444569602560:12345-192.168.202.57@tcp:35:rm.0 00000100:00100000:1.0:1788572597.867883:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a274a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:166688:x1875444569602560:12345-192.168.202.57@tcp:35:rm.0 Request processed in 331us (563us total) trans 352187318278 rc 0/0 00000100:00100000:1.0:1788572597.867902:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 89 00000100:00100000:2.0:1788572597.869249:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.869335:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569602816 00000100:00100000:0.0:1788572597.869344:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569602816 00000100:00100000:0.0:1788572597.869424:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1401 00000100:00100000:0.0:1788572597.869437:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:166688:x1875444569602816:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:0.0:1788572597.869469:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.869519:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109c017d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb725 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.869641:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109c0184 lrc: 3/1,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.869656:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109c0184 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.869669:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109c0184 lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572597.869682:0:198183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1788572597.869810:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14a400/0x265cfe11109c017d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb725 expref: 14 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.869840:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109c0184 lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb725 expref: 13 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.869851:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:0.0:1788572597.869854:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788572597.869859:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e590d14aa00, rc 0) 00000100:00100000:0.0:1788572597.869935:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:166688:x1875444569602816:12345-192.168.202.57@tcp:101:rm.0 Request processed in 501us (691us total) trans 352187318279 rc 0/0 00000100:00100000:0.0:1788572597.869952:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1401 00000100:00100000:0.0:1788572597.872361:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.872427:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569602944 00000100:00100000:3.0:1788572597.872438:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569602944 00000100:00100000:3.0:1788572597.872531:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1402 00000100:00100000:3.0:1788572597.872541:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+92:166688:x1875444569602944:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572597.872565:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.872595:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c0192 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb72c expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.872668:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0199 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.872681:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0199 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.872692:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0199 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572597.872730:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x2b:0x0]: returning size 4096 00000004:00200000:3.0:1788572597.872733:0:188833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572597.872761:0:188833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0199 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.872786:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c0192 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb72c expref: 94 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.872809:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0199 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb72c expref: 93 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.872818:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.872821:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788572597.872824:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffce800, rc 0) 00000100:00100000:3.0:1788572597.872878:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:166688:x1875444569602944:12345-192.168.202.57@tcp:101:rm.0 Request processed in 340us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.872883:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1402 00000100:00100000:2.0:1788572597.874205:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.874282:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569603200 00000100:00100000:1.0:1788572597.874289:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569603200 00000100:00100000:1.0:1788572597.874334:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1403 00000100:00100000:1.0:1788572597.874345:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+93:166688:x1875444569603200:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:1.0:1788572597.874358:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572597.874375:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c01a0 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb733 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.874452:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3000/0x265cfe11109c01a7 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.874464:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3000/0x265cfe11109c01a7 lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.874474:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3000/0x265cfe11109c01a7 lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572597.874517:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x2b:0x0]: returning size 4096 00010000:00010000:1.0:1788572597.874616:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c01a0 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb733 expref: 96 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.874637:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3000/0x265cfe11109c01a7 lrc: 3/0,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb733 expref: 95 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.874645:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:1.0:1788572597.874648:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788572597.874651:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3000, rc 0) 00000100:00100000:1.0:1788572597.874697:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:166688:x1875444569603200:12345-192.168.202.57@tcp:101:rm.0 Request processed in 356us (497us total) trans 30064771119 rc 0/0 00000100:00100000:1.0:1788572597.874704:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1403 00000100:00100000:2.0:1788572597.876461:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.876536:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569603328 00000100:00100000:0.0:1788572597.876541:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569603328 00000100:00100000:0.0:1788572597.876596:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 90 00000100:00100000:0.0:1788572597.876607:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:166688:x1875444569603328:12345-192.168.202.57@tcp:37:rm.0 00000100:00100000:2.0:1788572597.878645:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:166688:x1875444569603328:12345-192.168.202.57@tcp:37:rm.0 Request processed in 2032us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572597.878662:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 90 00000100:00100000:2.0:1788572597.880651:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.880710:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569603584 00000100:00100000:3.0:1788572597.880718:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569603584 00000100:00100000:3.0:1788572597.880763:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1404 00000100:00100000:3.0:1788572597.880772:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:166688:x1875444569603584:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.880821:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788572597.880843:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c006c lrc: 0/0,0 mode: --/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6df expref: 95 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.880860:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x39:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572597.880876:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c0199 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb72c expref: 94 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.880882:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.880885:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.880900:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.880909:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.880916:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.880922:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.880926:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.880930:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881001:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881007:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881011:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.881247:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].2, 64 off8320 00000004:00080000:3.0:1788572597.881258:0:188050:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 9350875777498ns, next at 9351875775093ns, rc = 0 00010000:00010000:3.0:1788572597.881301:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 3/0,1 mode: --/PW res: [0x240002729:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881311:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881316:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881320:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881325:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881328:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881351:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.881367:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881373:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881379:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881384:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.881387:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881392:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.881393:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572597.881404:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881407:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x39:0x0].0x0 (ffff8e590b3b4600) 00010000:00010000:3.0:1788572597.881414:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572597.881419:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.881420:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.881425:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881431:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01c3 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.881438:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881451:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.881452:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x39:0x0].0x0 (ffff8e590b3b4600) 00010000:00010000:0.0:1788572597.881460:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572597.881463:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.881465:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 1/0,0 mode: --/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881469:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.881505:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcec00/0x265cfe11109c01ca lrc: 0/0,0 mode: --/PW res: [0x240002729:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881512:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881520:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.881523:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881527:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881534:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.881536:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.881539:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.881544:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.881546:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c01b5 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.881548:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572597.881553:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1788572597.881557:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000759d4ce6 reply state 00000000d38e7252 transno 30064771120 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881565:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.881571:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x83daffd9 (ffff8e590b3b4400) 00010000:00010000:3.0:1788572597.881578:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.881581:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.881642:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:166688:x1875444569603584:12345-192.168.202.57@tcp:36:rm.0 Request processed in 870us (996us total) trans 30064771120 rc 0/0 00000100:00100000:3.0:1788572597.881650:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1404 00000100:00100000:3.0:1788572597.884380:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.884445:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569603840 00000100:00100000:2.0:1788572597.884454:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569603840 00000100:00100000:2.0:1788572597.884533:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1405 00000100:00100000:2.0:1788572597.884543:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+95:166688:x1875444569603840:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572597.884595:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572597.884619:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109bfeeb lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb692 expref: 95 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.884681:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2e:0x0].0x0 (ffff8e5a16354600) 00010000:00010000:2.0:1788572597.884690:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572597.884707:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.884717:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.884725:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.884732:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.884736:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.884740:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.884812:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.884821:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.884828:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572597.885029:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].2, 64 off8320 00000004:00080000:2.0:1788572597.885036:0:188048:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 9350879556265ns, next at 9351879554720ns, rc = 0 00010000:00010000:2.0:1788572597.885085:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885092:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885100:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885107:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885114:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885120:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885137:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572597.885154:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.885156:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.885160:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.885163:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885166:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.885170:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572597.885171:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.885175:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.885175:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885183:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.885183:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885193:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2e:0x0].0x0 (ffff8e590d91e800) 00010000:00010000:2.0:1788572597.885196:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.885198:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2e:0x0].0x0 (ffff8e590d91e800) 00010000:00010000:2.0:1788572597.885199:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 2/0,0 mode: --/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.885201:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572597.885204:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885206:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c01df lrc: 0/0,0 mode: --/EX res: [0x240002729:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.885210:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c01e6 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885221:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885227:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885233:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.885233:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.885236:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.885237:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.885239:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885245:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.885254:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885262:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885268:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:2.0:1788572597.885269:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.885271:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885275:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c01d1 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572597.885282:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091bdf7ff reply state 000000008954d1dc transno 30064771121 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885289:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.885293:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xc1e56442 (ffff8e5a16354c00) 00010000:00010000:2.0:1788572597.885295:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572597.885296:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572597.885354:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+96:166688:x1875444569603840:12345-192.168.202.57@tcp:36:rm.0 Request processed in 813us (985us total) trans 30064771121 rc 0/0 00000100:00100000:2.0:1788572597.885359:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1405 00010000:00010000:2.0:1788572597.885605:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572597.886529:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.886581:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569604096 00000100:00100000:3.0:1788572597.886587:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569604096 00000100:00100000:3.0:1788572597.886629:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1406 00000100:00100000:3.0:1788572597.886640:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1095ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+96:166688:x1875444569604096:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.886678:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572597.886694:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109bff9a lrc: 0/0,0 mode: --/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6b5 expref: 96 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886707:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x33:0x0].0x0 (ffff8e5a16354e00) 00010000:00010000:3.0:1788572597.886713:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.886726:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886736:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886743:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886750:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886757:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886761:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886812:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 3/0,1 mode: --/EX res: [0x240002729:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886820:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886825:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.886935:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].3, 64 off8384 00010000:00010000:3.0:1788572597.886962:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886967:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886972:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886976:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886980:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886983:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.886997:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.887009:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887013:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887017:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887020:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.887023:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887027:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.887028:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572597.887033:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x33:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:3.0:1788572597.887035:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572597.887037:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887038:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 2/0,0 mode: --/EX res: [0x240002729:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887051:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c01fb lrc: 0/0,0 mode: --/EX res: [0x240002729:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.887068:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572597.887074:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887075:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887091:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.887102:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887102:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887120:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.887123:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x33:0x0].0x0 (ffff8e590b3b4900) 00010000:00010000:2.0:1788572597.887129:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572597.887129:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.887135:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.887136:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.887153:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c0202 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887153:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887168:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.887171:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.887173:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.887178:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.887178:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf800/0x265cfe11109c01ed lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.887182:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.887187:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1788572597.887191:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000016f5cc3 reply state 000000001fe816c7 transno 30064771122 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887201:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.887207:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xa3936bac (ffff8e5a16354200) 00010000:00010000:3.0:1788572597.887209:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.887211:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.887274:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1095ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+97:166688:x1875444569604096:12345-192.168.202.57@tcp:36:rm.0 Request processed in 636us (746us total) trans 30064771122 rc 0/0 00000100:00100000:3.0:1788572597.887281:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1406 00000100:00100000:1.0:1788572597.888828:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.888891:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569604352 00000100:00100000:0.0:1788572597.888897:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569604352 00000100:00100000:0.0:1788572597.888942:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1407 00000100:00100000:0.0:1788572597.888951:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+97:166688:x1875444569604352:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572597.888986:0:198183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572597.889003:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c011b lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb702 expref: 97 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889016:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3e:0x0].0x0 (ffff8e5a02ffb500) 00010000:00010000:0.0:1788572597.889024:0:198183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572597.889037:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889047:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889055:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889076:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889083:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889098:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889155:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889163:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889169:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572597.889315:0:198183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].3, 64 off8384 00010000:00010000:0.0:1788572597.889350:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 3/0,1 mode: --/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889358:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889365:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889371:0:198183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889377:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889382:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889404:0:198183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572597.889419:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889425:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889434:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889439:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.889442:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889448:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889454:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3e:0x0].0x0 (ffff8e5a02ffbf00) 00010000:00010000:0.0:1788572597.889457:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572597.889460:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889465:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0217 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889508:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889514:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889520:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889524:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.889533:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889542:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889551:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:0.0:1788572597.889554:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.889557:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889562:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0209 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.889571:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021f89aec reply state 00000000e8c99d6a transno 30064771123 ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889579:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.889592:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x31e2699a (ffff8e5a02ffb200) 00010000:00010000:0.0:1788572597.889595:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.889600:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572597.889648:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+98:166688:x1875444569604352:12345-192.168.202.57@tcp:36:rm.0 Request processed in 697us (825us total) trans 30064771123 rc 0/0 00000100:00100000:0.0:1788572597.889654:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1407 00010000:00010000:2.0:1788572597.889791:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.889798:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.889804:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572597.889807:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.889813:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.889822:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3e:0x0].0x0 (ffff8e5a02ffbf00) 00010000:00010000:2.0:1788572597.889824:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572597.889827:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 1/0,0 mode: --/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.889832:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c021e lrc: 0/0,0 mode: --/PW res: [0x240002729:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.889842:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.889844:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.889845:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572597.891211:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.891250:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569604608 00000100:00100000:3.0:1788572597.891257:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569604608 00000100:00100000:3.0:1788572597.891302:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1408 00000100:00100000:3.0:1788572597.891311:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+98:166688:x1875444569604608:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.891348:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572597.891364:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109bff0e lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb699 expref: 98 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891378:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2f:0x0].0x0 (ffff8e5a16354000) 00010000:00010000:3.0:1788572597.891386:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.891400:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891411:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891419:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891428:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xef08328a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891435:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891441:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891522:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891531:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891539:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.891709:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].4, 64 off8448 00010000:00010000:3.0:1788572597.891744:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891753:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891761:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891768:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891775:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891781:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891798:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.891810:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891821:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.891823:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572597.891832:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.891834:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891843:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.891849:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.891851:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.891855:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891860:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.891866:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.891871:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2f:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:3.0:1788572597.891875:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572597.891886:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2f:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:0.0:1788572597.891890:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572597.891894:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 1/0,0 mode: --/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.891900:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c023a lrc: 0/0,0 mode: --/PW res: [0x240002729:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.891912:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572597.891914:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572597.891917:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.892047:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892066:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c0233 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892085:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892092:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892098:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892104:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892110:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.892113:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892119:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892127:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.892129:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.892132:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892137:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0225 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.892145:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d735850 reply state 00000000ec75070f transno 30064771124 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892155:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.892161:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xef08328a (ffff8e5a16354b00) 00010000:00010000:3.0:1788572597.892164:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.892166:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.892222:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+99:166688:x1875444569604608:12345-192.168.202.57@tcp:36:rm.0 Request processed in 912us (1016us total) trans 30064771124 rc 0/0 00000100:00100000:3.0:1788572597.892230:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1408 00000100:00100000:1.0:1788572597.893812:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.893856:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569604864 00000100:00100000:2.0:1788572597.893865:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569604864 00000100:00100000:2.0:1788572597.893917:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1409 00000100:00100000:2.0:1788572597.893927:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+99:166688:x1875444569604864:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572597.893966:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572597.893985:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f000/0x265cfe11109c00d5 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6f4 expref: 99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894001:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3c:0x0].0x0 (ffff8e5a03b22d00) 00010000:00010000:2.0:1788572597.894011:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572597.894026:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894037:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894046:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894072:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894081:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894088:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894154:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 3/0,1 mode: --/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894162:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894169:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572597.894349:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].4, 64 off8448 00010000:00010000:2.0:1788572597.894390:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894408:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894416:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894423:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894429:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894436:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894453:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572597.894468:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.894473:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.894475:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.894503:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894526:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.894527:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.894532:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.894539:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894550:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.894550:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3c:0x0].0x0 (ffff8e590d91ee00) 00010000:00010000:3.0:1788572597.894556:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572597.894558:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894562:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.894562:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534400/0x265cfe11109c0256 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894583:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.894585:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.894589:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.894593:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.894595:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3c:0x0].0x0 (ffff8e590d91ee00) 00010000:00010000:2.0:1788572597.894599:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572597.894602:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 2/0,0 mode: --/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894607:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535800/0x265cfe11109c024f lrc: 0/0,0 mode: --/EX res: [0x240002729:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894624:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894630:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894639:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894644:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.894647:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894652:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894658:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:2.0:1788572597.894661:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.894663:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894668:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535a00/0x265cfe11109c0241 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572597.894676:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d627caf reply state 0000000044662dda transno 30064771125 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894686:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.894692:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xec45d8e7 (ffff8e5a0a4b7400) 00010000:00010000:2.0:1788572597.894694:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572597.894697:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572597.894749:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+100:166688:x1875444569604864:12345-192.168.202.57@tcp:36:rm.0 Request processed in 824us (942us total) trans 30064771125 rc 0/0 00000100:00100000:2.0:1788572597.894756:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1409 00000100:00100000:1.0:1788572597.895976:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.896037:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569605120 00000100:00100000:3.0:1788572597.896044:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569605120 00000100:00100000:3.0:1788572597.896101:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1410 00000100:00100000:3.0:1788572597.896111:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+100:166688:x1875444569605120:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.896147:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572597.896163:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fa00/0x265cfe11109bff31 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6a0 expref: 100 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896176:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x30:0x0].0x0 (ffff8e5a0a4b7200) 00010000:00010000:3.0:1788572597.896184:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.896198:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896208:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896216:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896227:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896233:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896237:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896279:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 3/0,1 mode: --/EX res: [0x240002729:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896284:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896288:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.896408:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].5, 64 off8512 00010000:00010000:3.0:1788572597.896453:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896463:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896475:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896508:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896513:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896518:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896534:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.896548:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.896553:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572597.896555:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.896563:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896565:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.896580:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.896582:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.896589:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.896590:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.896609:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.896620:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x30:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:3.0:1788572597.896621:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.896623:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572597.896629:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896637:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x30:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:2.0:1788572597.896638:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0272 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896643:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.896650:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 2/0,0 mode: --/EX res: [0x240002729:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.896654:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.896658:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.896658:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c026b lrc: 0/0,0 mode: --/EX res: [0x240002729:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.896662:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.896684:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896691:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896696:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896701:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896706:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.896708:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896715:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896721:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.896723:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.896726:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896731:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c025d lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.896739:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071bb59fd reply state 00000000ac7c4147 transno 30064771126 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896748:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.896754:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x1c2b00d3 (ffff8e5a0a4b7900) 00010000:00010000:3.0:1788572597.896756:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.896759:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.896816:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+101:166688:x1875444569605120:12345-192.168.202.57@tcp:36:rm.0 Request processed in 706us (842us total) trans 30064771126 rc 0/0 00000100:00100000:3.0:1788572597.896823:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1410 00000100:00100000:3.0:1788572597.898030:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.898088:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569605376 00000100:00100000:2.0:1788572597.898096:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569605376 00000100:00100000:2.0:1788572597.898147:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1411 00000100:00100000:2.0:1788572597.898157:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+101:166688:x1875444569605376:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572597.898195:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572597.898208:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcf200/0x265cfe11109c00b2 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6ed expref: 101 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898222:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3b:0x0].0x0 (ffff8e590b3b4000) 00010000:00010000:2.0:1788572597.898232:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572597.898247:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898258:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898266:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898276:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xc977908d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898283:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898289:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898353:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898362:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898370:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572597.898568:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].5, 64 off8512 00010000:00010000:2.0:1788572597.898600:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 3/0,1 mode: --/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898606:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898611:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898616:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898620:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898625:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898645:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.898669:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.898672:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.898677:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898681:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898694:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.898694:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.898700:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898705:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.898712:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.898715:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898729:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.898749:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3b:0x0].0x0 (ffff8e590d91eb00) 00010000:00010000:3.0:1788572597.898761:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572597.898765:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3b:0x0].0x0 (ffff8e590d91eb00) 00010000:00010000:3.0:1788572597.898766:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 1/0,0 mode: --/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898770:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572597.898776:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.898780:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534e00/0x265cfe11109c028e lrc: 0/0,0 mode: --/PW res: [0x240002729:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898790:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535200/0x265cfe11109c0287 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.898795:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.898799:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.898801:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.898811:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898816:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898820:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898823:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898826:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.898828:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898831:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898836:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:2.0:1788572597.898837:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.898839:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898843:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534000/0x265cfe11109c0279 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572597.898848:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091dc33f4 reply state 00000000f9d82278 transno 30064771127 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898855:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.898859:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xc977908d (ffff8e590b3b4d00) 00010000:00010000:2.0:1788572597.898860:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572597.898862:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572597.898914:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590cb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+102:166688:x1875444569605376:12345-192.168.202.57@tcp:36:rm.0 Request processed in 759us (887us total) trans 30064771127 rc 0/0 00000100:00100000:2.0:1788572597.898918:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1411 00000100:00100000:1.0:1788572597.900204:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.900283:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569605632 00000100:00100000:3.0:1788572597.900291:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569605632 00000100:00100000:3.0:1788572597.900337:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1412 00000100:00100000:3.0:1788572597.900347:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+102:166688:x1875444569605632:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.900398:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572597.900411:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e200/0x265cfe11109bfea5 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb684 expref: 102 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900426:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2c:0x0].0x0 (ffff8e5a0a4b7e00) 00010000:00010000:3.0:1788572597.900435:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.900450:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900462:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900470:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900501:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900507:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900512:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900556:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900562:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900566:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.900708:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].6, 64 off8576 00010000:00010000:3.0:1788572597.900754:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900764:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900771:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900782:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900788:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900793:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900809:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.900832:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900838:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.900839:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.900847:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900856:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.900857:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572597.900862:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900866:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.900871:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900872:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.900887:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2c:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:3.0:1788572597.900888:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.900892:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572597.900896:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 1/0,0 mode: --/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.900901:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c02aa lrc: 0/0,0 mode: --/PW res: [0x240002729:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900902:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2c:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:3.0:1788572597.900909:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572597.900913:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.900913:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.900916:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.900918:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.900924:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c02a3 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900944:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900949:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900954:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900967:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900973:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.900975:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900979:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900985:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.900986:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.900988:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.900992:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c0295 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.900998:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7deca51 reply state 00000000db684084 transno 30064771128 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.901004:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.901007:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x679fc7b1 (ffff8e5a0a4b7f00) 00010000:00010000:3.0:1788572597.901009:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.901011:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.901053:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+103:166688:x1875444569605632:12345-192.168.202.57@tcp:36:rm.0 Request processed in 709us (854us total) trans 30064771128 rc 0/0 00000100:00100000:3.0:1788572597.901072:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1412 00000100:00100000:1.0:1788572597.902102:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.902144:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569605888 00000100:00100000:0.0:1788572597.902150:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569605888 00000100:00100000:0.0:1788572597.902182:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1413 00000100:00100000:0.0:1788572597.902189:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+103:166688:x1875444569605888:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572597.902237:0:198183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572597.902252:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcec00/0x265cfe11109bffbd lrc: 0/0,0 mode: --/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6bc expref: 103 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902263:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x34:0x0].0x0 (ffff8e590b3b4a00) 00010000:00010000:0.0:1788572597.902269:0:198183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572597.902279:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902286:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902295:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902301:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902305:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902309:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902353:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 3/0,1 mode: --/EX res: [0x240002729:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902361:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902367:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572597.902525:0:198183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].7, 64 off8640 00010000:00010000:0.0:1788572597.902557:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902564:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902568:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902573:0:198183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902580:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902585:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902616:0:198183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572597.902629:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902636:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902642:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.902644:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572597.902652:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.902654:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902657:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.902671:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ba00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572597.902674:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.902676:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.902692:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902693:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x34:0x0].0x0 (ffff8e5a02ffb500) 00010000:00010000:0.0:1788572597.902699:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572597.902705:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 2/0,0 mode: --/EX res: [0x240002729:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.902709:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x34:0x0].0x0 (ffff8e5a02ffb500) 00010000:00010000:0.0:1788572597.902713:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c02bf lrc: 0/0,0 mode: --/EX res: [0x240002729:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.902714:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572597.902719:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.902737:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c02c6 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902746:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902754:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902757:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902760:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.902763:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.902766:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572597.902767:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.902770:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.902773:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572597.902779:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:0.0:1788572597.902783:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.902787:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902792:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117fe00/0x265cfe11109c02b1 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.902802:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2053f27 reply state 00000000f852f618 transno 30064771129 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902812:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.902818:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xd0b639f4 (ffff8e590b3b4b00) 00010000:00010000:0.0:1788572597.902821:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.902824:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572597.902872:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+104:166688:x1875444569605888:12345-192.168.202.57@tcp:36:rm.0 Request processed in 682us (773us total) trans 30064771129 rc 0/0 00000100:00100000:0.0:1788572597.902879:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1413 00000100:00100000:2.0:1788572597.904089:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.904170:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569606144 00000100:00100000:3.0:1788572597.904176:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569606144 00000100:00100000:3.0:1788572597.904236:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1414 00000100:00100000:3.0:1788572597.904248:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+104:166688:x1875444569606144:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.904286:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572597.904302:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce600/0x265cfe11109bffe0 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6c3 expref: 104 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904315:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x35:0x0].0x0 (ffff8e590b3b4e00) 00010000:00010000:3.0:1788572597.904323:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.904337:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904347:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904359:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904371:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904379:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904386:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904440:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 3/0,1 mode: --/EX res: [0x240002729:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904448:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904455:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.904627:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].6, 64 off8576 00010000:00010000:3.0:1788572597.904664:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904672:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904679:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904687:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904693:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904700:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904721:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.904733:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.904741:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572597.904741:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.904751:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904752:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.904768:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.904769:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.904775:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904776:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904788:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.904795:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904800:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x35:0x0].0x0 (ffff8e590b3b4700) 00010000:00010000:3.0:1788572597.904805:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.904809:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 2/0,0 mode: --/EX res: [0x240002729:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.904814:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x35:0x0].0x0 (ffff8e590b3b4700) 00010000:00010000:3.0:1788572597.904817:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c02db lrc: 0/0,0 mode: --/EX res: [0x240002729:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.904819:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572597.904825:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.904841:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c02e2 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904850:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.904855:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572597.904858:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.904859:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.904860:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.904869:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904875:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904880:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.904883:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904890:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904898:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.904900:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.904903:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904909:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c02cd lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.904920:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003318a8fe reply state 00000000960bbf43 transno 30064771130 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904929:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.904935:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xfdd9083c (ffff8e590b3b4200) 00010000:00010000:3.0:1788572597.904937:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.904940:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.904990:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+105:166688:x1875444569606144:12345-192.168.202.57@tcp:36:rm.0 Request processed in 745us (903us total) trans 30064771130 rc 0/0 00000100:00100000:3.0:1788572597.904997:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1414 00000100:00100000:1.0:1788572597.906103:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.906145:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569606400 00000100:00100000:2.0:1788572597.906151:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569606400 00000100:00100000:2.0:1788572597.906196:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1415 00000100:00100000:2.0:1788572597.906205:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+105:166688:x1875444569606400:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572597.906239:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572597.906265:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fa00/0x265cfe11109c0026 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6d1 expref: 105 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906280:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x37:0x0].0x0 (ffff8e5a03b22700) 00010000:00010000:2.0:1788572597.906289:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572597.906302:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906311:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906319:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906330:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906336:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906343:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906393:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906400:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906404:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572597.906584:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].7, 64 off8640 00010000:00010000:2.0:1788572597.906626:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 3/0,1 mode: --/PW res: [0x240002729:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906639:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906650:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906656:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906662:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906668:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906687:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572597.906700:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906705:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906716:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.906720:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.906722:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.906730:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906737:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.906738:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906753:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x37:0x0].0x0 (ffff8e590d91ee00) 00010000:00010000:2.0:1788572597.906757:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.906760:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572597.906761:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.906768:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906769:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c02f7 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.906789:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906795:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.906801:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x37:0x0].0x0 (ffff8e590d91ee00) 00010000:00010000:2.0:1788572597.906804:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.906806:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572597.906812:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 1/0,0 mode: --/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906815:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906830:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.906832:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c02fe lrc: 0/0,0 mode: --/PW res: [0x240002729:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906833:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906854:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906862:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:2.0:1788572597.906863:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.906865:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.906866:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.906870:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.906872:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c02e9 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.906874:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788572597.906882:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b9c9981 reply state 00000000b0fd368b transno 30064771131 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906888:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.906892:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x3e3e6f26 (ffff8e5a03b22400) 00010000:00010000:2.0:1788572597.906894:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572597.906895:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572597.906937:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+106:166688:x1875444569606400:12345-192.168.202.57@tcp:36:rm.0 Request processed in 735us (838us total) trans 30064771131 rc 0/0 00000100:00100000:2.0:1788572597.906942:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1415 00000100:00100000:1.0:1788572597.908291:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.908330:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569606656 00000100:00100000:3.0:1788572597.908338:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569606656 00000100:00100000:3.0:1788572597.908384:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1416 00000100:00100000:3.0:1788572597.908393:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+106:166688:x1875444569606656:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.908430:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572597.908447:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535000/0x265cfe11109c013e lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb709 expref: 106 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908461:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3f:0x0].0x0 (ffff8e590d91ed00) 00010000:00010000:3.0:1788572597.908469:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.908506:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908515:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908521:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908529:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908535:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908542:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908610:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908619:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908630:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.908781:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].8, 64 off8704 00010000:00010000:3.0:1788572597.908817:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 3/0,1 mode: --/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908824:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908828:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908832:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908836:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908840:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908854:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.908864:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908868:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.908870:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572597.908872:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.908876:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908885:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.908888:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.908890:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908895:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.908900:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908903:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3f:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:3.0:1788572597.908908:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.908911:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.908912:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908924:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c0313 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.908930:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3f:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:2.0:1788572597.908933:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572597.908935:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 1/0,0 mode: --/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908937:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.908941:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c031a lrc: 0/0,0 mode: --/PW res: [0x240002729:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908944:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908954:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908959:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908962:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.908964:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.908965:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.908968:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.908972:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.908976:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908983:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.908984:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.908986:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.908989:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c0305 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.908995:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002bb1d287 reply state 00000000adf0ce79 transno 30064771132 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.909001:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.909005:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x54b0b1f4 (ffff8e590d91e700) 00010000:00010000:3.0:1788572597.909006:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.909007:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.909046:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+107:166688:x1875444569606656:12345-192.168.202.57@tcp:36:rm.0 Request processed in 656us (761us total) trans 30064771132 rc 0/0 00000100:00100000:3.0:1788572597.909051:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1416 00000100:00100000:3.0:1788572597.910074:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.910120:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569606912 00000100:00100000:2.0:1788572597.910127:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569606912 00000100:00100000:2.0:1788572597.910165:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1417 00000100:00100000:2.0:1788572597.910174:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+107:166688:x1875444569606912:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572597.910202:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572597.910216:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a600/0x265cfe11109c00f8 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6fb expref: 107 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910230:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3d:0x0].0x0 (ffff8e5a02ffb300) 00010000:00010000:2.0:1788572597.910237:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572597.910248:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910257:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910269:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910279:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xf142140 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910286:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910292:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910351:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 3/0,1 mode: --/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910359:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910365:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572597.910509:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].9, 64 off8768 00010000:00010000:2.0:1788572597.910546:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910555:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910562:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910569:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910576:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910582:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910598:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572597.910608:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910612:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910618:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.910619:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.910628:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f4e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.910628:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910633:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910642:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.910651:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572597.910659:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3d:0x0].0x0 (ffff8e590d91eb00) 00010000:00010000:3.0:1788572597.910660:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910666:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572597.910670:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 2/0,0 mode: --/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910675:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c032f lrc: 0/0,0 mode: --/EX res: [0x240002729:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.910682:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910691:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.910695:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3d:0x0].0x0 (ffff8e590d91eb00) 00010000:00010000:2.0:1788572597.910696:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.910700:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572597.910707:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.910707:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910725:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.910725:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5800/0x265cfe11109c0336 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910741:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.910744:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.910747:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.910750:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.910753:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.910763:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910778:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:2.0:1788572597.910780:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.910784:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910790:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0321 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572597.910799:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061ff55c2 reply state 0000000007a42e31 transno 30064771133 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910808:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.910815:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xf142140 (ffff8e5a02ffba00) 00010000:00010000:2.0:1788572597.910818:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572597.910820:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572597.910861:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+108:166688:x1875444569606912:12345-192.168.202.57@tcp:36:rm.0 Request processed in 689us (803us total) trans 30064771133 rc 0/0 00000100:00100000:2.0:1788572597.910865:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1417 00000100:00100000:1.0:1788572597.911978:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.912021:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569607168 00000100:00100000:3.0:1788572597.912029:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569607168 00000100:00100000:3.0:1788572597.912085:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1418 00000100:00100000:3.0:1788572597.912096:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+108:166688:x1875444569607168:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.912128:0:196070:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572597.912140:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2000/0x265cfe11109bfec8 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb68b expref: 108 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912153:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2d:0x0].0x0 (ffff8e5a039c6400) 00010000:00010000:3.0:1788572597.912158:0:196070:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.912169:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912178:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912198:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912210:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912217:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912224:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912290:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912300:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912307:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.912465:0:196070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].10, 64 off8832 00010000:00010000:3.0:1788572597.912526:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912535:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912542:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912549:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912555:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912561:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912581:0:196070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572597.912610:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572597.912611:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.912621:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912622:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912637:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.912647:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.912648:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.912654:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912655:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912673:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.912683:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912684:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2d:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:3.0:1788572597.912690:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.912695:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 2/0,0 mode: --/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.912702:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2d:0x0].0x0 (ffff8e590b3b4c00) 00010000:00010000:3.0:1788572597.912703:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c034b lrc: 0/0,0 mode: --/EX res: [0x240002729:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.912708:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572597.912713:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.912725:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0e00/0x265cfe11109c0352 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912743:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912748:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.912752:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.912752:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.912756:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.912759:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.912761:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.912770:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.912774:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912781:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912789:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.912790:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.912793:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912799:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c033d lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.912808:0:196070:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7463f9a reply state 000000007b05a69f transno 30064771134 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912819:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.912825:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x94c295fa (ffff8e5a039c6b00) 00010000:00010000:3.0:1788572597.912828:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.912830:0:196070:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.912884:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+109:166688:x1875444569607168:12345-192.168.202.57@tcp:36:rm.0 Request processed in 791us (910us total) trans 30064771134 rc 0/0 00000100:00100000:3.0:1788572597.912889:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1418 00000100:00100000:1.0:1788572597.917095:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.917149:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569607424 00000100:00100000:0.0:1788572597.917159:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569607424 00000100:00100000:0.0:1788572597.917211:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1419 00000100:00100000:0.0:1788572597.917224:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+109:166688:x1875444569607424:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:0.0:1788572597.917276:0:198183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572597.917296:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ee00/0x265cfe11109c0003 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6ca expref: 109 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917310:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x36:0x0].0x0 (ffff8e5a03b22f00) 00010000:00010000:0.0:1788572597.917318:0:198183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572597.917333:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917342:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917350:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917357:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917361:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917365:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917428:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917435:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917442:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572597.917674:0:198183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].8, 64 off8704 00010000:00010000:0.0:1788572597.917718:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 3/0,1 mode: --/PW res: [0x240002729:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917728:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917735:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917742:0:198183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917749:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917763:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917786:0:198183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572597.917803:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917809:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917816:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917821:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.917825:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917832:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917840:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x36:0x0].0x0 (ffff8e5a02ffb000) 00010000:00010000:0.0:1788572597.917843:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572597.917847:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917853:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0367 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917872:0:198183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917879:0:198183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917883:0:198183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917887:0:198183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14a400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.917889:0:198183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917892:0:198183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917897:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:0.0:1788572597.917898:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.917900:0:198183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917905:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14a400/0x265cfe11109c0359 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572597.917915:0:198183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000092f043a reply state 000000005ae6e271 transno 30064771135 ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917926:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.917932:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x1b7026cc (ffff8e5a03b22100) 00010000:00010000:0.0:1788572597.917935:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572597.917937:0:198183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572597.917992:0:10395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572597.917999:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.918002:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+110:166688:x1875444569607424:12345-192.168.202.57@tcp:36:rm.0 Request processed in 780us (914us total) trans 30064771135 rc 0/0 00010000:00010000:3.0:1788572597.918011:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce800 already unused, calling callback (ffffffffc0c114f0) 00000100:00100000:0.0:1788572597.918015:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1419 00010000:00010000:3.0:1788572597.918015:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.918024:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.918033:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x36:0x0].0x0 (ffff8e5a02ffb000) 00010000:00010000:3.0:1788572597.918035:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572597.918037:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 1/0,0 mode: --/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.918042:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce800/0x265cfe11109c036e lrc: 0/0,0 mode: --/PW res: [0x240002729:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.918052:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.918054:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.918065:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572597.919104:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.919144:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569607680 00000100:00100000:3.0:1788572597.919151:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569607680 00000100:00100000:3.0:1788572597.919194:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1420 00000100:00100000:3.0:1788572597.919210:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+110:166688:x1875444569607680:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.919248:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572597.919264:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfc00/0x265cfe11109c008f lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6e6 expref: 110 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919277:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3a:0x0].0x0 (ffff8e590b3b4100) 00010000:00010000:3.0:1788572597.919286:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.919299:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919309:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919317:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919327:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919334:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919341:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919394:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919402:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919424:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.919633:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].9, 64 off8768 00010000:00010000:3.0:1788572597.919669:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 3/0,1 mode: --/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919678:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919686:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919692:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919698:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919704:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919731:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.919745:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919751:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919757:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919764:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.919766:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919771:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919776:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3a:0x0].0x0 (ffff8e590b3b4e00) 00010000:00010000:3.0:1788572597.919778:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.919780:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919784:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0400/0x265cfe11109c0383 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919794:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919797:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919801:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919804:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919807:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.919809:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919829:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919837:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.919839:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.919842:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919847:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1a00/0x265cfe11109c0375 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.919858:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000044f784e reply state 00000000afa7d1a7 transno 30064771136 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919867:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.919874:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xa6a94833 (ffff8e590b3b4300) 00010000:00010000:3.0:1788572597.919876:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.919878:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.919923:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+111:166688:x1875444569607680:12345-192.168.202.57@tcp:36:rm.0 Request processed in 720us (821us total) trans 30064771136 rc 0/0 00000100:00100000:3.0:1788572597.919931:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1420 00010000:00010000:2.0:1788572597.921542:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.921553:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.921564:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572597.921568:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.921576:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.921589:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x3a:0x0].0x0 (ffff8e590b3b4e00) 00010000:00010000:2.0:1788572597.921592:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572597.921596:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 1/0,0 mode: --/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.921602:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0000/0x265cfe11109c038a lrc: 0/0,0 mode: --/PW res: [0x240002729:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.921619:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.921621:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.921622:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572597.921817:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.921882:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569607936 00000100:00100000:2.0:1788572597.921889:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569607936 00000100:00100000:2.0:1788572597.921936:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1421 00000100:00100000:2.0:1788572597.921947:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+111:166688:x1875444569607936:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572597.921992:0:188049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572597.922008:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ec00/0x265cfe11109bff54 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6a7 expref: 111 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922020:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x31:0x0].0x0 (ffff8e5a0a4b7600) 00010000:00010000:2.0:1788572597.922027:0:188049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572597.922043:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922067:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922078:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922089:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922096:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922102:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922166:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 3/0,1 mode: --/EX res: [0x240002729:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922175:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922183:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572597.922363:0:188049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].11, 64 off8896 00010000:00010000:2.0:1788572597.922403:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922412:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922419:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922426:0:188049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922432:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922438:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922458:0:188049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572597.922473:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.922509:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.922513:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.922518:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922522:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.922533:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f4600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.922540:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922543:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.922549:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.922555:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922558:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.922577:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x31:0x0].0x0 (ffff8e590d91e500) 00010000:00010000:3.0:1788572597.922581:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572597.922585:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922588:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x31:0x0].0x0 (ffff8e590d91e500) 00010000:00010000:2.0:1788572597.922595:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.922595:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4600/0x265cfe11109c03a6 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922601:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 2/0,0 mode: --/EX res: [0x240002729:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922611:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5600/0x265cfe11109c039f lrc: 0/0,0 mode: --/EX res: [0x240002729:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.922613:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.922627:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.922632:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.922632:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.922640:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 2/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922645:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922651:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f4e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.922654:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922659:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922670:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:2.0:1788572597.922673:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.922676:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 2/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922681:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4e00/0x265cfe11109c0391 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572597.922690:0:188049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fc364cd reply state 000000005f67fc2b transno 30064771137 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922699:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.922705:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x494dcf1b (ffff8e5a0a4b7800) 00010000:00010000:2.0:1788572597.922708:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572597.922710:0:188049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572597.922778:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+112:166688:x1875444569607936:12345-192.168.202.57@tcp:36:rm.0 Request processed in 833us (961us total) trans 30064771137 rc 0/0 00000100:00100000:2.0:1788572597.922786:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1421 00000100:00100000:1.0:1788572597.924390:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.924437:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569608192 00000100:00100000:3.0:1788572597.924444:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569608192 00000100:00100000:3.0:1788572597.924520:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1422 00000100:00100000:3.0:1788572597.924532:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+112:166688:x1875444569608192:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.924571:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572597.924586:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164fc00/0x265cfe11109c0049 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6d8 expref: 112 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924597:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x38:0x0].0x0 (ffff8e5903395600) 00010000:00010000:3.0:1788572597.924603:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.924615:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924623:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924632:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924638:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924642:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924646:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924701:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 3/0,1 mode: --/EX res: [0x240002729:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924709:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924715:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572597.924872:0:188050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].10, 64 off8832 00010000:00010000:3.0:1788572597.924901:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924908:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924912:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924917:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924924:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924930:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924952:0:188050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572597.924966:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924972:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924979:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.924981:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572597.924989:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.924991:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.924993:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.925005:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572597.925008:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.925011:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.925017:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x38:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:3.0:1788572597.925020:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.925023:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 2/0,0 mode: --/EX res: [0x240002729:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.925028:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.925028:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1200/0x265cfe11109c03bb lrc: 0/0,0 mode: --/EX res: [0x240002729:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.925077:0:82817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x38:0x0].0x0 (ffff8e590b3b4f00) 00010000:00010000:3.0:1788572597.925079:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.925081:0:82817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572597.925086:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 1/0,0 mode: --/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.925089:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.925099:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0a00/0x265cfe11109c03c2 lrc: 0/0,0 mode: --/PW res: [0x240002729:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.925102:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.925113:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.925119:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.925119:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.925122:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.925123:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.925127:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572597.925134:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.925143:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.925146:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.925149:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.925154:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0600/0x265cfe11109c03ad lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.925163:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047b4c990 reply state 000000003add51f5 transno 30064771138 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.925172:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.925179:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x610cb780 (ffff8e5903395800) 00010000:00010000:3.0:1788572597.925181:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.925183:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.925252:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+113:166688:x1875444569608192:12345-192.168.202.57@tcp:36:rm.0 Request processed in 722us (865us total) trans 30064771138 rc 0/0 00000100:00100000:3.0:1788572597.925259:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1422 00000100:00100000:3.0:1788572597.926441:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.926511:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569608448 00000100:00100000:2.0:1788572597.926518:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569608448 00000100:00100000:2.0:1788572597.926578:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1423 00000100:00100000:2.0:1788572597.926589:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+113:166688:x1875444569608448:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:2.0:1788572597.926633:0:188048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572597.926649:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f000/0x265cfe11109bff77 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb6ae expref: 113 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.926664:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x32:0x0].0x0 (ffff8e5a0a4b7100) 00010000:00010000:2.0:1788572597.926684:0:188048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572597.926699:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.926711:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.926720:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 3/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.926740:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 3/0,1 mode: --/PW res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.926747:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.926754:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.926809:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.926818:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.926825:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572597.926979:0:188048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].11, 64 off8896 00010000:00010000:2.0:1788572597.927029:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 3/0,1 mode: --/PW res: [0x240002729:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927038:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927046:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927053:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927071:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 4/0,1 mode: PW/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927078:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927095:0:188048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572597.927107:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927114:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927121:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927128:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.927131:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.927133:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.927139:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927143:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.927156:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572597.927161:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x32:0x0].0x0 (ffff8e590d91e600) 00010000:00010000:2.0:1788572597.927165:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572597.927171:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 2/0,0 mode: PW/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927171:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927191:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5400/0x265cfe11109c03d7 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.927193:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 3/0,0 mode: PW/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.927211:0:10396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x32:0x0].0x0 (ffff8e590d91e600) 00010000:00010000:2.0:1788572597.927213:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927225:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 4/0,1 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927231:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 3/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927238:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927243:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f4400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.927246:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 4/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927253:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 5/0,0 mode: CW/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927260:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:2.0:1788572597.927263:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.927266:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 3/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927272:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4400/0x265cfe11109c03c9 lrc: 0/0,0 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.927280:0:10396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000004:00010000:2.0:1788572597.927281:0:188048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f4c3ab2 reply state 00000000edfbd6c4 transno 30064771139 ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 3/0,1 mode: PW/PW res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.927287:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 1/0,0 mode: --/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927295:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.927298:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5000/0x265cfe11109c03de lrc: 0/0,0 mode: --/PW res: [0x240002729:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.927309:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x76709d63 (ffff8e5a0a4b7b00) 00010000:00010000:2.0:1788572597.927313:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572597.927316:0:188048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572597.927322:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572597.927325:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572597.927327:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572597.927367:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+114:166688:x1875444569608448:12345-192.168.202.57@tcp:36:rm.0 Request processed in 780us (929us total) trans 30064771139 rc 0/0 00000100:00100000:2.0:1788572597.927375:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1423 00000100:00100000:1.0:1788572597.928765:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.928814:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569608576 00000100:00100000:3.0:1788572597.928821:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569608576 00000100:00100000:3.0:1788572597.928867:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1424 00000100:00100000:3.0:1788572597.928877:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:166688:x1875444569608576:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:3.0:1788572597.928893:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.928908:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109c03e5 lrc: 2/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb73a expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.928957:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 3/1,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.928968:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.928978:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 3/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.928991:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.928999:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929009:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929053:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109c03fa lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929075:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109c03fa lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929082:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109c03fa lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.929099:0:196070:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109c03fa lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929110:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 4/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929116:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 4/1,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929123:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 3/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929129:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929134:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.929138:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 4/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929145:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 5/0,0 mode: CR/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929155:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:3.0:1788572597.929158:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.929162:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 3/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929168:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0400/0x265cfe11109c03ec lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929179:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929185:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929202:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929207:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.929211:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929216:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929224:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0xf7117594 (ffff8e590b3b4100) 00010000:00010000:3.0:1788572597.929227:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.929229:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 2/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929235:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0e00/0x265cfe11109c03f3 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929276:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe1a00/0x265cfe11109c03e5 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb73a expref: 15 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929290:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109c03fa lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb73a expref: 14 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.929297:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7c00) 00010000:00010000:3.0:1788572597.929299:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572597.929302:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5905fe0000, rc 0) 00000100:00100000:3.0:1788572597.929346:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:166688:x1875444569608576:12345-192.168.202.57@tcp:101:rm.0 Request processed in 470us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.929353:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1424 00000100:00100000:1.0:1788572597.930275:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.930311:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.930324:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569608704 00000100:00100000:0.0:1788572597.930332:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569608704 00000100:00100000:2.0:1788572597.930346:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569608832 00000100:00100000:2.0:1788572597.930351:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569608832 00000100:00100000:0.0:1788572597.930369:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1425 00000100:00100000:0.0:1788572597.930377:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+114:166688:x1875444569608704:12345-192.168.202.57@tcp:101:rm.0 00000100:00100000:2.0:1788572597.930390:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4692 00010000:00010000:0.0:1788572597.930392:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788572597.930400:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:2399:x1875444569608832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572597.930406:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0401 lrc: 2/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb741 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.930409:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572597.930424:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5905fe0000/0x265cfe11109c03fa lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb73a expref: 14 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.930434:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7c00) 00010000:00010000:2.0:1788572597.930437:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572597.930449:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c0408 lrc: 3/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.930461:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c0408 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572597.930467:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:2399:x1875444569608832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 70us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572597.930474:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4692 00010000:00010000:0.0:1788572597.930475:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c0408 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572597.930547:0:198183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x2b:0x0]: returning size 4096 00000004:00200000:0.0:1788572597.930551:0:198183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788572597.930576:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0401 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb741 expref: 116 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.930591:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c0408 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb741 expref: 115 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.930598:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:0.0:1788572597.930600:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788572597.930616:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf600, rc 0) 00000100:00100000:0.0:1788572597.930649:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:166688:x1875444569608704:12345-192.168.202.57@tcp:101:rm.0 Request processed in 272us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572597.930655:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1425 00000100:00100000:3.0:1788572597.933957:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572597.934009:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569608960 00000100:00100000:0.0:1788572597.934016:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569608960 00000100:00100000:0.0:1788572597.934081:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4693 00000100:00100000:0.0:1788572597.934091:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:2398:x1875444569608960:12345-192.168.202.57@tcp:103:rm.0 00010000:00010000:0.0:1788572597.934105:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572597.934125:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109bfe6d lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb676 expref: 13 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.934141:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a0a4b7c00) 00010000:00010000:0.0:1788572597.934150:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572597.934197:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2398:x1875444569608960:12345-192.168.202.57@tcp:103:rm.0 Request processed in 107us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572597.934205:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4693 00000100:00100000:2.0:1788572597.934355:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572597.934387:0:188051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569609216 00000100:00100000:1.0:1788572597.934391:0:188051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569609216 00000100:00100000:1.0:1788572597.934417:0:188051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 91 00000100:00100000:1.0:1788572597.934422:0:188051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:166688:x1875444569609216:12345-192.168.202.57@tcp:35:rm.0 00000100:00100000:1.0:1788572597.934657:0:188051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+116:166688:x1875444569609216:12345-192.168.202.57@tcp:35:rm.0 Request processed in 233us (302us total) trans 30064771140 rc 0/0 00000100:00100000:1.0:1788572597.934664:0:188051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 91 00000100:00100000:1.0:1788572597.935382:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.935404:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569609472 00000100:00100000:3.0:1788572597.935409:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569609472 00000100:00100000:3.0:1788572597.935447:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1426 00000100:00100000:3.0:1788572597.935456:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+116:166688:x1875444569609472:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.935521:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788572597.935542:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c0408 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb741 expref: 116 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.935561:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd3000/0x265cfe11109c01a7 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb733 expref: 115 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.935572:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.935580:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.935623:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 3/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.935632:0:188833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 3/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.935642:0:188833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 3/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572597.935662:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516224:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1788572597.935701:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572597.935730:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5901082840 going to sleep for 11 seconds 00000100:00100000:0.0:1788572597.935739:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584516224 00000100:00100000:0.0:1788572597.935745:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584516224 00000100:00100000:0.0:1788572597.935783:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1788572597.935792:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188833:x1875444584516224:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788572597.935802:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572597.935816:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcec00/0x265cfe11109c0416 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109c040f expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.935838:0:188053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb66f expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.935848:0:188053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcec00/0x265cfe11109c0416 lrc: 4/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109c040f expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.935871:0:188053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb66f expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.935887:0:188053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb66f expref: 11 pid: 188048 timeout: 9450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.935898:0:188053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:188053:1875444584516352:192.168.202.57@tcp:104: 00000100:00100000:0.0:1788572597.935948:0:188053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31f1f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572597.937701:0:188053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:188053:1875444584516352:192.168.202.57@tcp:104: 00010000:00010000:0.0:1788572597.937731:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcec00/0x265cfe11109c0416 lrc: 3/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c040f expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.937742:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:0.0:1788572597.937745:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.937749:0:188053:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcec00/0x265cfe11109c0416 lrc: 3/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c040f expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.937771:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcec00, rc 0) 00000100:00100000:0.0:1788572597.937817:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:188833:x1875444584516224:12345-0@lo:101:mdt00_003.0 Request processed in 2026us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572597.937826:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1788572597.937866:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516224:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1788572597.937884:0:188833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 4/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572597.937923:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1788572597.937933:0:188833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 4/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572597.937966:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569609600 00000100:00100000:2.0:1788572597.937971:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569609600 00010000:00010000:2.0:1788572597.937999:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb66f expref: 12 pid: 188048 timeout: 9450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572597.938021:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12917 00000100:00100000:2.0:1788572597.938027:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a11061c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:2397:x1875444569609600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572597.938037:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572597.938041:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb66f expref: 12 pid: 188048 timeout: 9450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.938051:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb66f expref: 12 pid: 188048 timeout: 9450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.938082:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a24534800/0x265cfe11109bfe51 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb66f expref: 12 pid: 188048 timeout: 9450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.938094:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:2.0:1788572597.938097:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcec00/0x265cfe11109c0416 lrc: 2/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c040f expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.938106:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcec00/0x265cfe11109c0416 lrc: 2/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109c040f expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.938114:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcec00/0x265cfe11109c0416 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109c040f expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.938139:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcec00/0x265cfe11109c0416 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c040f expref: 6 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572597.938150:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6502:1875444584516480:0@lo:105: 00000100:00100000:2.0:1788572597.938176:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572597.938216:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590bba0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572597.938219:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584516480 00000100:00100000:1.0:1788572597.938226:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584516480 00000100:00100000:1.0:1788572597.938275:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5408 00000100:00100000:1.0:1788572597.938284:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6502:x1875444584516480:12345-0@lo:105: 00010000:00010000:1.0:1788572597.938294:0:6501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 5/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.938303:0:6501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 5/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.938311:0:6501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 5/0,1 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.938319:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 5/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.938326:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 6/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.938334:0:6501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 6/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.938356:0:6501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a4117ec00) 00010000:00010000:0.0:1788572597.938380:0:188833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.938392:0:188833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572597.938398:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6502:x1875444584516480:12345-0@lo:105: Request processed in 113us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572597.938409:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5408 00000004:00080000:0.0:1788572597.938417:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x7:0x0] 00000100:00100000:2.0:1788572597.938417:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6502:1875444584516480:0@lo:105: 00010000:00010000:2.0:1788572597.938435:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572597.938450:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 3/0,1 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.938460:0:188833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 3/0,1 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.938469:0:188833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 3/0,1 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572597.938500:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a11061c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:2397:x1875444569609600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 449us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572597.938508:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516608:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1788572597.938516:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12917 00000100:00100000:0.0:1788572597.938547:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.938573:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31f1f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572597.938577:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584516608 00000100:00100000:3.0:1788572597.938588:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584516608 00000100:00100000:3.0:1788572597.938625:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1788572597.938633:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:188833:x1875444584516608:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1788572597.938828:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.938844:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117ee00/0x265cfe11109c0424 lrc: 2/0,0 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109c041d expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.938862:0:189111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117ee00/0x265cfe11109c0424 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109c041d expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.938874:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117ee00/0x265cfe11109c0424 lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c041d expref: 8 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.938878:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0xf7117594 (ffff8e590b3b4700) 00010000:00010000:3.0:1788572597.938880:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.938882:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117ee00, rc 0) 00000100:00100000:3.0:1788572597.938917:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584516608:12345-0@lo:101:mdt00_003.0 Request processed in 286us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.938921:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1788572597.938954:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516608:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788572597.938966:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109c0424 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.938975:0:188833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0424 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572597.938987:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x7:0x0] 00000100:00100000:0.0:1788572597.939015:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572597.939040:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.939072:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31f1f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572597.939081:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584516736 00000100:00100000:3.0:1788572597.939086:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584516736 00000100:00100000:3.0:1788572597.939121:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1788572597.939128:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a40523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584516736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788572597.939180:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a40523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584516736:12345-0@lo:1000:mdt00_003.0 Request processed in 53us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.939185:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1788572597.939227:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572597.939272:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572597.939294:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.939312:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fd620c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572597.939325:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584516864 00000100:00100000:3.0:1788572597.939330:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584516864 00000100:00100000:3.0:1788572597.939357:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1788572597.939361:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584516864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788572597.939420:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584516864:12345-0@lo:1000:mdt00_003.0 Request processed in 58us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.939424:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1788572597.939446:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572597.939496:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516992:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572597.939519:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.939538:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31f1f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572597.939568:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584516992 00000100:00100000:1.0:1788572597.939573:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584516992 00000100:00100000:1.0:1788572597.939602:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1788572597.939611:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584516992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788572597.939694:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584516992:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (173us total) trans 0 rc 1/1 00000100:00100000:1.0:1788572597.939703:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1788572597.939716:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584516992:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788572597.939755:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.939763:0:188833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.939770:0:188833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.939782:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584517120:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1788572597.939803:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.939821:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fd62840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572597.939835:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584517120 00000100:00100000:3.0:1788572597.939841:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584517120 00000100:00100000:3.0:1788572597.939863:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1788572597.939868:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:188833:x1875444584517120:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1788572597.939875:0:189111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572597.939883:0:189111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0432 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109c042b expref: -99 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.939894:0:189111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0432 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109c042b expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.939900:0:189111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0432 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c042b expref: 9 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.939906:0:189111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4a00) 00010000:00010000:3.0:1788572597.939907:0:189111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572597.939909:0:189111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117fe00, rc 0) 00000100:00100000:3.0:1788572597.939934:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:188833:x1875444584517120:12345-0@lo:101:mdt00_003.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572597.939940:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1788572597.939949:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584517120:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788572597.939962:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.939971:0:188833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.939992:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 3/0,1 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.940000:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.940012:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.940172:0:188833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584517248:0@lo:700:mdt00_003.0 00000100:00100000:0.0:1788572597.940199:0:188833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572597.940223:0:188833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a31f1f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572597.940250:0:188057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584517248 00000100:00100000:2.0:1788572597.940256:0:188057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584517248 00000100:00100000:2.0:1788572597.940284:0:188057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788572597.940293:0:188057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+9:188833:x1875444584517248:12345-0@lo:700:mdt00_003.0 00000100:00100000:2.0:1788572597.940340:0:188057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+9:188833:x1875444584517248:12345-0@lo:700:mdt00_003.0 Request processed in 48us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572597.940347:0:188057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788572597.940352:0:188833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188833:1875444584517248:0@lo:700:mdt00_003.0 00000040:00080000:0.0:1788572597.940442:0:188833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572597.940461:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].11, 64 off33472 00000004:00080000:0.0:1788572597.940468:0:188833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a31f1f3c0 with version 4 00000004:00080000:1.0:1788572597.940515:0:202679:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5905274300 version 4 rpc_version 4 00000020:00100000:1.0:1788572597.940538:0:202679:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000040:00080000:0.0:1788572597.940544:0:188833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788572597.940547:0:202679:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5905a53800 x1875444584517504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:0.0:1788572597.940557:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].12, 64 off33536 00000004:00080000:0.0:1788572597.940564:0:188833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a0380c6c0 with version 5 00000100:00100000:1.0:1788572597.940565:0:202679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a53800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584517504:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788572597.940604:0:202679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572597.940627:0:202679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572597.940640:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584517504 00000100:00100000:3.0:1788572597.940644:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584517504 00000100:00100000:3.0:1788572597.940678:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1788572597.940688:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202679:x1875444584517504:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:0.0:1788572597.941283:0:188833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572597.941314:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].6, 64 off33152 00000040:00080000:0.0:1788572597.941576:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400036c8:0x1:0x0].1, 424 off33192 00000040:00080000:0.0:1788572597.941660:0:188833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000284a1:0x1:0x0].1, 504 off33272 00000004:00080000:0.0:1788572597.941666:0:188833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e5a1fd62840 with version 6 00000001:00080000:1.0:1788572597.942286:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318280 is committed 00000001:00080000:1.0:1788572597.942295:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318279 is committed 00000100:00100000:3.0:1788572597.942401:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202679:x1875444584517504:12345-0@lo:1000:osp_up0-1.0 Request processed in 1713us (1795us total) trans 352187318280 rc 0/0 00000100:00100000:3.0:1788572597.942419:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000004:00080000:1.0:1788572597.942434:0:202679:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318280 committed transno 352187318280 00000100:00100000:1.0:1788572597.942437:0:202679:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318280 gen 2 00000100:00100000:1.0:1788572597.942453:0:202679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a53800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584517504:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1788572597.942472:0:202679:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5905274300 version 5 rpc_version 5 00000020:00100000:1.0:1788572597.942512:0:202679:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572597.942519:0:202679:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5905a53800 x1875444584517760/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572597.942547:0:202679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a53800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584517760:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788572597.942573:0:202679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572597.942592:0:202679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572597.942599:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584517760 00000100:00100000:3.0:1788572597.942604:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584517760 00000100:00100000:3.0:1788572597.942635:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1788572597.942643:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:202679:x1875444584517760:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1788572597.950547:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318281 is committed 00000100:00100000:3.0:1788572597.950723:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:202679:x1875444584517760:12345-0@lo:1000:osp_up0-1.0 Request processed in 8076us (8144us total) trans 352187318281 rc 0/0 00000100:00100000:3.0:1788572597.950737:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000004:00080000:1.0:1788572597.950774:0:202679:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318281 committed transno 352187318281 00000100:00100000:1.0:1788572597.950780:0:202679:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318281 gen 2 00000100:00100000:1.0:1788572597.950799:0:202679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a53800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584517760:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1788572597.950824:0:202679:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5905274300 version 6 rpc_version 6 00000020:00100000:1.0:1788572597.950856:0:202679:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572597.950864:0:202679:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5905a53800 x1875444584518016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572597.950884:0:202679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a53800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584518016:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788572597.950928:0:202679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572597.950957:0:202679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5906681a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572597.950976:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584518016 00000100:00100000:3.0:1788572597.950984:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584518016 00000100:00100000:3.0:1788572597.951026:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1788572597.951035:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202679:x1875444584518016:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788572597.951822:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202679:x1875444584518016:12345-0@lo:1000:osp_up0-1.0 Request processed in 786us (893us total) trans 352187318282 rc 0/0 00000100:00100000:3.0:1788572597.951831:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1788572597.951875:0:202679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a53800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584518016:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1788572597.951925:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002729:0x2b:0x0]: returning size 4096 00010000:00010000:0.0:1788572597.951947:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 3/0,1 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.951957:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.951965:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.951971:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcee00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572597.951975:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.951983:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 4/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.951997:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e5a02ffb600) 00010000:00010000:0.0:1788572597.952000:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572597.952005:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 2/0,0 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952011:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c0439 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952029:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952037:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 4/0,1 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952043:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952078:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572597.952090:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x7:0x0] 00010000:00010000:0.0:1788572597.952097:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952104:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 4/0,1 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952116:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952134:0:188833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1788572597.952138:0:188833:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x7:0x0] 00010000:00010000:0.0:1788572597.952142:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 4/0,1 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109c0424 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952150:0:188833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109c0424 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.952156:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572597.952163:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 2/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.952169:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce800 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572597.952173:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572597.952180:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 3/0,0 mode: EX/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.952206:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 2/0,0 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.952212:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572597.952248:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 1/0,0 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.952254:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:166688:x1875444569609472:12345-192.168.202.57@tcp:36:rm.0 Request processed in 16786us (16859us total) trans 30064771141 rc 0/0 00010000:00010000:2.0:1788572597.952261:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffce800/0x265cfe11109c042b lrc: 0/0,0 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109c0432 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572597.952268:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1426 00010000:00010000:2.0:1788572597.952290:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572597.952293:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 2/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.952298:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ec00 already unused, calling callback (ffffffffc1816ee0) 00010000:00010000:2.0:1788572597.952301:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572597.952305:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 3/0,0 mode: CW/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.952318:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 2/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.952321:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572597.952326:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 1/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.952331:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a4117ec00/0x265cfe11109c040f lrc: 0/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109c0416 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.952341:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.952343:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572597.952344:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572597.952347:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584518144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572597.952356:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584518272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572597.952399:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572597.952455:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572597.952504:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584518144 00000100:00100000:1.0:1788572597.952510:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584518144 00000100:00100000:1.0:1788572597.952545:0:43930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584518272 00000100:00100000:1.0:1788572597.952549:0:43930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584518272 00000100:00100000:1.0:1788572597.952574:0:43930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4694 00000100:00100000:1.0:1788572597.952582:0:43930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3641:x1875444584518144:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572597.952587:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4695 00010000:00010000:1.0:1788572597.952595:0:43930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788572597.952600:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3642:x1875444584518272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572597.952611:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572597.952612:0:43930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fe00/0x265cfe11109c0432 lrc: 0/0,0 mode: --/EX res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109c042b expref: 11 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572597.952626:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcec00/0x265cfe11109c0416 lrc: 0/0,0 mode: --/CW res: [0x200027501:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109c040f expref: 10 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572597.952628:0:43930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x0 (ffff8e590b3b4a00) 00010000:00010000:0.0:1788572597.952642:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:0.0:1788572597.952647:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572597.952653:0:43930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572597.952691:0:43930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3641:x1875444584518144:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572597.952698:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3642:x1875444584518272:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572597.952701:0:43930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4694 00000100:00100000:0.0:1788572597.952712:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4695 00000100:00100000:2.0:1788572597.952724:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584518272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572597.952749:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584518144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572597.952902:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572597.953978:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.954027:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569609728 00000100:00100000:2.0:1788572597.954033:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569609728 00000100:00100000:2.0:1788572597.954081:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1427 00000100:00100000:2.0:1788572597.954091:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:166688:x1875444569609728:12345-192.168.202.57@tcp:101:rm.0 00010000:00010000:2.0:1788572597.954105:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572597.954119:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4400/0x265cfe11109c0440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb748 expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954176:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954191:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954202:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954426:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954436:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954443:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954557:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c0455 lrc: 3/1,0 mode: --/PR res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954565:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c0455 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954576:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c0455 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572597.954611:0:188049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1788572597.954622:0:188049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572597.954640:0:188049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c0455 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954651:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954667:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954674:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954679:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.954683:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954691:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954700:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:2.0:1788572597.954703:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.954706:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954712:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5400/0x265cfe11109c0447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954740:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954746:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954752:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954757:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572597.954759:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954766:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954773:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e590d91e500) 00010000:00010000:2.0:1788572597.954775:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572597.954778:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954784:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c044e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954812:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4400/0x265cfe11109c0440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb748 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954825:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c0455 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb748 expref: 9 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572597.954837:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:2.0:1788572597.954839:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572597.954841:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a245f4200, rc 0) 00000100:00100000:2.0:1788572597.954893:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:166688:x1875444569609728:12345-192.168.202.57@tcp:101:rm.0 Request processed in 804us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572597.954899:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1427 00000100:00100000:3.0:1788572597.956188:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572597.956236:0:188052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569609984 00000100:00100000:2.0:1788572597.956242:0:188052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569609984 00000100:00100000:2.0:1788572597.956283:0:188052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 92 00000100:00100000:2.0:1788572597.956290:0:188052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:166688:x1875444569609984:12345-192.168.202.57@tcp:35:rm.0 00000100:00100000:2.0:1788572597.956440:0:188052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:166688:x1875444569609984:12345-192.168.202.57@tcp:35:rm.0 Request processed in 150us (257us total) trans 352187318283 rc 0/0 00000100:00100000:2.0:1788572597.956445:0:188052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 92 00000100:00100000:1.0:1788572597.957436:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572597.957522:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569610240 00000100:00100000:3.0:1788572597.957528:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569610240 00000100:00100000:3.0:1788572597.957577:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1428 00000100:00100000:3.0:1788572597.957597:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:166688:x1875444569610240:12345-192.168.202.57@tcp:36:rm.0 00010000:00010000:3.0:1788572597.957631:0:188050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788572597.957673:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c0455 lrc: 0/0,0 mode: --/PR res: [0x200027501:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb748 expref: 10 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957695:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e590d14aa00/0x265cfe11109c0184 lrc: 0/0,0 mode: --/CR res: [0x200027501:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb725 expref: 9 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957709:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590d91ef00) 00010000:00010000:3.0:1788572597.957723:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a40dcf600/0x265cfe11109bfbb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb661 expref: 8 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957738:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:3.0:1788572597.957742:0:188050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572597.957763:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957785:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957795:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957823:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957832:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957837:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957920:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 3/0,1 mode: --/EX res: [0x200027501:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957928:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.957934:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572597.958151:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1788572597.958162:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 3/0,1 mode: EX/EX res: [0x200027501:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958168:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 2/0,0 mode: EX/EX res: [0x200027501:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958172:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958176:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.958178:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 3/0,0 mode: EX/EX res: [0x200027501:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958188:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 4/0,0 mode: EX/EX res: [0x200027501:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958194:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0x0 (ffff8e590b3b4100) 00010000:00010000:3.0:1788572597.958196:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572597.958198:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 2/0,0 mode: --/EX res: [0x200027501:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958202:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c046a lrc: 0/0,0 mode: --/EX res: [0x200027501:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958217:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958222:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958228:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958234:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958239:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572597.958242:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958248:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958256:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:3.0:1788572597.958258:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572597.958261:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958267:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c045c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572597.958277:0:188050:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002504275f reply state 00000000a69dd17c transno 352187318284 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958287:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572597.958293:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572597.958295:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572597.958297:0:188050:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572597.958353:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:166688:x1875444569610240:12345-192.168.202.57@tcp:36:rm.0 Request processed in 768us (917us total) trans 352187318284 rc 0/0 00000100:00100000:3.0:1788572597.958359:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1428 00010000:00010000:3.0:1788572598.908650:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572599.676604:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584518400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572599.676672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572599.676713:0:9987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584518400 00000100:00100000:3.0:1788572599.676723:0:9987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584518400 00000100:00080000:1.0:1788572599.676779:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572599.676793:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6511 00000100:00100000:3.0:1788572599.676804:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584518400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572599.676846:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572599.676917:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875444584518400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572599.676925:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6511 00000100:00100000:3.0:1788572599.676965:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584518528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572599.676968:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875444584518400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572599.677010:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572599.677058:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584518528 00000100:00100000:0.0:1788572599.677063:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584518528 00000100:00100000:0.0:1788572599.677097:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6512 00000100:00100000:0.0:1788572599.677105:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584518528:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788572599.677112:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788572599.677123:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572599.677174:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584518528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572599.677182:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6512 00000100:00100000:2.0:1788572599.677234:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584518528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572599.932661:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572600.188641:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584518656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572600.188717:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.188768:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584518656 00000100:00100000:2.0:1788572600.188772:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572600.188777:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584518656 00000100:00100000:2.0:1788572600.188779:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fdc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584518784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572600.188814:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.188826:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584518784 00000100:00100000:3.0:1788572600.188830:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584518784 00000100:00100000:3.0:1788572600.188852:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1788572600.188864:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584518656:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572600.188865:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1788572600.188890:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584518784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572600.188902:0:189111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445941248 avail 1299701760 00000004:00000024:0.0:1788572600.188918:0:188053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445548032 avail 1299308544 00000100:00100000:3.0:1788572600.188960:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875444584518656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572600.188981:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3641:x1875444584518784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572600.188983:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1788572600.188994:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1788572600.189042:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fdc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584518784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572600.189054:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875444584518656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572600.189614:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584519040:0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.189623:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1fbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584518912:0@lo:400:kworker.0 00000100:00100000:0.0:1788572600.189658:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.189672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572600.189699:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584519552:0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.189711:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584519296:0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.189720:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584519424:0@lo:400:kworker.0 00000100:00100000:1.0:1788572600.189724:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584519040 00000100:00100000:1.0:1788572600.189731:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584519040 00000100:00100000:0.0:1788572600.189735:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572600.189755:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572600.189765:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584520064:0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.189768:0:201330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584518912 00000100:00100000:3.0:1788572600.189773:0:201330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584518912 00000100:00100000:1.0:1788572600.189785:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584519296 00000100:00100000:1.0:1788572600.189791:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584519296 00000100:00100000:0.0:1788572600.189808:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572600.189809:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584519808:0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.189814:0:201330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788572600.189825:0:201330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584518912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572600.189832:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1788572600.189844:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584519040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.189850:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.189873:0:201330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e87131b0-4a60-4def-a26d-6e23dcfe5daa+24:3643:x1875444584518912:12345-0@lo:400:kworker.0 Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572600.189881:0:201330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788572600.189890:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788572600.189899:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584519168:0@lo:400:kworker.0 00000100:00100000:1.0:1788572600.189912:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875444584519040:12345-0@lo:400:kworker.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572600.189917:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584519552 00000100:00100000:1.0:1788572600.189922:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1788572600.189923:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584519552 00000100:00100000:2.0:1788572600.189929:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572600.189940:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584519808 00000100:00100000:1.0:1788572600.189946:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584519808 00000100:00100000:2.0:1788572600.189954:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584519680:0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.189959:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584520064 00000100:00100000:3.0:1788572600.189963:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584520064 00000100:00100000:1.0:1788572600.189982:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584519168 00000100:00100000:1.0:1788572600.189987:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584519168 00000100:00100000:2.0:1788572600.189995:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.190010:0:177557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584519680 00000100:00100000:3.0:1788572600.190016:0:177557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584519680 00000100:00100000:1.0:1788572600.190020:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1788572600.190024:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584520192:0@lo:400:kworker.0 00000100:00100000:1.0:1788572600.190044:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584519296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.190054:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.190067:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7954 00000100:00100000:3.0:1788572600.190076:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584519552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572600.190104:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875444584519296:12345-0@lo:400:kworker.0 Request processed in 75us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572600.190112:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1788572600.190128:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584520192 00000100:00100000:3.0:1788572600.190133:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3644:x1875444584519552:12345-0@lo:400:kworker.0 Request processed in 56us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572600.190134:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584520192 00000100:00100000:3.0:1788572600.190144:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7954 00000100:00100000:1.0:1788572600.190161:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1788572600.190169:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584519808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.190180:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1788572600.190181:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7955 00000100:00100000:2.0:1788572600.190196:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584519168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.190198:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584520064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572600.190208:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875444584519808:12345-0@lo:400:kworker.0 Request processed in 37us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572600.190216:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1788572600.190232:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1788572600.190242:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584520192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.190252:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584520064:12345-0@lo:400:kworker.0 Request processed in 60us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572600.190262:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7955 00000100:00100000:2.0:1788572600.190263:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875444584519168:12345-0@lo:400:kworker.0 Request processed in 58us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572600.190274:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:1.0:1788572600.190282:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875444584520192:12345-0@lo:400:kworker.0 Request processed in 40us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572600.190282:0:177557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7956 00000100:00100000:3.0:1788572600.190294:0:177557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584519680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572600.190295:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00080000:1.0:1788572600.190325:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572600.190329:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875444584519168:0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.190339:0:177557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3642:x1875444584519680:12345-0@lo:400:kworker.0 Request processed in 48us (345us total) trans 0 rc 0/0 00000100:00080000:1.0:1788572600.190346:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572600.190347:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875444584519680:0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.190351:0:177557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7956 00000100:00080000:1.0:1788572600.190352:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572600.190367:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875444584520192:0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.190381:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875444584519296:0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.190394:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875444584519808:0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.190405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.190429:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e590a805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584519936:0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.190432:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584519424 00000100:00100000:2.0:1788572600.190437:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584519424 00000100:00100000:0.0:1788572600.190444:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875444584519552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572600.190464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584520064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572600.190503:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875444584519040:0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.190503:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:3.0:1788572600.190517:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572600.190519:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584519424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.190561:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875444584519424:12345-0@lo:400:kworker.0 Request processed in 49us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572600.190565:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1fbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e87131b0-4a60-4def-a26d-6e23dcfe5daa:3643:1875444584518912:0@lo:400:kworker.0 00000100:00100000:2.0:1788572600.190570:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00080000:2.0:1788572600.190596:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572600.190597:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875444584519424:0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.190618:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584519936 00000100:00100000:3.0:1788572600.190622:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584519936 00000100:00100000:3.0:1788572600.190659:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7957 00000100:00080000:2.0:1788572600.190663:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572600.190668:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584519936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572600.190703:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875444584519936:12345-0@lo:400:kworker.0 Request processed in 38us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572600.190710:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7957 00000100:00100000:2.0:1788572600.190717:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e590a805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584519936:0@lo:400:kworker.0 00000001:02000400:0.0:1788572600.294350:0:203481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80d: DNE: create remote dir, drop update rep from MDT1, fail 2 MDTs ========================================================== 21:43:20 (1788572600) 00000100:00100000:1.0:1788572600.319990:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572600.320042:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569610368 00000100:00100000:2.0:1788572600.320052:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569610368 00000100:00080000:1.0:1788572600.320109:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572600.320144:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1429 00000100:00100000:2.0:1788572600.320153:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+9:167257:x1875444569610368:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572600.320172:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572600.320192:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb74f expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.320243:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4400/0x265cfe11109c0478 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.320256:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4400/0x265cfe11109c0478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.320269:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4400/0x265cfe11109c0478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572600.320312:0:188048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572600.320317:0:188048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572600.320334:0:188048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4400/0x265cfe11109c0478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.320363:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb74f expref: 11 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.320380:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4400/0x265cfe11109c0478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb74f expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.320387:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:2.0:1788572600.320389:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572600.320392:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a245f4400, rc 0) 00000100:00100000:2.0:1788572600.320440:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:167257:x1875444569610368:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 288us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572600.320447:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1429 00000100:00100000:0.0:1788572600.321359:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572600.321388:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569610496 00000100:00100000:3.0:1788572600.321393:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569610496 00000100:00100000:3.0:1788572600.321423:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1430 00000100:00100000:3.0:1788572600.321429:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:167257:x1875444569610496:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1788572600.321437:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572600.321448:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c047f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb756 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321545:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321556:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321566:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321579:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321585:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321591:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321890:0:196070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321896:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321901:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321905:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321909:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572600.321912:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321917:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321925:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:3.0:1788572600.321927:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572600.321929:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321932:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f800/0x265cfe11109c0486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321939:0:196070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321944:0:196070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321948:0:196070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321950:0:196070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572600.321952:0:196070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321955:0:196070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321959:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ed55f7e (ffff8e590b3b4900) 00010000:00010000:3.0:1788572600.321960:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572600.321974:0:196070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321977:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117f000/0x265cfe11109c048d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.321997:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c047f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb756 expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.322003:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:3.0:1788572600.322004:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572600.322006:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c047f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb756 expref: 11 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.322015:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e200, rc 0) 00000100:00100000:3.0:1788572600.322047:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:167257:x1875444569610496:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 618us (691us total) trans 0 rc 301/301 00000100:00100000:3.0:1788572600.322051:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1430 00000100:00100000:1.0:1788572600.324412:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572600.324460:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569610752 00000100:00100000:2.0:1788572600.324466:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569610752 00000100:00100000:2.0:1788572600.324524:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1431 00000100:00100000:2.0:1788572600.324534:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:167257:x1875444569610752:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1788572600.324586:0:188833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572600.324602:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4400/0x265cfe11109c0478 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb74f expref: 10 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.324614:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:2.0:1788572600.324617:0:188833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572600.324662:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.324674:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.324684:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.324697:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.324703:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.324710:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325154:0:188833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 3/0,1 mode: --/PW res: [0x200027501:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325161:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325167:0:188833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572600.325176:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008532b8d5 reply state 00000000f84dd545 transno 352187318285 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 3/0,1 mode: PW/PW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325183:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325187:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:2.0:1788572600.325189:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572600.325191:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788572600.325194:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788572600.325200:0:188833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325205:0:188833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325209:0:188833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325213:0:188833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325217:0:188833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572600.325220:0:188833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325224:0:188833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325231:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:2.0:1788572600.325233:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572600.325235:0:188833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325238:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5600/0x265cfe11109c0494 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572600.325245:0:188833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008532b8d5 reply state 00000000f84dd545 transno 352187318285 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325249:0:188833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.325256:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ed55f7e (ffff8e590d91e500) 00010000:00010000:2.0:1788572600.325258:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572600.325259:0:188833:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788572600.325306:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:167257:x1875444569610752:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 775us (897us total) trans 352187318285 rc 0/0 00000100:00100000:2.0:1788572600.325311:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1431 00000100:00100000:0.0:1788572600.626841:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572600.626881:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569610880 00000100:00100000:1.0:1788572600.626898:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569610880 00000100:00100000:1.0:1788572600.626942:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1432 00000100:00100000:1.0:1788572600.626961:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+11:167275:x1875444569610880:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572600.626979:0:198183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572600.626996:0:198183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109c04a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb75d expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.627050:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109c04b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.627064:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109c04b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.627077:0:198183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109c04b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572600.627126:0:198183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572600.627131:0:198183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572600.627149:0:198183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109c04b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.627170:0:198183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2400/0x265cfe11109c04a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb75d expref: 13 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.627182:0:198183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3800/0x265cfe11109c04b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb75d expref: 12 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.627188:0:198183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:1.0:1788572600.627190:0:198183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572600.627193:0:198183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3800, rc 0) 00000100:00100000:1.0:1788572600.627240:0:198183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:167275:x1875444569610880:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 292us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572600.627245:0:198183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1432 00000100:00100000:0.0:1788572600.628637:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572600.628670:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569611008 00000100:00100000:1.0:1788572600.628675:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569611008 00000100:00100000:1.0:1788572600.628706:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1433 00000100:00100000:1.0:1788572600.628713:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+12:167275:x1875444569611008:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1788572600.628721:0:188050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572600.628732:0:188050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109c04b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb764 expref: -99 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.628778:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.628795:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.628804:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.628816:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.628824:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.628840:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.628919:0:188050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109c04cc lrc: 3/1,0 mode: --/PR res: [0x200027501:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.628929:0:188050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109c04cc lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.628937:0:188050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109c04cc lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572600.628982:0:188050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788572600.628986:0:188050:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572600.628999:0:188050:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109c04cc lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629016:0:188050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629022:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629035:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629042:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629048:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572600.629052:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629060:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629070:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:1.0:1788572600.629074:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572600.629078:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629085:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3a00/0x265cfe11109c04be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629102:0:188050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629109:0:188050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629115:0:188050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629121:0:188050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd3400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572600.629124:0:188050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629131:0:188050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629139:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ed55f7e (ffff8e590d91e500) 00010000:00010000:1.0:1788572600.629141:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572600.629144:0:188050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629150:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3400/0x265cfe11109c04c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629173:0:188050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd2200/0x265cfe11109c04b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb764 expref: 14 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629187:0:188050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1fcd3e00/0x265cfe11109c04cc lrc: 3/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb764 expref: 13 pid: 188050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.629195:0:188050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:1.0:1788572600.629197:0:188050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788572600.629200:0:188050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1fcd3e00, rc 0) 00000100:00100000:1.0:1788572600.629244:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:167275:x1875444569611008:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 530us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572600.629255:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1433 00000100:00100000:2.0:1788572600.630160:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572600.630203:0:188049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569611136 00000100:00100000:0.0:1788572600.630209:0:188049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569611136 00000100:00100000:0.0:1788572600.630241:0:188049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1434 00000100:00100000:0.0:1788572600.630251:0:188049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:167275:x1875444569611136:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1788572600.630262:0:188049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572600.630273:0:188049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c04d3 lrc: 2/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb76b expref: -99 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630312:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 3/1,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630322:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 3/1,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630332:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 3/1,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630346:0:188049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 3/1,0 mode: --/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630353:0:188049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630360:0:188049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630383:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 3/1,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630391:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 2/0,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630398:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 3/0,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630415:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572600.630419:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 3/0,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630426:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 4/0,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630436:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:0.0:1788572600.630439:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572600.630442:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 2/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630448:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffce800/0x265cfe11109c04da lrc: 0/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630458:0:188049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630465:0:188049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630472:0:188049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630528:0:188049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572600.630533:0:188049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630540:0:188049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630548:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0xf7117594 (ffff8e5a02ffb100) 00010000:00010000:0.0:1788572600.630558:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572600.630562:0:188049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 2/0,0 mode: --/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630568:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf600/0x265cfe11109c04e1 lrc: 0/0,0 mode: --/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630595:0:188049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c04d3 lrc: 1/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb76b expref: 14 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630614:0:188049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:0.0:1788572600.630617:0:188049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572600.630621:0:188049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcee00/0x265cfe11109c04d3 lrc: 0/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb76b expref: 14 pid: 188049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.630630:0:188049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcee00, rc 0) 00000100:00100000:0.0:1788572600.630668:0:188049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:167275:x1875444569611136:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 419us (510us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572600.630675:0:188049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1434 00000100:00100000:0.0:1788572600.631548:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572600.631591:0:188048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569611264 00000100:00100000:2.0:1788572600.631597:0:188048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569611264 00000100:00100000:2.0:1788572600.631635:0:188048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1435 00000100:00100000:2.0:1788572600.631644:0:188048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:167275:x1875444569611264:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572600.631652:0:188048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572600.631662:0:188048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4600/0x265cfe11109c04e8 lrc: 2/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb772 expref: -99 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631689:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 3/1,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631695:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 3/1,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631701:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 3/1,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631708:0:188048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 3/1,0 mode: --/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631713:0:188048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631721:0:188048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631738:0:188048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 4/1,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631744:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 4/1,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631750:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 3/0,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631756:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 4/0,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631763:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f4a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572600.631766:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 4/0,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631774:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 5/0,0 mode: CR/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631783:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:2.0:1788572600.631786:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572600.631789:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 3/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631801:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4a00/0x265cfe11109c04ef lrc: 0/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631813:0:188048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631820:0:188048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631826:0:188048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631831:0:188048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572600.631834:0:188048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631839:0:188048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631847:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0xf7117594 (ffff8e590d91e100) 00010000:00010000:2.0:1788572600.631849:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572600.631852:0:188048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 2/0,0 mode: --/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631859:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5a00/0x265cfe11109c04f6 lrc: 0/0,0 mode: --/PR res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631883:0:188048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4600/0x265cfe11109c04e8 lrc: 1/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb772 expref: 14 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631892:0:188048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:2.0:1788572600.631895:0:188048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572600.631898:0:188048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4600/0x265cfe11109c04e8 lrc: 0/0,0 mode: --/CR res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb772 expref: 14 pid: 188048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.631915:0:188048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a245f4600, rc 0) 00000100:00100000:2.0:1788572600.631963:0:188048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:167275:x1875444569611264:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 309us (405us total) trans 0 rc 301/301 00000100:00100000:2.0:1788572600.631971:0:188048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1435 00000100:00100000:1.0:1788572600.632857:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572600.632894:0:196070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569611392 00000100:00100000:2.0:1788572600.632898:0:196070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569611392 00000100:00100000:2.0:1788572600.632925:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1436 00000100:00100000:2.0:1788572600.632931:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+13:167275:x1875444569611392:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572600.632940:0:196070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572600.632961:0:196070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5800/0x265cfe11109c04fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb779 expref: -99 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.633002:0:196070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 3/1,0 mode: --/PR res: [0x200027501:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.633013:0:196070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.633021:0:196070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572600.633051:0:196070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788572600.633054:0:196070:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572600.633070:0:196070:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 3/1,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.633090:0:196070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5800/0x265cfe11109c04fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb779 expref: 15 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.633103:0:196070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb779 expref: 14 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.633108:0:196070:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:2.0:1788572600.633110:0:196070:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572600.633112:0:196070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a245f5200, rc 0) 00000100:00100000:2.0:1788572600.633146:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:167275:x1875444569611392:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 215us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572600.633153:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1436 00000100:00100000:1.0:1788572600.634776:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572600.634826:0:188833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569611648 00000100:00100000:2.0:1788572600.634833:0:188833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569611648 00000100:00100000:2.0:1788572600.634876:0:188833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1437 00000100:00100000:2.0:1788572600.634884:0:188833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+14:167275:x1875444569611648:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1788572600.634897:0:188833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572600.634911:0:188833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4e00/0x265cfe11109c050b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8364c713e25bb780 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572600.634983:0:188833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027501:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788572600.635061:0:188833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4e00/0x265cfe11109c050b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb780 expref: 16 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.635075:0:188833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5a122fbf00) 00010000:00010000:2.0:1788572600.635078:0:188833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572600.635084:0:188833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4e00/0x265cfe11109c050b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb780 expref: 16 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.635101:0:188833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a245f4e00, rc 0) 00000100:00100000:2.0:1788572600.635146:0:188833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:167275:x1875444569611648:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 259us (371us total) trans 352187318286 rc 301/301 00000100:00100000:2.0:1788572600.635152:0:188833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1437 00000100:00100000:1.0:1788572600.636142:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572600.636186:0:198183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569611904 00000100:00100000:0.0:1788572600.636193:0:198183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569611904 00000100:00080000:1.0:1788572600.636233:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572600.636252:0:198183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1438 00000100:00100000:0.0:1788572600.636262:0:198183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+115:167275:x1875444569611904:12345-192.168.202.57@tcp:36:lfs.0 00000100:00100000:0.0:1788572600.636366:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584520320:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.636414:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.636438:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584520320 00000100:00100000:0.0:1788572600.636445:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572600.636445:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584520320 00000100:00100000:0.0:1788572600.636513:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788572600.636525:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:198183:x1875444584520320:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.636585:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:198183:x1875444584520320:12345-0@lo:1000:mdt00_005.0 Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572600.636593:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1788572600.636631:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1095ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584520320:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1788572600.636685:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584520448:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1788572600.636711:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572600.636728:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318240 going to sleep for 11 seconds 00000100:00100000:0.0:1788572600.636739:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584520448 00000100:00100000:0.0:1788572600.636744:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584520448 00000100:00100000:0.0:1788572600.636773:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1788572600.636782:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:198183:x1875444584520448:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.636855:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:198183:x1875444584520448:12345-0@lo:1000:mdt00_005.0 Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572600.636862:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1788572600.636881:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584520448:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1788572600.636912:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584520576:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1788572600.636945:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572600.636971:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572600.636984:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584520576 00000100:00100000:3.0:1788572600.636988:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584520576 00000100:00100000:3.0:1788572600.637014:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1788572600.637022:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:198183:x1875444584520576:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1788572600.637092:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:198183:x1875444584520576:12345-0@lo:1000:mdt00_005.0 Request processed in 71us (146us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572600.637100:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1788572600.637117:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584520576:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1788572600.637161:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 3/0,1 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.637170:0:198183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 3/0,1 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572600.637179:0:198183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 3/0,1 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572600.637190:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584520704:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1788572600.637212:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572600.637230:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572600.637246:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584520704 00000100:00100000:0.0:1788572600.637252:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584520704 00000100:00100000:0.0:1788572600.637282:0:188053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1788572600.637290:0:188053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:198183:x1875444584520704:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1788572600.637298:0:188053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572600.637311:0:188053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0520 lrc: 2/0,0 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109c0519 expref: -99 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.637332:0:188053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 2/0,1 mode: TXN/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.637345:0:188053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 2/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb779 expref: 14 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.637354:0:188053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0520 lrc: 5/0,0 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109c0519 expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.637378:0:188053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb779 expref: 14 pid: 196070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.637391:0:188053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb779 expref: 14 pid: 196070 timeout: 9453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572600.637403:0:188053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:188053:1875444584520832:192.168.202.57@tcp:104: 00010000:00010000:0.0:1788572600.637459:0:188053:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1788572600.637521:0:188053:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788572600.637561:0:188053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a0019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572600.638364:0:188053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:188053:1875444584520832:192.168.202.57@tcp:104: 00010000:00010000:2.0:1788572600.638386:0:188053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0520 lrc: 3/0,0 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c0519 expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.638396:0:188053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:2.0:1788572600.638399:0:188053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572600.638403:0:188053:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0520 lrc: 3/0,0 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c0519 expref: 9 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.638413:0:188053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a1ffcf200, rc 0) 00000100:00100000:2.0:1788572600.638455:0:188053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584520704:12345-0@lo:101:mdt00_005.0 Request processed in 1166us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572600.638463:0:188053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1788572600.638554:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1788572600.638555:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584520704:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1788572600.638576:0:198183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 4/0,1 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.638585:0:198183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 4/0,1 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572600.638603:0:152004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569612032 00000100:00100000:2.0:1788572600.638610:0:152004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569612032 00010000:00010000:2.0:1788572600.638632:0:152004:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb779 expref: 15 pid: 196070 timeout: 9453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572600.638662:0:152004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 12918 00000100:00100000:2.0:1788572600.638671:0:152004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+15:2398:x1875444569612032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572600.638682:0:152004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572600.638688:0:152004:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 4/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb779 expref: 15 pid: 196070 timeout: 9453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.638701:0:152004:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 3/0,0 mode: PR/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb779 expref: 15 pid: 196070 timeout: 9453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.638718:0:152004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5200/0x265cfe11109c0504 lrc: 0/0,0 mode: --/PR res: [0x200027501:0xa:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0x8364c713e25bb779 expref: 15 pid: 196070 timeout: 9453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.638731:0:152004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:2.0:1788572600.638735:0:152004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0520 lrc: 2/0,0 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c0519 expref: 8 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.638743:0:152004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:0.0:1788572600.638769:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318286 is committed 00010000:00010000:3.0:1788572600.638785:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572600.638786:0:201325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318282 is committed 00000100:00100000:2.0:1788572600.638794:0:152004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+10:2398:x1875444569612032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 122us (240us total) trans 0 rc 0/0 00010000:00010000:3.0:1788572600.638801:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572600.638806:0:152004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 12918 00010000:00010000:3.0:1788572600.638814:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638821:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572600.638826:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638833:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638844:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8e590b3b4800) 00010000:00010000:3.0:1788572600.638847:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572600.638850:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638857:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117fa00/0x265cfe11109c0463 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638875:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638881:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638888:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638893:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f4200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572600.638896:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638903:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638910:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ed55f7e (ffff8e590d91e500) 00010000:00010000:3.0:1788572600.638962:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572600.638966:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638973:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f4200/0x265cfe11109c049b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ed55f7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638987:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.638994:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639000:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639005:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572600.639008:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639014:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639022:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0x0 (ffff8e590d91e200) 00010000:00010000:3.0:1788572600.639025:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572600.639028:0:3627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0520 lrc: 2/0,0 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c0519 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639038:0:3627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0520 lrc: 2/0,0 mode: CW/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109c0519 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639045:0:3627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0520 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x265cfe11109c0519 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639067:0:3627:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a1ffcf200/0x265cfe11109c0520 lrc: 3/0,0 mode: CW/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c0519 expref: 7 pid: 188053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572600.639082:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e59028ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3627:1875444584520960:0@lo:105: 00000100:00100000:3.0:1788572600.639108:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.639135:0:3627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590d7b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572600.639147:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584520960 00000100:00100000:0.0:1788572600.639157:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584520960 00000100:00100000:0.0:1788572600.639192:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5409 00000100:00100000:0.0:1788572600.639200:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3627:x1875444584520960:12345-0@lo:105: 00010000:00010000:0.0:1788572600.639209:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 5/0,1 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.639216:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 5/0,1 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.639222:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 5/0,1 mode: --/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.639226:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 5/0,1 mode: CW/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.639230:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 6/0,1 mode: CW/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.639236:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 6/0,1 mode: CW/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572600.639251:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e5a1fcd3400) 00010000:00010000:2.0:1788572600.639268:0:198183:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572600.639279:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3627:x1875444584520960:12345-0@lo:105: Request processed in 81us (170us total) trans 0 rc 0/0 00010000:00010000:2.0:1788572600.639279:0:198183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1fcd3400/0x265cfe11109c0519 lrc: 4/0,1 mode: CW/CW res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c0520 expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572600.639294:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5409 00000100:00100000:3.0:1788572600.639301:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e59028ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3627:1875444584520960:0@lo:105: 00000004:00080000:2.0:1788572600.639307:0:198183:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0xa:0x0] 00010000:00010000:3.0:1788572600.639319:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 2/0,0 mode: --/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639328:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a245f5000/0x265cfe11109c04a2 lrc: 0/0,0 mode: --/TXN res: [0x200027501:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 188833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.639334:0:198183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a245f4400/0x265cfe11109c0527 lrc: 3/0,1 mode: --/PW res: [0x200027501:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 198183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.639341:0:198183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a245f4400/0x265cfe11109c0527 lrc: 3/0,1 mode: --/PW res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.639354:0:198183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a245f4400/0x265cfe11109c0527 lrc: 3/0,1 mode: --/PW res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572600.639366:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fee680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521088:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1788572600.639391:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572600.639410:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572600.639413:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584521088 00000100:00100000:3.0:1788572600.639418:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584521088 00000100:00100000:3.0:1788572600.639450:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1788572600.639457:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:198183:x1875444584521088:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1788572600.639468:0:188054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572600.639497:0:188054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c052e lrc: 2/0,0 mode: --/PW res: [0x200027501:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x265cfe11109c0527 expref: -99 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639516:0:188054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c052e lrc: 3/0,0 mode: PW/PW res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x265cfe11109c0527 expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639528:0:188054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117e200/0x265cfe11109c052e lrc: 3/0,0 mode: PW/PW res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x265cfe11109c0527 expref: 9 pid: 188054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572600.639535:0:188054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0xa:0x0].0xf7117594 (ffff8e5a1fbf4d00) 00010000:00010000:3.0:1788572600.639537:0:188054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572600.639541:0:188054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5a4117e200, rc 0) 00000100:00100000:3.0:1788572600.639575:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521088:12345-0@lo:101:mdt00_005.0 Request processed in 118us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572600.639583:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1788572600.639594:0:198183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318282 gen 2 00000004:00080000:2.0:1788572600.639600:0:198183:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318282 committed transno 352187318282 00000100:00100000:2.0:1788572600.639641:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fee680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521088:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1788572600.639652:0:198183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a245f4400/0x265cfe11109c0527 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x265cfe11109c052e expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572600.639661:0:198183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a245f4400/0x265cfe11109c0527 lrc: 4/0,1 mode: PW/PW res: [0x200027501:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x265cfe11109c052e expref: -99 pid: 198183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572600.639673:0:198183:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0xa:0x0] 00000100:00100000:2.0:1788572600.639696:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fee680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521216:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1788572600.639722:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572600.639742:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e5a1fdbccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572600.639764:0:188053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584521216 00000100:00100000:0.0:1788572600.639770:0:188053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584521216 00000100:00100000:2.0:1788572600.639810:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1788572600.639819:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521216:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1788572600.639872:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521216:12345-0@lo:1000:mdt00_005.0 Request processed in 55us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572600.639879:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1788572600.639892:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fee680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521216:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.639927:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521344:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.639961:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572600.639982:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572600.639999:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584521344 00000100:00100000:3.0:1788572600.640003:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584521344 00000100:00100000:3.0:1788572600.640028:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1788572600.640035:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521344:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1788572600.640099:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521344:12345-0@lo:1000:mdt00_005.0 Request processed in 64us (148us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572600.640107:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1788572600.640121:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521344:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.640178:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521472:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.640200:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572600.640219:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572600.640240:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584521472 00000100:00100000:2.0:1788572600.640244:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584521472 00000100:00100000:2.0:1788572600.640269:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1788572600.640275:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521472:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1788572600.640338:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521472:12345-0@lo:1000:mdt00_005.0 Request processed in 61us (134us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572600.640346:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1788572600.640348:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521472:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.640400:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521600:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.640427:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572600.640455:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572600.640469:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584521600 00000100:00100000:3.0:1788572600.640475:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584521600 00000100:00100000:3.0:1788572600.640654:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1788572600.640662:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521600:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1788572600.640723:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521600:12345-0@lo:1000:mdt00_005.0 Request processed in 62us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572600.640732:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521600:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1788572600.640732:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1788572600.640785:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521728:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.640811:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572600.640832:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572600.640835:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584521728 00000100:00100000:2.0:1788572600.640841:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584521728 00000100:00100000:2.0:1788572600.640864:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1788572600.640869:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521728:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1788572600.640915:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521728:12345-0@lo:1000:mdt00_005.0 Request processed in 46us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572600.640920:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1788572600.640935:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521728:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.640987:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521856:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.641010:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572600.641027:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572600.641044:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584521856 00000100:00100000:3.0:1788572600.641049:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584521856 00000100:00100000:3.0:1788572600.641075:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1788572600.641091:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521856:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1788572600.641159:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521856:12345-0@lo:1000:mdt00_005.0 Request processed in 76us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572600.641163:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521856:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1788572600.641170:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000040:00080000:0.0:1788572600.641628:0:198183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400036c8:0x1:0x0].2, 1096 off34288 00000100:00100000:0.0:1788572600.641694:0:198183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521984:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1788572600.641723:0:198183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572600.641748:0:198183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590a001300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572600.641761:0:189111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584521984 00000100:00100000:1.0:1788572600.641767:0:189111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584521984 00000100:00100000:1.0:1788572600.641798:0:189111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1788572600.641807:0:189111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521984:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1788572600.641867:0:189111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198183:x1875444584521984:12345-0@lo:1000:mdt00_005.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572600.641874:0:189111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1788572600.641884:0:198183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:198183:1875444584521984:0@lo:1000:mdt00_005.0 00000040:00080000:0.0:1788572600.641915:0:198183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000284a1:0x1:0x0].2, 1240 off34512 00000004:00080000:0.0:1788572600.641922:0:198183:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8e590a0019c0 with version 7 00000004:00080000:1.0:1788572600.641944:0:202679:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e5905274300 version 7 rpc_version 7 00000020:00100000:1.0:1788572600.641975:0:202679:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788572600.641983:0:202679:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e5a1ffa9500 x1875444584522240/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572600.641997:0:202679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202679:1875444584522240:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788572600.642031:0:202679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572600.642052:0:202679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e590b318240 going to sleep for 11 seconds 00000100:00100000:3.0:1788572600.642069:0:188054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584522240 00000100:00100000:3.0:1788572600.642073:0:188054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584522240 00000100:00100000:3.0:1788572600.642104:0:188054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1788572600.642113:0:188054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202679:x1875444584522240:12345-0@lo:1000:osp_up0-1.0 00010000:02000000:3.0:1788572600.642334:0:188054:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00010000:00020000:3.0:1788572600.647718:0:188054:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8e5a36b3fc50 x1875444584522240/t352187318287(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:261/0 lens 2520/4320 e 0 to 0 dl 1788572611 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572600.647734:0:188054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202679:x1875444584522240:12345-0@lo:1000:osp_up0-1.0 Request processed in 5623us (5702us total) trans 352187318287 rc 0/0 00000100:00100000:3.0:1788572600.647744:0:188054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000004:00080000:0.0:1788572600.700655:0:202683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 9353695172777ns, next at 9354695169577ns, rc = 0 00000100:00100000:2.0:1788572600.700669:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584522496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572600.700681:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:1.0:1788572600.700750:0:202685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 9353695269987ns, next at 9354695267812ns, rc = 0 00000100:00100000:3.0:1788572600.700752:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584522368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572600.700838:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.700871:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584522496 00000100:00100000:3.0:1788572600.700880:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584522496 00000100:00100000:2.0:1788572600.700898:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572600.700927:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584522368 00000100:00100000:3.0:1788572600.700931:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584522368 00000100:00100000:2.0:1788572600.700938:0:9987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6513 00000100:00100000:2.0:1788572600.700965:0:9987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584522496:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572600.700972:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6514 00000100:00100000:3.0:1788572600.700981:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584522368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572600.701001:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788572600.701050:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584522368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (152us total) trans 0 rc 0/0 00002000:00000024:2.0:1788572600.701178:0:9987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572600.701195:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6514 00000100:00100000:2.0:1788572600.701223:0:9987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875444584522496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 275us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572600.701230:0:9987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6513 00000100:00100000:2.0:1788572600.701270:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584522368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572600.701274:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584522496:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572600.956675:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572601.706643:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572601.706693:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1788572601.706723:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572601.706759:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569612288 00000100:00100000:3.0:1788572601.706759:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1788572601.706764:0:201332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569612160 00000100:00100000:1.0:1788572601.706768:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569612288 00000100:00100000:2.0:1788572601.706772:0:201332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569612160 00000100:00100000:0.0:1788572601.706782:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569612544 00000100:00100000:0.0:1788572601.706789:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569612544 00000100:00100000:3.0:1788572601.706799:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1788572601.706816:0:188050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569612416 00000100:00100000:1.0:1788572601.706820:0:188050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569612416 00000100:00100000:2.0:1788572601.706825:0:201332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 130 00000100:00100000:2.0:1788572601.706837:0:201332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5904095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569612160:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572601.706846:0:43929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444569612672 00000100:00100000:3.0:1788572601.706851:0:43929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444569612672 00000100:00100000:1.0:1788572601.706856:0:188050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 634 00000100:00100000:0.0:1788572601.706857:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7958 00000100:00100000:1.0:1788572601.706867:0:188050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2398:x1875444569612288:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1788572601.706874:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569612544:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:3.0:1788572601.706892:0:43929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7959 00000100:00100000:3.0:1788572601.706902:0:43929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569612672:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1788572601.706924:0:201332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5904095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f79285ed-4685-45a8-8731-5e2522a143f3+10:2397:x1875444569612160:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572601.706930:0:201332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 130 00000100:00100000:1.0:1788572601.706942:0:188050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+8:2398:x1875444569612288:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572601.706943:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2398:x1875444569612544:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572601.706946:0:43929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+5:2397:x1875444569612672:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572601.706966:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7958 00000100:00100000:1.0:1788572601.706966:0:188050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 634 00000100:00100000:2.0:1788572601.706973:0:196070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 635 00000100:00100000:3.0:1788572601.706977:0:43929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7959 00000100:00100000:2.0:1788572601.706989:0:196070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+117:2397:x1875444569612416:12345-192.168.202.57@tcp:400:kworker.0 00000100:00080000:1.0:1788572601.706992:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572601.706996:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572601.707026:0:196070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02515dca-bbf0-45e0-bd6e-e76f0c89bd0b+117:2397:x1875444569612416:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 42us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572601.707034:0:196070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 635 00010000:00010000:2.0:1788572601.980678:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572603.004644:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572603.774223:0:202673:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:1.0:1788572603.774244:0:202673:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00010000:00010000:1.0:1788572603.774292:0:202673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x265cfe11109c0424 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572603.774309:0:202673:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 3/0,0 mode: PW/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x265cfe11109c0424 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774343:0:202673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 2/0,0 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109c0424 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774353:0:202673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572603.774363:0:202673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8e5a1ffcfc00/0x265cfe11109c041d lrc: 0/0,0 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x265cfe11109c0424 expref: -99 pid: 188833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788572603.774380:0:202673:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 30064771142 is committed 00000020:00080000:1.0:1788572603.774394:0:202673:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8e5a1fd620c0 refcount 2 committed 0 result 0 batchid 25769803847 00000020:00080000:1.0:1788572603.774400:0:202673:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a1f9da100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5a1fd62840 00000020:00080000:1.0:1788572603.774404:0:202673:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000284a1:0x1:0x0].1 00000020:00080000:1.0:1788572603.774407:0:202673:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e5a1f9dad00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5901906c00 00000020:00080000:1.0:1788572603.774411:0:202673:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400036c8:0x1:0x0].1 00000004:00080000:1.0:1788572603.774464:0:202673:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000004:00080000:1.0:1788572603.774498:0:202673:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000100:00100000:2.0:1788572603.774500:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584522624:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1788572603.774567:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572603.774599:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584522624 00000100:00100000:0.0:1788572603.774607:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584522624 00000100:00100000:2.0:1788572603.774610:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584522880:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1788572603.774615:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774626:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774635:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788572603.774643:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572603.774647:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572603.774650:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.774655:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774663:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.774672:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584523648:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572603.774673:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22743 00010000:00010000:1.0:1788572603.774677:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x679fc7b1 (ffff8e5a0a4b7f00) 00010000:00010000:1.0:1788572603.774683:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.774688:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.774689:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5905a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875444584522624:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.774701:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e000/0x265cfe11109bfe9e lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.774703:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572603.774709:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584522880 00000100:00100000:3.0:1788572603.774713:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584522880 00002000:00080000:0.0:1788572603.774718:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:648 count 1 00010000:00010000:1.0:1788572603.774722:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.774730:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584524160:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.774731:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774742:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572603.774748:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572603.774748:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.774754:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.774754:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4696 00010000:00010000:0.0:1788572603.774759:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.774763:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572603.774765:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3644:x1875444584522880:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1788572603.774771:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.774780:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572603.774785:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x288:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.774789:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x94c295fa (ffff8e5a039c6b00) 00010000:00010000:0.0:1788572603.774791:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x288:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.774793:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572603.774797:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5a4117ee00/0x265cfe11109c0424 lrc: 0/0,0 mode: --/PW res: [0x200027501:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x265cfe11109c041d expref: 10 pid: 189111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774799:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.774800:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.774802:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584524672:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.774812:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1fcd2600/0x265cfe11109bfec1 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.774818:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027501:0x7:0x0].0xf7117594 (ffff8e590b3b4700) 00010000:00010000:3.0:1788572603.774841:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572603.774849:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774849:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.774861:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572603.774870:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.774873:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.774879:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584522880:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 116us (236us total) trans 0 rc 0/0 00010000:00010000:1.0:1788572603.774882:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.774895:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4696 00010000:00010000:1.0:1788572603.774897:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfe00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572603.774898:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774900:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.774909:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584522880:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1788572603.774922:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.774931:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572603.774933:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00010000:00010000:1.0:1788572603.774935:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xc1e56442 (ffff8e5a16354c00) 00010000:00010000:1.0:1788572603.774939:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572603.774940:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572603.774942:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.774944:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584523136:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1788572603.774946:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774951:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfe00/0x265cfe11109bfee4 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.774959:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572603.774963:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774966:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774973:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.774978:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.774980:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.774984:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572603.774990:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.774993:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.774997:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775000:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775004:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e132c1d/0x265cfe11109c0535 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775008:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xef08328a (ffff8e5a16354b00) 00010000:00010000:1.0:1788572603.775011:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572603.775011:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584523520:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.775016:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775022:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce000/0x265cfe11109bff07 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775022:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572603.775025:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572603.775027:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572603.775033:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775039:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572603.775051:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775057:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.775062:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775063:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5905a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1875444584522624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 378us (495us total) trans 4294975701 rc 0/0 00000100:00100000:2.0:1788572603.775074:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584524032:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.775078:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.775078:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584523648 00000100:00100000:0.0:1788572603.775080:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22743 00000100:00100000:3.0:1788572603.775084:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584523648 00010000:00010000:1.0:1788572603.775093:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x1c2b00d3 (ffff8e5a0a4b7900) 00010000:00010000:1.0:1788572603.775095:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.775099:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775101:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584524160 00000100:00100000:0.0:1788572603.775106:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584524160 00010000:00010000:1.0:1788572603.775108:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e800/0x265cfe11109bff2a lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775114:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572603.775115:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584524672 00000100:00100000:3.0:1788572603.775121:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584524672 00010000:00010000:1.0:1788572603.775126:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775133:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775139:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775141:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584523136 00000100:00100000:0.0:1788572603.775147:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584523136 00010000:00010000:1.0:1788572603.775148:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117e400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.775155:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775155:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584524544:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1788572603.775157:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584523520 00000100:00100000:3.0:1788572603.775161:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584523520 00010000:00010000:1.0:1788572603.775166:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775173:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584524032 00000100:00100000:0.0:1788572603.775179:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584524032 00010000:00010000:1.0:1788572603.775180:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x494dcf1b (ffff8e5a0a4b7800) 00010000:00010000:1.0:1788572603.775185:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572603.775187:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22744 00010000:00010000:1.0:1788572603.775188:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775194:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572603.775199:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584523648:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.775200:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117e400/0x265cfe11109bff4d lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775208:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584524544 00000100:00100000:0.0:1788572603.775212:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584524544 00010000:00010000:1.0:1788572603.775213:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788572603.775213:0:179391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:646 count 1 00010000:00010000:1.0:1788572603.775220:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775226:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.775231:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4c380/2, rc 0, transno 4294975701 00002000:00010000:3.0:1788572603.775231:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572603.775232:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ea00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.775236:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775239:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22745 00010000:00010000:3.0:1788572603.775242:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775248:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775250:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584522624:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572603.775252:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3644:x1875444584524160:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1788572603.775254:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x286:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:3.0:1788572603.775263:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x286:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.775268:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x76709d63 (ffff8e5a0a4b7b00) 00010000:00010000:3.0:1788572603.775268:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775270:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:0.0:1788572603.775274:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:651 count 1 00010000:00010000:1.0:1788572603.775274:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775277:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775280:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584522752:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.775286:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117ea00/0x265cfe11109bff70 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572603.775291:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572603.775292:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775299:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.775308:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775310:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775310:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775321:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572603.775330:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28b:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.775331:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.775338:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572603.775340:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572603.775342:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf000 already unused, calling callback (ffffffffc180a4f0) 00000100:00100000:2.0:1788572603.775346:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523264:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1788572603.775350:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775350:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775370:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572603.775375:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775391:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xa3936bac (ffff8e5a16354200) 00010000:00010000:0.0:1788572603.775392:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775398:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572603.775400:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523776:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.775403:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.775411:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775418:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf000/0x265cfe11109bff93 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.775423:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+9:3644:x1875444584523648:12345-0@lo:6:osp-syn-1-1.0 Request processed in 227us (721us total) trans 4294975702 rc 0/0 00000100:00100000:3.0:1788572603.775430:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22744 00010000:00010000:0.0:1788572603.775431:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572603.775433:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775441:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572603.775444:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584522752 00010000:00010000:1.0:1788572603.775447:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.775447:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584522752 00010000:00010000:1.0:1788572603.775453:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775461:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.775464:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775468:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584524288:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1788572603.775469:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584523264 00000100:00100000:3.0:1788572603.775473:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584523264 00010000:00010000:1.0:1788572603.775474:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775502:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xd0b639f4 (ffff8e590b3b4b00) 00010000:00010000:1.0:1788572603.775505:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.775509:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775515:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf400/0x265cfe11109bffb6 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.775517:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584523776 00000100:00100000:3.0:1788572603.775520:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584523776 00000100:00100000:2.0:1788572603.775527:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572603.775532:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775540:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775546:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775551:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcea00 already unused, calling callback (ffffffffc180a4f0) 00000100:00100000:3.0:1788572603.775553:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584524288 00010000:00010000:1.0:1788572603.775554:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.775556:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584524288 00000100:00100000:2.0:1788572603.775561:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00010000:00010000:1.0:1788572603.775562:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775573:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523008:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.775580:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xfdd9083c (ffff8e590b3b4200) 00000100:00100000:3.0:1788572603.775582:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22746 00010000:00010000:1.0:1788572603.775583:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.775586:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.775590:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a41742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+11:3644:x1875444584524672:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.775593:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcea00/0x265cfe11109bffd9 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775601:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572603.775605:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788572603.775605:0:179391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:649 count 1 00010000:00010000:1.0:1788572603.775611:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775617:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775623:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f200 already unused, calling callback (ffffffffc180a4f0) 00002000:00010000:3.0:1788572603.775623:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1788572603.775625:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523392:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.775627:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775629:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775637:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775639:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x289:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:3.0:1788572603.775643:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x289:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.775647:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x1b7026cc (ffff8e5a03b22100) 00010000:00010000:3.0:1788572603.775648:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775650:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.775655:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775658:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572603.775665:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f200/0x265cfe11109bfffc lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775665:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775674:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775680:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775681:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775683:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523904:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.775694:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775701:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.775702:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788572603.775707:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.775710:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775717:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775726:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572603.775729:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3644:x1875444584524160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 479us (968us total) trans 4294975703 rc 0/0 00010000:00010000:1.0:1788572603.775731:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x3e3e6f26 (ffff8e5a03b22400) 00010000:00010000:1.0:1788572603.775737:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.775741:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775742:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22745 00010000:00010000:1.0:1788572603.775751:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e600/0x265cfe11109c001f lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.775752:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584524416:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1788572603.775760:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584523008 00000100:00100000:0.0:1788572603.775766:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584523008 00010000:00010000:1.0:1788572603.775773:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775781:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775784:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584523392 00010000:00010000:1.0:1788572603.775787:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775789:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584523392 00000100:00100000:2.0:1788572603.775796:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572603.775798:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a41742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+13:3644:x1875444584524672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 208us (941us total) trans 38654705692 rc 0/0 00010000:00010000:1.0:1788572603.775801:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164f200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.775805:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775807:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584523904 00000100:00100000:3.0:1788572603.775807:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22746 00000100:00100000:0.0:1788572603.775812:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584523904 00010000:00010000:1.0:1788572603.775815:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775839:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x610cb780 (ffff8e5903395800) 00000100:00100000:0.0:1788572603.775841:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584524416 00010000:00010000:1.0:1788572603.775842:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572603.775846:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584524416 00010000:00010000:1.0:1788572603.775848:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775855:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164f200/0x265cfe11109c0042 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775868:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22747 00010000:00010000:1.0:1788572603.775869:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775877:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.775878:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3644:x1875444584523136:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.775891:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788572603.775896:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:651 count 1 00010000:00010000:1.0:1788572603.775897:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.775902:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775909:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572603.775916:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572603.775920:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x83daffd9 (ffff8e590b3b4400) 00010000:00010000:0.0:1788572603.775923:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775924:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.775929:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.775938:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28b:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.775940:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dce800/0x265cfe11109c0065 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.775944:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572603.775954:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775956:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775971:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.775972:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.775974:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22748 00010000:00010000:1.0:1788572603.775985:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.775985:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e590a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+12:3644:x1875444584523520:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.775993:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:0.0:1788572603.775994:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.775997:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788572603.775999:0:179391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:649 count 1 00010000:00010000:0.0:1788572603.776010:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776012:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572603.776015:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572603.776023:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776032:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xa6a94833 (ffff8e590b3b4300) 00010000:00010000:3.0:1788572603.776033:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x289:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.776035:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572603.776037:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x289:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.776038:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776039:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788572603.776042:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776048:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce600/0x265cfe11109c0088 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776052:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776060:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776060:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776068:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776068:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776074:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776078:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffce400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.776081:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776084:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788572603.776087:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776095:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xc977908d (ffff8e590b3b4d00) 00010000:00010000:1.0:1788572603.776098:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.776101:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.776107:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22749 00010000:00010000:1.0:1788572603.776112:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffce400/0x265cfe11109c00ab lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.776114:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3644:x1875444584523136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 235us (1132us total) trans 38654705693 rc 0/0 00000100:00100000:2.0:1788572603.776122:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+13:3644:x1875444584524032:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1788572603.776131:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22747 00010000:00010000:1.0:1788572603.776135:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572603.776142:0:43923:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:642 count 1 00010000:00010000:1.0:1788572603.776144:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.776152:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22750 00010000:00010000:1.0:1788572603.776155:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.776161:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e590a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+13:3644:x1875444584523520:12345-0@lo:6:osp-syn-1-1.0 Request processed in 177us (1119us total) trans 4294975704 rc 0/0 00000100:00100000:0.0:1788572603.776164:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3644:x1875444584524544:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:2.0:1788572603.776164:0:43923:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572603.776165:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a3164e800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.776171:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.776172:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22748 00010000:00010000:2.0:1788572603.776178:0:43923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776179:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788572603.776183:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:647 count 1 00000100:00100000:3.0:1788572603.776191:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22751 00010000:00010000:1.0:1788572603.776199:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xec45d8e7 (ffff8e5a0a4b7400) 00010000:00010000:2.0:1788572603.776199:0:43923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x282:0x0].0x0 since=9356s v=(0 0) 00002000:00010000:0.0:1788572603.776203:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1788572603.776203:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+12:3641:x1875444584522752:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.776206:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572603.776208:0:43923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.776212:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776217:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776218:0:43923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776220:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a3164e800/0x265cfe11109c00ce lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788572603.776220:0:179391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:643 count 1 00002000:00010000:3.0:1788572603.776238:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572603.776242:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x287:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.776246:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776248:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x287:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572603.776248:0:43923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776249:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776259:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776261:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776278:0:43923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776281:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776289:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776291:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x283:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.776297:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14b000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572603.776299:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x283:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.776303:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776304:0:43923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776309:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776315:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776320:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776335:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776336:0:43923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1788572603.776340:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776351:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xf142140 (ffff8e5a02ffba00) 00010000:00010000:3.0:1788572603.776352:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776357:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572603.776360:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1788572603.776360:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776361:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776371:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14b000/0x265cfe11109c00f1 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776374:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1788572603.776381:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776387:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776394:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776399:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14be00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.776402:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776408:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776417:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x31e2699a (ffff8e5a02ffb200) 00010000:00010000:1.0:1788572603.776420:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.776423:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.776427:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+15:3644:x1875444584524032:12345-0@lo:6:osp-syn-0-1.0 Request processed in 309us (1315us total) trans 38654705694 rc 0/0 00010000:00010000:1.0:1788572603.776436:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14be00/0x265cfe11109c0114 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.776441:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22749 00000100:00100000:0.0:1788572603.776446:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3644:x1875444584524544:12345-0@lo:6:osp-syn-0-1.0 Request processed in 284us (1254us total) trans 38654705695 rc 0/0 00000100:00100000:0.0:1788572603.776456:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22750 00010000:00010000:1.0:1788572603.776458:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.776465:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+14:3641:x1875444584522752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 264us (1148us total) trans 38654705696 rc 0/0 00010000:00010000:1.0:1788572603.776466:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.776469:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22752 00010000:00010000:1.0:1788572603.776477:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.776500:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22753 00010000:00010000:1.0:1788572603.776502:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535e00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.776507:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.776512:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3641:x1875444584523776:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1788572603.776517:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+12:3641:x1875444584523264:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.776519:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.776523:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22751 00002000:00080000:0.0:1788572603.776527:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:644 count 1 00010000:00010000:1.0:1788572603.776531:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x54b0b1f4 (ffff8e590d91e700) 00010000:00010000:1.0:1788572603.776535:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.776538:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572603.776538:0:43923:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:643 count 1 00000100:00100000:3.0:1788572603.776541:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22754 00002000:00010000:0.0:1788572603.776544:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572603.776553:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535e00/0x265cfe11109c0137 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.776553:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+12:3641:x1875444584524288:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1788572603.776555:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572603.776561:0:43923:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:3.0:1788572603.776567:0:179391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:646 count 1 00010000:00010000:1.0:1788572603.776570:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776573:0:43923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776578:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x284:0x0].0x0 since=9356s v=(0 0) 00002000:00010000:3.0:1788572603.776584:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572603.776588:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x284:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.776589:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776594:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776600:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776601:0:43923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x283:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.776603:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776612:0:43923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x283:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.776622:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcfa00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:2.0:1788572603.776624:0:43923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776627:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776630:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776630:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x286:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:3.0:1788572603.776639:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x286:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.776646:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776649:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776653:0:43923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776657:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776661:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x83daffd9 (ffff8e590b3b4400) 00010000:00010000:3.0:1788572603.776666:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776667:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.776672:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776679:0:43923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776684:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776687:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcfa00/0x265cfe11109c01bc lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776687:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776705:0:43923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776712:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1788572603.776712:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776715:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776722:0:43923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:1.0:1788572603.776724:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776726:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:1.0:1788572603.776731:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776737:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534a00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.776740:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776747:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776759:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xc1e56442 (ffff8e5a16354c00) 00010000:00010000:1.0:1788572603.776762:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.776765:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776771:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534a00/0x265cfe11109c01d8 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776790:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.776792:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3641:x1875444584523776:12345-0@lo:6:osp-syn-0-1.0 Request processed in 283us (1354us total) trans 38654705697 rc 0/0 00000100:00100000:0.0:1788572603.776805:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22753 00010000:00010000:1.0:1788572603.776805:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.776814:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+14:3641:x1875444584524288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 263us (1288us total) trans 38654705698 rc 0/0 00010000:00010000:1.0:1788572603.776815:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776821:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcfc00 already unused, calling callback (ffffffffc180a4f0) 00000100:00100000:3.0:1788572603.776822:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22754 00010000:00010000:1.0:1788572603.776825:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.776842:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22755 00000100:00100000:2.0:1788572603.776844:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+13:3641:x1875444584523264:12345-0@lo:6:osp-syn-1-1.0 Request processed in 348us (1456us total) trans 4294975705 rc 0/0 00010000:00010000:1.0:1788572603.776852:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.776853:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22756 00000100:00100000:0.0:1788572603.776857:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3641:x1875444584523008:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1788572603.776863:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22752 00010000:00010000:1.0:1788572603.776866:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xa3936bac (ffff8e5a16354200) 00000100:00100000:3.0:1788572603.776866:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+12:3641:x1875444584523392:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.776870:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:0.0:1788572603.776873:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:645 count 1 00010000:00010000:1.0:1788572603.776873:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788572603.776880:0:179391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:650 count 1 00010000:00010000:1.0:1788572603.776883:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a40dcfc00/0x265cfe11109c01f4 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.776888:0:43923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22757 00002000:00010000:0.0:1788572603.776892:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1788572603.776898:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572603.776899:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.776904:0:43923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+12:3641:x1875444584523904:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.776905:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776909:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776923:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776925:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x285:0x0].0x0 since=9356s v=(0 0) 00002000:00080000:2.0:1788572603.776927:0:43923:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:647 count 1 00010000:00010000:0.0:1788572603.776935:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x285:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.776936:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776938:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28a:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:0.0:1788572603.776945:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776945:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ae00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572603.776945:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28a:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1788572603.776947:0:43923:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572603.776950:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776954:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776960:0:43923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.776971:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.776974:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.776978:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.776987:0:43923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x287:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.776991:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x31e2699a (ffff8e5a02ffb200) 00010000:00010000:1.0:1788572603.777000:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572603.777000:0:43923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x287:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572603.777005:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777005:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777005:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777007:0:43923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777027:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ae00/0x265cfe11109c0210 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777036:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777036:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777037:0:43923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777044:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777063:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:3.0:1788572603.777064:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00010000:00010000:1.0:1788572603.777068:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777068:0:43923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777087:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777089:0:43923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777097:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.777104:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777107:0:43923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:1.0:1788572603.777114:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777125:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xef08328a (ffff8e5a16354b00) 00010000:00010000:1.0:1788572603.777128:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.777131:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.777140:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3641:x1875444584523008:12345-0@lo:6:osp-syn-1-1.0 Request processed in 286us (1537us total) trans 4294975706 rc 0/0 00010000:00010000:1.0:1788572603.777140:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0800/0x265cfe11109c022c lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.777151:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+13:3641:x1875444584523392:12345-0@lo:6:osp-syn-0-1.0 Request processed in 287us (1496us total) trans 38654705699 rc 0/0 00000100:00100000:0.0:1788572603.777154:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22755 00000100:00100000:3.0:1788572603.777163:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22756 00010000:00010000:1.0:1788572603.777164:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777170:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.777176:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22758 00010000:00010000:1.0:1788572603.777182:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.777189:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3641:x1875444584524416:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.777191:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534200 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.777198:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.777199:0:43923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+13:3641:x1875444584523904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 299us (1475us total) trans 4294975707 rc 0/0 00002000:00080000:0.0:1788572603.777202:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:650 count 1 00000100:00080000:3.0:1788572603.777206:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572603.777215:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.777217:0:43923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22757 00010000:00010000:3.0:1788572603.777217:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00002000:00010000:0.0:1788572603.777220:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572603.777226:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777231:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777238:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xec45d8e7 (ffff8e5a0a4b7400) 00010000:00010000:3.0:1788572603.777239:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fa00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572603.777244:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572603.777244:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777248:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777263:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24534200/0x265cfe11109c0248 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777264:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777266:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28a:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:2.0:1788572603.777271:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788572603.777275:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572603.777280:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777282:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777284:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777286:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777302:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777311:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000486d357c/0x265cfe11109c053c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777314:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777322:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777328:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572603.777335:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777340:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777340:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1c00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572603.777340:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788572603.777347:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777347:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777356:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777365:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777367:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777369:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572603.777375:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777389:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777390:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x1c2b00d3 (ffff8e5a0a4b7900) 00010000:00010000:0.0:1788572603.777392:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:3.0:1788572603.777394:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777396:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.777401:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777414:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013ec139b/0x265cfe11109c0543 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777415:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1c00/0x265cfe11109c0264 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777417:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777435:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec44f6b9/0x265cfe11109c054a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777439:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777447:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777449:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1788572603.777456:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777457:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777457:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00000100:00100000:0.0:1788572603.777461:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a36aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3641:x1875444584524416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 273us (1667us total) trans 4294975708 rc 0/0 00010000:00010000:3.0:1788572603.777463:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777477:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.777498:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.777501:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22758 00010000:00010000:3.0:1788572603.777501:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572603.777508:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572603.777509:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777510:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777515:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777521:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xc977908d (ffff8e590b3b4d00) 00010000:00010000:3.0:1788572603.777523:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777526:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.777530:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777537:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777538:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a24535600/0x265cfe11109c0280 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777540:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777560:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777560:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000264b752f/0x265cfe11109c0558 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777564:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777569:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777574:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788572603.777580:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777584:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f944a62c/0x265cfe11109c0551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777585:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777587:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f4a00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572603.777592:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777599:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.777602:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777611:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777613:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777616:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788572603.777619:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x679fc7b1 (ffff8e5a0a4b7f00) 00010000:00010000:1.0:1788572603.777622:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572603.777624:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777626:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777626:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777640:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1000/0x265cfe11109c029c lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777646:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcee00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572603.777647:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043c744e4/0x265cfe11109c055f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777653:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777655:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777664:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788572603.777670:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777672:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777676:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777680:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777680:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117ec00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572603.777685:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777696:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117f400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572603.777698:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777699:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777703:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788572603.777703:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777708:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777712:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777713:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777722:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051222cf/0x265cfe11109c0566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777737:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bd9311c/0x265cfe11109c056d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777739:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572603.777743:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xd0b639f4 (ffff8e590b3b4b00) 00010000:00010000:0.0:1788572603.777747:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777749:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.777754:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777758:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788572603.777767:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777769:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a4117f400/0x265cfe11109c02b8 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777776:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572603.777781:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777792:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777795:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572603.777796:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777798:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a4117fe00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572603.777805:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777806:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777816:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777821:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777844:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777851:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777851:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777856:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062f829ba/0x265cfe11109c0574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777868:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1600 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572603.777868:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777873:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777884:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777886:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6b84253/0x265cfe11109c0582 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777887:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777891:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572603.777898:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777908:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xfdd9083c (ffff8e590b3b4200) 00010000:00010000:2.0:1788572603.777909:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e128646/0x265cfe11109c057b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777916:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572603.777916:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572603.777917:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dce600 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:1.0:1788572603.777921:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777923:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777924:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777933:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572603.777934:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1600/0x265cfe11109c02d4 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777942:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777942:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572603.777947:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777949:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777960:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.777968:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5400 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:2.0:1788572603.777975:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777977:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.777980:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.777983:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.777995:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.778003:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778007:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d178d034/0x265cfe11109c0589 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778010:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1ffcf800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:3.0:1788572603.778010:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778015:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778034:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.778034:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097f84aef/0x265cfe11109c0590 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.778035:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778044:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572603.778052:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778052:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x3e3e6f26 (ffff8e5a03b22400) 00010000:00010000:1.0:1788572603.778060:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572603.778061:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8b06475/0x265cfe11109c0597 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.778061:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572603.778064:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572603.778065:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.778068:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572603.778070:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf200 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572603.778077:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778084:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a1ffcf800/0x265cfe11109c02f0 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.778092:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572603.778095:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.778097:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572603.778102:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572603.778109:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778111:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778125:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572603.778126:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572603.778128:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad3be7f/0x265cfe11109c059e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778135:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778144:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.778147:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778151:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572603.778152:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778156:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572603.778160:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572603.778163:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x54b0b1f4 (ffff8e590d91e700) 00010000:00010000:1.0:1788572603.778166:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.778168:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778172:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1800/0x265cfe11109c030c lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778173:0:10395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572603.778189:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778193:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778196:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778202:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f4000 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.778204:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778209:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778221:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xf142140 (ffff8e5a02ffba00) 00010000:00010000:1.0:1788572603.778223:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.778227:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778233:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4000/0x265cfe11109c0328 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778248:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778256:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778262:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778268:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1400 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.778271:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778277:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.778277:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788572603.778284:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x94c295fa (ffff8e5a039c6b00) 00010000:00010000:1.0:1788572603.778286:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572603.778289:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584524800:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.778290:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778295:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1400/0x265cfe11109c0344 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196070 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778298:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4d500/2, rc 0, transno 4294975706 00000100:00100000:2.0:1788572603.778312:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523008:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.778314:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778323:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778328:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905fece00/2, rc 0, transno 38654705699 00000100:00100000:3.0:1788572603.778328:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572603.778330:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778338:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e590d14ba00 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.778341:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778347:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523392:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.778348:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778361:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x1b7026cc (ffff8e5a03b22100) 00000100:00100000:3.0:1788572603.778361:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584524800 00000004:00080000:2.0:1788572603.778363:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4c700/2, rc 0, transno 4294975707 00010000:00010000:1.0:1788572603.778364:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572603.778366:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584524800 00010000:00010000:1.0:1788572603.778369:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778373:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523904:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.778379:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e590d14ba00/0x265cfe11109c0360 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 198183 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.778391:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584524928:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1788572603.778393:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4c000/2, rc 0, transno 4294975708 00010000:00010000:1.0:1788572603.778397:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.778400:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22759 00000100:00100000:2.0:1788572603.778403:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584524416:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.778405:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.778410:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584524800:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.778414:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778419:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905feed80/2, rc 0, transno 38654705696 00010000:00010000:1.0:1788572603.778421:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe0200 already unused, calling callback (ffffffffc180a4f0) 00002000:00080000:3.0:1788572603.778423:0:179391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:642 count 1 00010000:00010000:1.0:1788572603.778426:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.778431:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572603.778433:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584522752:0@lo:6:osp-syn-0-1.0 00002000:00010000:3.0:1788572603.778439:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572603.778443:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.778445:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778453:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0xa6a94833 (ffff8e590b3b4300) 00010000:00010000:3.0:1788572603.778454:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x282:0x0].0x0 since=9356s v=(0 0) 00000004:00080000:2.0:1788572603.778456:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4f100/2, rc 0, transno 4294975705 00010000:00010000:1.0:1788572603.778457:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572603.778458:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.778461:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.778466:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778467:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523264:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788572603.778469:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe0200/0x265cfe11109c037c lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188833 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.778471:0:41719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584524928 00010000:00010000:3.0:1788572603.778506:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.778508:0:41719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584524928 00010000:00010000:1.0:1788572603.778512:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778512:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905feea00/2, rc 0, transno 38654705697 00010000:00010000:3.0:1788572603.778522:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778523:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778523:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584523776:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.778535:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.778536:0:41719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22760 00010000:00010000:3.0:1788572603.778536:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778542:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905a52680/2, rc 0, transno 38654705698 00010000:00010000:1.0:1788572603.778546:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f5e00 already unused, calling callback (ffffffffc180a4f0) 00000100:00100000:0.0:1788572603.778550:0:41719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3642:x1875444584524928:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.778552:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778552:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875444584524288:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1788572603.778558:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572603.778565:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788572603.778567:0:41719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:648 count 1 00010000:00010000:1.0:1788572603.778582:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x494dcf1b (ffff8e5a0a4b7800) 00010000:00010000:1.0:1788572603.778585:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1788572603.778588:0:41719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572603.778589:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778600:0:41719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778601:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f5e00/0x265cfe11109c0398 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778610:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a1ff86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584525056:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1788572603.778623:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x288:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:0.0:1788572603.778627:0:41719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x288:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.778630:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778632:0:41719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.778639:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e59028ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+14:3642:x1875444584524800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 230us (310us total) trans 4294975709 rc 0/0 00010000:00010000:1.0:1788572603.778645:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778657:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572603.778657:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22759 00010000:00010000:1.0:1788572603.778661:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778662:0:41719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.778675:0:179391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584525056 00010000:00010000:1.0:1788572603.778676:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5905fe1e00 already unused, calling callback (ffffffffc180a4f0) 00000100:00100000:3.0:1788572603.778680:0:179391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584525056 00010000:00010000:1.0:1788572603.778682:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778684:0:41719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778694:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778698:0:41719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572603.778706:0:179391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22761 00000004:00080000:2.0:1788572603.778707:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905fed500/2, rc 0, transno 38654705693 00010000:00010000:1.0:1788572603.778709:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x610cb780 (ffff8e5903395800) 00010000:00010000:1.0:1788572603.778716:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572603.778716:0:179391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+14:3643:x1875444584525056:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1788572603.778719:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584523136:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1788572603.778721:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778726:0:41719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788572603.778729:0:179391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:644 count 1 00010000:00010000:1.0:1788572603.778734:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5905fe1e00/0x265cfe11109c03b4 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188050 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778736:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4e680/2, rc 0, transno 4294975704 00000100:00100000:2.0:1788572603.778743:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584523520:0@lo:6:osp-syn-1-1.0 00002000:00010000:3.0:1788572603.778745:0:179391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572603.778754:0:179391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778757:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778760:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905fee680/2, rc 0, transno 38654705694 00010000:00010000:3.0:1788572603.778764:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x284:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.778765:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778769:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584524032:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1788572603.778770:0:179391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x284:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.778774:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.778778:0:179391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778783:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a245f4800 already unused, calling callback (ffffffffc180a4f0) 00010000:00010000:1.0:1788572603.778786:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778789:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905a52d80/2, rc 0, transno 38654705695 00010000:00010000:3.0:1788572603.778789:0:179391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778793:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778799:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584524544:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1788572603.778802:0:179391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.778804:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002729:0x2b:0x0].0x76709d63 (ffff8e5a0a4b7b00) 00000100:00100000:0.0:1788572603.778807:0:41719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a31c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3642:x1875444584524928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 258us (375us total) trans 38654705700 rc 0/0 00010000:00010000:1.0:1788572603.778809:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572603.778814:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 2/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778818:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4f480/2, rc 0, transno 4294975702 00010000:00010000:3.0:1788572603.778821:0:179391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572603.778823:0:41719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22760 00010000:00010000:1.0:1788572603.778843:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8e5a245f4800/0x265cfe11109c03d0 lrc: 0/0,0 mode: --/TXN res: [0x240002729:0x2b:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188048 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778843:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584523648:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1788572603.778853:0:179391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1788572603.778862:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4fb80/2, rc 0, transno 4294975703 00000100:00100000:2.0:1788572603.778867:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584524160:0@lo:6:osp-syn-1-1.0 00000020:00080000:1.0:1788572603.778879:0:202694:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 25769803847 committed batchid 17179873001 00000004:00080000:2.0:1788572603.778881:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5905a51f80/2, rc 0, transno 38654705692 00000100:00100000:2.0:1788572603.778887:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5905a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875444584524672:0@lo:6:osp-syn-0-1.0 00000020:00080000:1.0:1788572603.778925:0:202694:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179873001 00010000:00010000:0.0:1788572603.778927:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1788572603.778935:0:179391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584525056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 216us (281us total) trans 4294975710 rc 0/0 00010000:00010000:0.0:1788572603.778936:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572603.778943:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a1ff86d80/2, rc 0, transno 4294975710 00000100:00100000:2.0:1788572603.778953:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a1ff86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584525056:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1788572603.778954:0:179391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22761 00010000:00010000:0.0:1788572603.778956:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24535000 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572603.778963:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778967:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788572603.778977:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.778979:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584525184:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1788572603.778982:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572603.778991:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.778997:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.779000:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a40dcf800 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572603.779005:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779012:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c81ea12a/0x265cfe11109c05a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572603.779017:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572603.779020:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779037:0:82817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572603.779042:0:82817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.779044:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779057:0:82817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a24534e00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:3.0:1788572603.779062:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df48b94/0x265cfe11109c05ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779063:0:82817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779085:0:82817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.779097:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572603.779099:0:82817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572603.779100:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572603.779102:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875444584525184 00010000:00010000:3.0:1788572603.779106:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572603.779108:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875444584525184 00010000:00010000:0.0:1788572603.779115:0:82817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e433b91/0x265cfe11109c05b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779132:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572603.779132:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4d880/2, rc 0, transno 38654705700 00010000:00010000:0.0:1788572603.779135:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572603.779139:0:82817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572603.779142:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584524928:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1788572603.779154:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a36aadf80/2, rc 0, transno 4294975709 00000100:00100000:3.0:1788572603.779158:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a36aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875444584524800:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1788572603.779171:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572603.779184:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22762 00000100:00100000:1.0:1788572603.779194:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3643:x1875444584525184:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1788572603.779207:0:43917:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:645 count 1 00002000:00010000:1.0:1788572603.779224:0:43917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572603.779230:0:43917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.779239:0:43917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x285:0x0].0x0 since=9356s v=(0 0) 00010000:00010000:1.0:1788572603.779243:0:43917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x285:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572603.779247:0:43917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.779257:0:43917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.779266:0:43917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.779274:0:43917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572603.779291:0:43917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572603.779301:0:10396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572603.779306:0:10396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779315:0:10396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5a1fcd2c00 already unused, calling callback (ffffffffc0c114f0) 00010000:00010000:0.0:1788572603.779319:0:10396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779328:0:10396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779340:0:10396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779348:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e5716b/0x265cfe11109c05ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572603.779364:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572603.779367:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572603.779370:0:10396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572603.779379:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5a1ff84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+15:3643:x1875444584525184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 185us (364us total) trans 38654705701 rc 0/0 00000100:00100000:1.0:1788572603.779386:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22762 00000004:00080000:1.0:1788572603.779466:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5a31c4dc00/2, rc 0, transno 38654705701 00000100:00100000:1.0:1788572603.779472:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e5a31c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875444584525184:0@lo:6:osp-syn-0-1.0 Debug log: 75255 lines, 75255 kept, 0 dropped, 0 bad.